-- Logs begin at Tue 2022-07-26 15:23:43 UTC, end at Tue 2022-07-26 16:41:12 UTC. -- Jul 26 16:03:11.348451 dv-cinder-851042-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 26 16:03:11.355716 dv-cinder-851042-1-smb devstack@keystone.service[80587]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 26 16:03:11.360798 dv-cinder-851042-1-smb devstack@keystone.service[80587]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 16:03:11 2022] *** Jul 26 16:03:11.360798 dv-cinder-851042-1-smb devstack@keystone.service[80587]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 16:03:11.360798 dv-cinder-851042-1-smb devstack@keystone.service[80587]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 16:03:11.360798 dv-cinder-851042-1-smb devstack@keystone.service[80587]: nodename: dv-cinder-851042-1-smb Jul 26 16:03:11.360798 dv-cinder-851042-1-smb devstack@keystone.service[80587]: machine: x86_64 Jul 26 16:03:11.360798 dv-cinder-851042-1-smb devstack@keystone.service[80587]: clock source: unix Jul 26 16:03:11.360798 dv-cinder-851042-1-smb devstack@keystone.service[80587]: pcre jit disabled Jul 26 16:03:11.360798 dv-cinder-851042-1-smb devstack@keystone.service[80587]: detected number of CPU cores: 4 Jul 26 16:03:11.360798 dv-cinder-851042-1-smb devstack@keystone.service[80587]: current working directory: / Jul 26 16:03:11.360798 dv-cinder-851042-1-smb devstack@keystone.service[80587]: detected binary path: /usr/bin/uwsgi-core Jul 26 16:03:11.360798 dv-cinder-851042-1-smb devstack@keystone.service[80587]: your processes number limit is 47680 Jul 26 16:03:11.360798 dv-cinder-851042-1-smb devstack@keystone.service[80587]: your memory page size is 4096 bytes Jul 26 16:03:11.360798 dv-cinder-851042-1-smb devstack@keystone.service[80587]: detected max file descriptor number: 2048 Jul 26 16:03:11.360798 dv-cinder-851042-1-smb devstack@keystone.service[80587]: lock engine: pthread robust mutexes Jul 26 16:03:11.360798 dv-cinder-851042-1-smb devstack@keystone.service[80587]: thunder lock: enabled Jul 26 16:03:11.360798 dv-cinder-851042-1-smb devstack@keystone.service[80587]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 26 16:03:11.360798 dv-cinder-851042-1-smb devstack@keystone.service[80587]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 16:03:11.399216 dv-cinder-851042-1-smb devstack@keystone.service[80587]: Python main interpreter initialized at 0x55c7baf7e9c0 Jul 26 16:03:11.399216 dv-cinder-851042-1-smb devstack@keystone.service[80587]: python threads support enabled Jul 26 16:03:11.399216 dv-cinder-851042-1-smb devstack@keystone.service[80587]: your server socket listen backlog is limited to 100 connections Jul 26 16:03:11.399216 dv-cinder-851042-1-smb devstack@keystone.service[80587]: your mercy for graceful operations on workers is 90 seconds Jul 26 16:03:11.399568 dv-cinder-851042-1-smb devstack@keystone.service[80587]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 16:03:11.399648 dv-cinder-851042-1-smb devstack@keystone.service[80587]: *** Operational MODE: preforking *** Jul 26 16:03:11.399918 dv-cinder-851042-1-smb devstack@keystone.service[80587]: *** uWSGI is running in multiple interpreter mode *** Jul 26 16:03:11.399918 dv-cinder-851042-1-smb devstack@keystone.service[80587]: spawned uWSGI master process (pid: 80587) Jul 26 16:03:11.400124 dv-cinder-851042-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 26 16:03:11.404684 dv-cinder-851042-1-smb devstack@keystone.service[80587]: spawned uWSGI worker 1 (pid: 80601, cores: 1) Jul 26 16:03:11.404684 dv-cinder-851042-1-smb devstack@keystone.service[80587]: spawned uWSGI worker 2 (pid: 80602, cores: 1) Jul 26 16:03:11.404684 dv-cinder-851042-1-smb devstack@keystone.service[80587]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 16:03:17.025734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 16:03:17.025734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: from cryptography.utils import int_from_bytes Jul 26 16:03:17.026467 dv-cinder-851042-1-smb devstack@keystone.service[80602]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 16:03:17.026467 dv-cinder-851042-1-smb devstack@keystone.service[80602]: from cryptography.utils import int_from_bytes Jul 26 16:03:17.026882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 16:03:17.026882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: from cryptography.utils import int_from_bytes Jul 26 16:03:17.026987 dv-cinder-851042-1-smb devstack@keystone.service[80602]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 16:03:17.026987 dv-cinder-851042-1-smb devstack@keystone.service[80602]: from cryptography.utils import int_from_bytes Jul 26 16:03:17.031495 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 16:03:17.031698 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 16:03:17.031893 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] command line args: [] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 16:03:17.031984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 16:03:17.032165 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 16:03:17.032249 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 16:03:17.032347 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ================================================================================ {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 16:03:17.032433 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] command line args: [] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 16:03:17.032605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] admin_token = **** {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.032711 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 16:03:17.032790 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ================================================================================ {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 16:03:17.032870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] config_dir = [] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.033036 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] admin_token = **** {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.033115 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.033223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] config_source = [] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.033305 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] config_dir = [] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.033407 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] debug = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.033496 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.033610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.033900 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] config_source = [] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.033900 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] debug = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.034092 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.034205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.034330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.034427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.034427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.034617 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.034718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.034823 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.034925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.035031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] list_limit = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.035031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] log_config_append = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.035217 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] list_limit = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.035323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.035423 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] log_config_append = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.035531 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] log_dir = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.035632 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.035727 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] log_file = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.035819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] log_dir = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.035819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] log_file = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.036060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.036134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.036254 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.036334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.036454 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.036537 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.036613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.036613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.036832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.036949 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.037028 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.037028 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.037222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.037300 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.037424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.037532 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.037619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.037766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.037977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.038058 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.038220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.038383 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.038514 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.038701 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.038809 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.038976 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.039221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.039484 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.141/identity {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.039631 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.039706 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] publish_errors = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.039888 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.040030 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.040118 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.040286 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.040501 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.040584 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.040782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.041021 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] standard_threads = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.041112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.141/identity {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.041216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] publish_errors = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.041297 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.041487 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.041572 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.041666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.041845 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] use_journal = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.041927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.042009 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] use_json = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.042140 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.042222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] use_stderr = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.042456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] use_syslog = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.042552 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.042625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.042778 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.042859 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.042975 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] standard_threads = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.043104 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.043215 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.043366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.043544 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.043623 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.043846 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.043971 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.044089 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.044181 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] use_journal = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.044345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.044462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] use_json = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.044584 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.044815 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] use_stderr = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.044906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.045085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] use_syslog = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.045171 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.045337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:03:17.045415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.045576 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.045658 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.045826 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.045915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.046066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.046150 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.046317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.046401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.046569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.046653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.046809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.046886 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.047058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.047134 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.047297 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.047385 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.047587 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.047709 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.047829 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.047908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.048332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.048427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.048576 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.048653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.048855 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.048933 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.049096 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.049247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.049326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.049396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.049551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.049635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.049786 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.049874 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.050024 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.050108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.050276 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.050354 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.050521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.050597 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.050751 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.050827 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.050986 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.051062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.051235 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.051313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.051484 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.051566 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.051723 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.051805 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.051951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.052034 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.052183 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.052259 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.052412 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.052494 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.052646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.052811 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.052924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.053036 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.053159 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.053237 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.053393 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.053470 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.053626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.053737 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.053893 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.053975 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.054144 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.054219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.054377 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.054444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.054614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.054691 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.054841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.054929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.055076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.055152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.055313 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.055387 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.055539 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.055623 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.055769 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.055852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.055998 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.056075 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.056227 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.056313 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.056461 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.056543 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.056715 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.056806 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.056946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.057034 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.057177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.057253 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.057403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.057474 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.057634 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.057722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.057866 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.058110 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.058242 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.058373 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.058494 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.058611 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.058765 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.058843 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.059010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.059086 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.059248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.059332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.059492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.059570 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.059726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.059801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.059973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.060060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.060207 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.060284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.060440 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.060516 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.060679 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.060773 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.060946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.061031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.061184 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.061266 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.061416 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.061503 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.061654 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.061731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.061888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.061966 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.062124 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.062209 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.062371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.062456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.062610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.062693 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.062850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.062927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.063080 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.063163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.063311 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.063394 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.063543 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.063620 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.063788 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.063880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.064024 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.064100 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.064259 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.064336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.064497 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.064583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.064752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.064832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.064985 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.065062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.065217 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.065309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.065449 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.065526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.065680 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.065757 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.065913 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.065997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.066147 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.066230 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.066385 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.066461 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.066616 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.066698 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.066854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.066931 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.067087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.067164 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.067320 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.067398 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.067551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.067628 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.067779 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.067857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.068007 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.068085 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.068235 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.068313 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.069020 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.069095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] auth.external = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.069290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.069368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.069537 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.069615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.069793 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.069877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.070035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] auth.password = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.070113 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.070268 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.070351 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] auth.token = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.070508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.070584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.070746 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.070836 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.070993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.071070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.071222 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] auth.external = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.071299 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.071450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.071528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.071705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.071782 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.071939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.072017 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.072178 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] credential.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.072256 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] auth.password = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.072403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] auth.token = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.072480 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.072641 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.072737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.072898 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.072975 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.073144 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.073224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.073374 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.073451 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.073608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.073684 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.073853 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.073930 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.074081 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.074166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.074314 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] credential.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.074392 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.074559 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.074638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.074805 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.074883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.075049 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.075126 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.075267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.075342 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.075510 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.075588 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.075806 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.075883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.076084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.076162 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] federation.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.076337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.076416 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.076582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.076707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.079559 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.079633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.079721 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.079812 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.079887 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.079957 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.080035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.080106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.080176 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.080245 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.080313 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.080382 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.080459 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.080530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] federation.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.080599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.080693 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.080767 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.080837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.080921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.080999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.081070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.081138 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.081207 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.081286 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.081358 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.081427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.081496 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.081564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.081632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.081710 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.081782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.081851 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.081958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.082034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.082104 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.082182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.082182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.082301 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.082301 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.082414 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.082481 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.082557 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.082629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.082698 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.082767 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.082843 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.082914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.082990 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.083061 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.083130 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.083130 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.083244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.083312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.083387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.083459 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.083528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.083591 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.083659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.083728 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.083804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.083874 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.083943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.084148 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.084782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.084913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.085005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.085160 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.085240 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.085414 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.085490 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.085657 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.085742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.085908 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.085985 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.086144 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.086227 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.086376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.086461 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.086604 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.086681 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.086838 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.086917 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.087064 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.087149 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.087296 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.087374 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.087532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.087611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.087767 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.087865 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.088041 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.088125 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.088286 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.088363 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.088526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.088613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.088791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.088871 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.089023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.089100 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.089261 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.089349 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.089504 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.089581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.089732 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.089809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.089969 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.090056 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.090199 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.090276 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.090434 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.090511 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.090667 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.090745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.090903 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.090981 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.091138 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.091215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.091370 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.091449 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.091601 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.091677 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.091846 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.091929 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.092073 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.092151 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.092302 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.092379 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.092547 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.092624 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.092813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.092894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.093047 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.093126 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.093315 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.093430 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.093551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.093632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.093780 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.093857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.094016 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.094092 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.094258 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.094337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.094487 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.094563 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.094731 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.094808 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.094974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.095052 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.095218 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.095296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.095450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.095577 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.095663 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.095832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.095909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.096069 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.096147 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.096321 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.096406 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.096553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.096630 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.096813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.096890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.097054 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.097143 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.097295 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.097373 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.097543 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.097652 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.097794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.097904 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.098035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.098137 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.098292 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.098403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.098539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.098690 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.098772 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.098864 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.099013 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.099091 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.099252 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.099370 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.099522 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.099617 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.099820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.099899 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.100067 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.100154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.100305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.100383 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.100538 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.100632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.100803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] resource.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.100894 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.101038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.101114 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.101269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.101346 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.101504 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.101590 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.101747 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.101825 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.101986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.102064 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.102216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.102301 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.102455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.102539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.102708 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] resource.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.102799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.102951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.103040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.103187 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] role.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.103264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.103420 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.103496 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] role.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.103658 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.103744 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.103903 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.103981 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.104136 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.104215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.104380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.104470 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.104629 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.104737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.104871 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.104949 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.108228 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] role.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.108304 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.108364 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] role.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.108421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.108484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.108554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.108621 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.108707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.108789 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.108862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.108931 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.109000 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.109077 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.109148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.109217 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.109282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.109350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.109419 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.109495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.109566 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.109634 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.109703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.109772 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.109841 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.109923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.109923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.110043 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.110112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.110181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.110245 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.110321 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.110321 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.110438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.110512 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.110583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.110651 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.110728 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.110800 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.110875 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.110947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.111016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.111093 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.111165 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.111234 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.111303 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.111371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.111440 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.111516 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.111588 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.111657 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.111726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.111795 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.111864 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.111940 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.112011 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.112076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] token.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.112144 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.112214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.112283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.112359 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.112430 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.112499 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.112568 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.112636 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.112752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.112835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.112960 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.113062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.113189 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.113309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.113422 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] token.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.113554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.113654 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.113803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.113900 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.114042 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.114161 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.114324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.114403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.114562 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.114640 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.114810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.114888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.115067 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.115146 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.115324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.115404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.115570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.115648 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.115802 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.115880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.116036 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.116113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.connection = **** {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.116268 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.116355 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.116510 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.116597 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.116777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.116858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.117008 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.117086 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.117247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.117336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.117508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.117586 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.117747 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.117825 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.connection = **** {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.117984 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.118135 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.118231 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.118318 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.118464 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.118541 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.118703 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.118781 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.118935 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.119021 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.119167 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.119246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.119403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.119481 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.119655 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.119742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.119910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.119998 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.120145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.120223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.120379 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.120465 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.120538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 16:03:17.120609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.120867 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.121103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.121343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.121571 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.121807 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.122036 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:03:17.122202 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 16:03:17.151018 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.151173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.151254 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.151366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.151449 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.151596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.159743 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.159957 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.189571 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.189750 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.189933 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.190170 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.242607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.243312 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.293367 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.293597 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.294469 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.294706 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.360639 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.360896 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.361041 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.361126 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.361272 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.361356 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.361494 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.361577 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.361734 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.361816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.361952 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.362168 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.386373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.386604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.386685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.386830 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.386912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.387052 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.387132 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.387291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.387381 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.387507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.387588 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.387719 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.387799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.387929 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.398862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.398991 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.411782 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.411888 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.412014 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.412112 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.412264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.412491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.412573 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.412738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.412934 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.413017 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.413174 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.413323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.413711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.414101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 16:03:17.433107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.433311 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 16:03:17.433646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.433843 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 16:03:17.434112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.434371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.434628 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.434719 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.434840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 16:03:17.434920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.435182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.435384 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 16:03:17.435657 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.435922 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.436182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.436441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.444602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.444867 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.445133 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.445410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.446741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.447020 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.447292 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.447584 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.452855 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.454521 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.457595 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.457874 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.458153 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.458433 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.458712 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.459001 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.459274 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.459356 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.459545 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.459627 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.459810 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.459899 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.460079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.460168 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.460340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.460421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.460641 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.460936 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.461214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.461489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.461766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.462035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.483357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.484866 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.485078 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.485161 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.486578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.486863 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.489731 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.490013 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.490816 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.492029 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.492310 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.492594 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.497408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.497688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.499355 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.499643 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.501840 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.502124 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.502414 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.502694 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.502971 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.503252 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.503520 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.503803 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.503883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.504092 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.504390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.504698 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.504985 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.505266 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.505550 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.505899 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.520251 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.520538 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.522418 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.522720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.524469 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.526683 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.527631 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.527926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.530138 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.530445 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.532297 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.534942 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.535464 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.538193 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.538700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.538996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.539279 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.539572 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.539858 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.540149 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.541394 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.541700 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.541992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.542298 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.542581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.542861 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.556956 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.557237 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.557501 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.557770 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.559893 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.560180 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.560450 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.560744 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.564697 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.566248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.566521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.567655 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.569803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.569968 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.570083 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.570245 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.570548 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.570831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.571115 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.572933 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.573216 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.573518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.573815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.574108 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.582512 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.582790 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.583070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.583349 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.583626 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.583897 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.584194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.585672 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.585954 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.586235 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.586516 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.586798 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.587079 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.587355 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.599756 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.602739 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.603106 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.605712 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.606153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.608119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.609158 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.609768 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.610051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.610329 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.611606 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.613304 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.613611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.613898 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.617364 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.618950 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.620969 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.621903 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.622190 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.622471 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.622582 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.622744 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.625557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.625852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.626141 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.626431 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.630775 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.631639 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.631926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.635363 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.635652 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.635934 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.638777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.639052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.639330 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.639605 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.639888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.640172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.640442 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.640742 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.641113 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.641395 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.641681 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.641955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.642250 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.642513 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.642863 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 16:03:17.643146 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.643427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.643706 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.643993 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.644277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.644552 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.644857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.645235 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.645521 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.645806 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.646091 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.646362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.646652 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 16:03:17.675954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c7baf7e9c0 pid: 80602 (default app) Jul 26 16:03:17.679718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38ced3-8598-4c52-a792-5554ac749748 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:17.680001 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38ced3-8598-4c52-a792-5554ac749748 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:17.680274 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38ced3-8598-4c52-a792-5554ac749748 None None] PATH_INFO: `/v3` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:17.681138 dv-cinder-851042-1-smb devstack@keystone.service[80601]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c7baf7e9c0 pid: 80601 (default app) Jul 26 16:03:17.684551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1/1] 10.222.0.141 () {50 vars in 796 bytes} [Tue Jul 26 16:03:17 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:26.254494 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecdd30-84a4-4445-b84e-55427e3e326a None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:26.254979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecdd30-84a4-4445-b84e-55427e3e326a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:26.254979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecdd30-84a4-4445-b84e-55427e3e326a None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:26.259951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1/2] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:26 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:03:26.265418 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15e183-17ca-4c6c-8c4f-77a4560ca16d None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:26.265826 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15e183-17ca-4c6c-8c4f-77a4560ca16d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:26.265969 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15e183-17ca-4c6c-8c4f-77a4560ca16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:26.338248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: INFO dbcounter [None req-bb15e183-17ca-4c6c-8c4f-77a4560ca16d None None] Registered counter for database keystone Jul 26 16:03:26.359107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG oslo_db.sqlalchemy.engines [None req-bb15e183-17ca-4c6c-8c4f-77a4560ca16d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80602) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 16:03:26.365909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writer thread running {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 16:03:26.543216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG passlib.handlers.bcrypt [None req-bb15e183-17ca-4c6c-8c4f-77a4560ca16d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80602) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 16:03:26.543561 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG passlib.handlers.bcrypt [None req-bb15e183-17ca-4c6c-8c4f-77a4560ca16d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80602) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 16:03:26.597753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-bb15e183-17ca-4c6c-8c4f-77a4560ca16d None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:26.599391 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-bb15e183-17ca-4c6c-8c4f-77a4560ca16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:26.721385 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 2/3] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:26 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 26 16:03:26.855541 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecdd30-84a4-4445-b84e-55427e3e326a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:26.924499 dv-cinder-851042-1-smb devstack@keystone.service[80601]: INFO dbcounter [None req-f7ecdd30-84a4-4445-b84e-55427e3e326a None None] Registered counter for database keystone Jul 26 16:03:26.946272 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG oslo_db.sqlalchemy.engines [None req-f7ecdd30-84a4-4445-b84e-55427e3e326a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80601) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 16:03:26.952562 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writer thread running {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 16:03:27.070614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecdd30-84a4-4445-b84e-55427e3e326a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:27.074886 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac19fd-4ea0-43e1-a3d3-2fa0714f6711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:27.075528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac19fd-4ea0-43e1-a3d3-2fa0714f6711 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:27.075819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac19fd-4ea0-43e1-a3d3-2fa0714f6711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:27.076095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac19fd-4ea0-43e1-a3d3-2fa0714f6711 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:27.084593 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac19fd-4ea0-43e1-a3d3-2fa0714f6711 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:27.135384 dv-cinder-851042-1-smb devstack@keystone.service[80601]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4eac19fd-4ea0-43e1-a3d3-2fa0714f6711 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 16:03:27.135729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac19fd-4ea0-43e1-a3d3-2fa0714f6711 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:27.145288 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 2/4] 10.222.0.141 () {58 vars in 1329 bytes} [Tue Jul 26 16:03:26 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 16:03:27.151747 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15e183-17ca-4c6c-8c4f-77a4560ca16d None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:27.166319 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15e183-17ca-4c6c-8c4f-77a4560ca16d None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:27.170665 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3199fda-6a90-4f0f-91db-f5dee7708073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:27.171758 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3199fda-6a90-4f0f-91db-f5dee7708073 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:27.172039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3199fda-6a90-4f0f-91db-f5dee7708073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:27.172313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3199fda-6a90-4f0f-91db-f5dee7708073 admin admin] PATH_INFO: `/v3/projects/a7fee3c27a264e38accf0b43d34d249e` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:27.174058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3199fda-6a90-4f0f-91db-f5dee7708073 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7fee3c27a264e38accf0b43d34d249e)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:27.227285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b3199fda-6a90-4f0f-91db-f5dee7708073 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 16:03:27.227635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3199fda-6a90-4f0f-91db-f5dee7708073 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:27.232228 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 3/5] 10.222.0.141 () {56 vars in 1212 bytes} [Tue Jul 26 16:03:27 2022] GET /identity/v3/projects/a7fee3c27a264e38accf0b43d34d249e => generated 345 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:29.194570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b04f9-c1df-4cbf-bc72-620ec2c12f72 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:29.195052 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b04f9-c1df-4cbf-bc72-620ec2c12f72 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:29.195052 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b04f9-c1df-4cbf-bc72-620ec2c12f72 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:29.199150 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 3/6] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:29 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:29.204553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8ef6d-a5b4-4efe-8da8-0cf948e0bfda None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:29.204971 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8ef6d-a5b4-4efe-8da8-0cf948e0bfda None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:29.205138 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8ef6d-a5b4-4efe-8da8-0cf948e0bfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:29.227374 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8bd8ef6d-a5b4-4efe-8da8-0cf948e0bfda None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:29.228913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8bd8ef6d-a5b4-4efe-8da8-0cf948e0bfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:29.236652 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 4/7] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:29 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 26 16:03:29.258817 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b04f9-c1df-4cbf-bc72-620ec2c12f72 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:29.270773 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b04f9-c1df-4cbf-bc72-620ec2c12f72 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:29.274953 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dfa54-318b-430e-bbf0-24e372bcf86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:29.275556 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dfa54-318b-430e-bbf0-24e372bcf86b admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:29.275840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dfa54-318b-430e-bbf0-24e372bcf86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:29.276116 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dfa54-318b-430e-bbf0-24e372bcf86b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:29.283728 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5dfa54-318b-430e-bbf0-24e372bcf86b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:29.285531 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5dfa54-318b-430e-bbf0-24e372bcf86b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:29.294648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 4/8] 10.222.0.141 () {58 vars in 1329 bytes} [Tue Jul 26 16:03:29 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 16:03:29.300042 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8ef6d-a5b4-4efe-8da8-0cf948e0bfda None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:29.309640 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8ef6d-a5b4-4efe-8da8-0cf948e0bfda None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:29.313999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abced907-28c2-4c47-8982-0fab6470ad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:29.314629 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abced907-28c2-4c47-8982-0fab6470ad22 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:29.314916 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abced907-28c2-4c47-8982-0fab6470ad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:29.315199 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abced907-28c2-4c47-8982-0fab6470ad22 admin admin] PATH_INFO: `/v3/users/6845518adc8f4e04b03cfbd69adea2d2` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:29.316561 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abced907-28c2-4c47-8982-0fab6470ad22 admin admin] RBAC: Authorizing `identity:get_user(user_id=6845518adc8f4e04b03cfbd69adea2d2)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:29.318423 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abced907-28c2-4c47-8982-0fab6470ad22 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:29.319950 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 5/9] 10.222.0.141 () {56 vars in 1203 bytes} [Tue Jul 26 16:03:29 2022] GET /identity/v3/users/6845518adc8f4e04b03cfbd69adea2d2 => generated 248 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:03:31.351029 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a1eaa-4880-4595-b717-edd438addff5 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:31.351515 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a1eaa-4880-4595-b717-edd438addff5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:31.351515 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a1eaa-4880-4595-b717-edd438addff5 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:31.352869 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 5/10] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:03:31.358185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84da11-6c33-4c7d-b164-8cd852c311d5 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:31.358597 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84da11-6c33-4c7d-b164-8cd852c311d5 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:31.358743 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84da11-6c33-4c7d-b164-8cd852c311d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:31.378092 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-fc84da11-6c33-4c7d-b164-8cd852c311d5 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:31.379288 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fc84da11-6c33-4c7d-b164-8cd852c311d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:31.399269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55282e-bc73-45cc-8dae-1b3efdc21ada None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:31.399562 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55282e-bc73-45cc-8dae-1b3efdc21ada None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:31.399844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55282e-bc73-45cc-8dae-1b3efdc21ada None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:31.401606 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 6/11] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:03:31.407240 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6f57b-28e6-41b8-a2ba-b05c9b8d4a08 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:31.407530 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6f57b-28e6-41b8-a2ba-b05c9b8d4a08 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:31.407811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6f57b-28e6-41b8-a2ba-b05c9b8d4a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:31.450738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG passlib.handlers.bcrypt [None req-bfc6f57b-28e6-41b8-a2ba-b05c9b8d4a08 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80601) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 16:03:31.451147 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG passlib.handlers.bcrypt [None req-bfc6f57b-28e6-41b8-a2ba-b05c9b8d4a08 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80601) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 16:03:31.459384 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 6/12] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:31.482540 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84da11-6c33-4c7d-b164-8cd852c311d5 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:31.499355 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-bfc6f57b-28e6-41b8-a2ba-b05c9b8d4a08 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:31.500985 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-bfc6f57b-28e6-41b8-a2ba-b05c9b8d4a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:31.509877 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:31.591637 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84da11-6c33-4c7d-b164-8cd852c311d5 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:31.607303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 7/13] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:03:31.624188 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ec92c-f480-42e9-a863-ec0d8dba9c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:31.624862 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ec92c-f480-42e9-a863-ec0d8dba9c5a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:31.625146 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ec92c-f480-42e9-a863-ec0d8dba9c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:31.625422 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ec92c-f480-42e9-a863-ec0d8dba9c5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:31.628596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6f57b-28e6-41b8-a2ba-b05c9b8d4a08 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:31.636745 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ec92c-f480-42e9-a863-ec0d8dba9c5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:03:31.645584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-4f3ec92c-f480-42e9-a863-ec0d8dba9c5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:03:31.645584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:03:31.645584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:03:31.645584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:03:31.645584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:03:31.645584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:03:31.645584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:03:31.645584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:03:31.645584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:03:31.645584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:03:31.645584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:03:31.645584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:03:31.645584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:03:31.645584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:03:31.645584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:03:31.645584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:03:31.646913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:03:31.646913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:03:31.646913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:03:31.646913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:03:31.646913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:03:31.646913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:03:31.646913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:03:31.646913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:03:31.646913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:03:31.646913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:03:31.646913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:03:31.646913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:03:31.646913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:03:31.646913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:03:31.646913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:03:31.646913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:03:31.647926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:03:31.647926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:03:31.647926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:03:31.647926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:03:31.647926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:03:31.647926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:03:31.647926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:03:31.647926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:03:31.647926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:03:31.647926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:03:31.647926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:03:31.647926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:03:31.647926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 7/14] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:03:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:03:31.653007 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ec92c-f480-42e9-a863-ec0d8dba9c5a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:31.729856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6f57b-28e6-41b8-a2ba-b05c9b8d4a08 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:31.732121 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:31.735481 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:31.753601 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ec92c-f480-42e9-a863-ec0d8dba9c5a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:31.765237 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ae527-243f-4697-aca2-1b9b71ed6611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:31.766098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ae527-243f-4697-aca2-1b9b71ed6611 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:31.766380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ae527-243f-4697-aca2-1b9b71ed6611 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:31.766653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ae527-243f-4697-aca2-1b9b71ed6611 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:31.789637 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4603db6-e895-4a9a-a8fd-0fbbdd6f0aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:31.790259 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4603db6-e895-4a9a-a8fd-0fbbdd6f0aae None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:31.790544 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4603db6-e895-4a9a-a8fd-0fbbdd6f0aae None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:31.790821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4603db6-e895-4a9a-a8fd-0fbbdd6f0aae None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:31.791542 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4603db6-e895-4a9a-a8fd-0fbbdd6f0aae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:31.791852 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4603db6-e895-4a9a-a8fd-0fbbdd6f0aae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:31.793278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4603db6-e895-4a9a-a8fd-0fbbdd6f0aae None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:31.805373 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 8/15] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:03:31 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:03:31.810904 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4603db6-e895-4a9a-a8fd-0fbbdd6f0aae None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:31.835736 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ae527-243f-4697-aca2-1b9b71ed6611 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:31.837317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ae527-243f-4697-aca2-1b9b71ed6611 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:31.938249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 8/16] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:03:31 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 16:03:31.944737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ae527-243f-4697-aca2-1b9b71ed6611 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:31.947928 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:32.016049 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4603db6-e895-4a9a-a8fd-0fbbdd6f0aae None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:32.046456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ae527-243f-4697-aca2-1b9b71ed6611 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:32.052365 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd9a99-5bd5-49ec-b2b1-eeef9e1ac01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:32.053050 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd9a99-5bd5-49ec-b2b1-eeef9e1ac01f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:32.053338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd9a99-5bd5-49ec-b2b1-eeef9e1ac01f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:32.053615 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd9a99-5bd5-49ec-b2b1-eeef9e1ac01f None admin] PATH_INFO: `/v3/users/6845518adc8f4e04b03cfbd69adea2d2` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:32.054792 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd9a99-5bd5-49ec-b2b1-eeef9e1ac01f None admin] RBAC: Authorizing `identity:get_user(user_id=6845518adc8f4e04b03cfbd69adea2d2)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:32.056253 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd9a99-5bd5-49ec-b2b1-eeef9e1ac01f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:32.057882 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 9/17] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:03:31 2022] GET /identity/v3/users/6845518adc8f4e04b03cfbd69adea2d2 => generated 248 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:03:32.063274 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd9a99-5bd5-49ec-b2b1-eeef9e1ac01f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:32.078052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:32.082232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcb3b7-dcb5-4214-ad91-afc9d979b96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:32.083094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcb3b7-dcb5-4214-ad91-afc9d979b96f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:32.090035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcb3b7-dcb5-4214-ad91-afc9d979b96f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:32.090035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcb3b7-dcb5-4214-ad91-afc9d979b96f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:32.102210 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcb3b7-dcb5-4214-ad91-afc9d979b96f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:32.103669 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcb3b7-dcb5-4214-ad91-afc9d979b96f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:32.121245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-0dfcb3b7-dcb5-4214-ad91-afc9d979b96f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:03:32.121245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:03:32.121245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:03:32.121245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:03:32.121245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:03:32.121245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:03:32.121245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:03:32.121245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:03:32.121245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:03:32.121245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:03:32.121245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:03:32.121245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:03:32.121245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:03:32.121245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:03:32.121245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:03:32.122060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:03:32.122060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:03:32.122060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:03:32.122060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:03:32.122060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:03:32.122060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:03:32.122060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:03:32.122060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:03:32.122060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:03:32.122060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:03:32.122060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:03:32.122060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:03:32.122060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:03:32.122060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:03:32.122060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:03:32.122060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:03:32.122060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:03:32.123047 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:03:32.123047 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:03:32.123047 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:03:32.123047 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:03:32.123047 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 9/18] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:03:32.128208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcb3b7-dcb5-4214-ad91-afc9d979b96f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:32.165598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd9a99-5bd5-49ec-b2b1-eeef9e1ac01f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:32.183759 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:32.198993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59d5ae-4788-41a1-bad8-84361868bbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:32.199632 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59d5ae-4788-41a1-bad8-84361868bbea None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:32.199937 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59d5ae-4788-41a1-bad8-84361868bbea None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:32.200211 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59d5ae-4788-41a1-bad8-84361868bbea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:32.201342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59d5ae-4788-41a1-bad8-84361868bbea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:32.202793 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59d5ae-4788-41a1-bad8-84361868bbea None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:32.204373 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 10/19] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:03:32 2022] GET /identity/v3/domains/default => generated 200 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:03:32.210936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59d5ae-4788-41a1-bad8-84361868bbea None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:32.230307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcb3b7-dcb5-4214-ad91-afc9d979b96f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:32.263310 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da2555-1316-41bc-aa19-39c6b046458b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:32.264029 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da2555-1316-41bc-aa19-39c6b046458b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:32.264384 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da2555-1316-41bc-aa19-39c6b046458b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:32.264686 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da2555-1316-41bc-aa19-39c6b046458b None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:32.265419 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da2555-1316-41bc-aa19-39c6b046458b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:32.265725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da2555-1316-41bc-aa19-39c6b046458b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:32.267104 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da2555-1316-41bc-aa19-39c6b046458b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:32.284374 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 10/20] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:03:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:03:32.289785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:32.310052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59d5ae-4788-41a1-bad8-84361868bbea None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:32.347410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ed801-25ca-468e-bc44-29d4b59b0b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:32.348050 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ed801-25ca-468e-bc44-29d4b59b0b5d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:32.348330 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ed801-25ca-468e-bc44-29d4b59b0b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:32.348605 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ed801-25ca-468e-bc44-29d4b59b0b5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:32.349480 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ed801-25ca-468e-bc44-29d4b59b0b5d None admin] RBAC: Adding query filter params (role.id=94ecbd6c86a84b75bdb0c57fc27a9a07, scope.domain.id=default, user.id=6845518adc8f4e04b03cfbd69adea2d2) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:32.349792 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ed801-25ca-468e-bc44-29d4b59b0b5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:32.351284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ed801-25ca-468e-bc44-29d4b59b0b5d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:32.358707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 11/21] 10.222.0.141 () {56 vars in 1327 bytes} [Tue Jul 26 16:03:32 2022] GET /identity/v3/role_assignments?user.id=6845518adc8f4e04b03cfbd69adea2d2&scope.domain.id=default&role.id=94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 234 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:34.719810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9f0bb-dd47-4852-95bf-bd679b9a71d6 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:34.720373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9f0bb-dd47-4852-95bf-bd679b9a71d6 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:34.720373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9f0bb-dd47-4852-95bf-bd679b9a71d6 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:34.721987 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 11/22] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:34.731744 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb0bd4-5cbd-40e5-ab15-4f61a956a878 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:34.732186 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb0bd4-5cbd-40e5-ab15-4f61a956a878 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:34.732386 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb0bd4-5cbd-40e5-ab15-4f61a956a878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:34.757726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-86eb0bd4-5cbd-40e5-ab15-4f61a956a878 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:34.759300 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-86eb0bd4-5cbd-40e5-ab15-4f61a956a878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:34.844462 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b212d-95ff-4a7c-89f8-90108f3ab72a None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:34.844818 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b212d-95ff-4a7c-89f8-90108f3ab72a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:34.845306 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b212d-95ff-4a7c-89f8-90108f3ab72a None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:34.848180 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 12/23] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:34.848604 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 12/24] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:34.853392 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d533f6-6109-4e1a-a5da-540f3e6ca933 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:34.853899 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d533f6-6109-4e1a-a5da-540f3e6ca933 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:34.854387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d533f6-6109-4e1a-a5da-540f3e6ca933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:34.873710 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f48225-001c-480c-92c2-57a4b0757842 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:34.874426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f48225-001c-480c-92c2-57a4b0757842 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:34.874926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f48225-001c-480c-92c2-57a4b0757842 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:34.876478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 13/25] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:03:34.881756 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f626178-c910-4d55-aef5-8ef4ef833af1 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:34.882293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f626178-c910-4d55-aef5-8ef4ef833af1 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:34.882777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f626178-c910-4d55-aef5-8ef4ef833af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:34.893660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-37d533f6-6109-4e1a-a5da-540f3e6ca933 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:34.894873 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-37d533f6-6109-4e1a-a5da-540f3e6ca933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:34.907299 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-4f626178-c910-4d55-aef5-8ef4ef833af1 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:34.908786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4f626178-c910-4d55-aef5-8ef4ef833af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:35.034630 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 13/26] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:03:35.037353 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d533f6-6109-4e1a-a5da-540f3e6ca933 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:35.046236 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 14/27] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:03:35.071488 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f626178-c910-4d55-aef5-8ef4ef833af1 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:35.094485 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:35.112298 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:35.177233 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d533f6-6109-4e1a-a5da-540f3e6ca933 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:35.215892 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f626178-c910-4d55-aef5-8ef4ef833af1 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:35.221364 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21e676-8f2e-49a2-9069-8a319ff1fbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:35.222331 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21e676-8f2e-49a2-9069-8a319ff1fbde None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:35.222925 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21e676-8f2e-49a2-9069-8a319ff1fbde None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:35.223422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21e676-8f2e-49a2-9069-8a319ff1fbde None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:35.224900 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21e676-8f2e-49a2-9069-8a319ff1fbde None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:35.227050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21e676-8f2e-49a2-9069-8a319ff1fbde None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:35.255539 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2986fa-8f07-426f-8257-7cda301dc95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:35.256185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2986fa-8f07-426f-8257-7cda301dc95a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:35.256466 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2986fa-8f07-426f-8257-7cda301dc95a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:35.256762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2986fa-8f07-426f-8257-7cda301dc95a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:35.267331 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2986fa-8f07-426f-8257-7cda301dc95a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:03:35.273347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-2f2986fa-8f07-426f-8257-7cda301dc95a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:03:35.273347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:03:35.273347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:03:35.273347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:03:35.273347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:03:35.273347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:03:35.273347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:03:35.273347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:03:35.273347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:03:35.273347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:03:35.273347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:03:35.273347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:03:35.273347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:03:35.273347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:03:35.273347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:03:35.273347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:03:35.274410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:03:35.274410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:03:35.274410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:03:35.274410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:03:35.274410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:03:35.274410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:03:35.274410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:03:35.274410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:03:35.274410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:03:35.274410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:03:35.274410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:03:35.274410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:03:35.274410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:03:35.274410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:03:35.274410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:03:35.274410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:03:35.275164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:03:35.275164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:03:35.275164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:03:35.275164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:03:35.275164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:03:35.275164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:03:35.275164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:03:35.275164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:03:35.275164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:03:35.275164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:03:35.275164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:03:35.275164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:03:35.275164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 15/28] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:03:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:03:35.281235 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2986fa-8f07-426f-8257-7cda301dc95a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:35.357095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:35.404120 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2986fa-8f07-426f-8257-7cda301dc95a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:35.447139 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f24fb9-4741-40d6-bdfc-2dde1232ccbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:35.447920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f24fb9-4741-40d6-bdfc-2dde1232ccbf None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:35.448289 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f24fb9-4741-40d6-bdfc-2dde1232ccbf None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:35.448629 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f24fb9-4741-40d6-bdfc-2dde1232ccbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:35.459960 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f24fb9-4741-40d6-bdfc-2dde1232ccbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:35.461648 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f24fb9-4741-40d6-bdfc-2dde1232ccbf None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:35.478401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-07f24fb9-4741-40d6-bdfc-2dde1232ccbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:03:35.478401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:03:35.478401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:03:35.478401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:03:35.478401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:03:35.478401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:03:35.478401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:03:35.478401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:03:35.478401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:03:35.478401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:03:35.478401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:03:35.478401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:03:35.478401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:03:35.478401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:03:35.478401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:03:35.479219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:03:35.479219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:03:35.479219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:03:35.479219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:03:35.479219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:03:35.479219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:03:35.479219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:03:35.479219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:03:35.479219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:03:35.479219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:03:35.479219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:03:35.479219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:03:35.479219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:03:35.479219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:03:35.479219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:03:35.479219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:03:35.479219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:03:35.480015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:03:35.480015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:03:35.480015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:03:35.480015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:03:35.480015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 16/29] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:03:35.481298 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25719e-6f47-4cc0-ab95-66656a8b3a67 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:35.481645 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25719e-6f47-4cc0-ab95-66656a8b3a67 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:35.482033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25719e-6f47-4cc0-ab95-66656a8b3a67 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:35.483335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 17/30] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:35.484137 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25719e-6f47-4cc0-ab95-66656a8b3a67 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:35.552881 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 14/31] 10.222.0.141 () {60 vars in 1136 bytes} [Tue Jul 26 16:03:35 2022] POST /identity/v3/roles => generated 220 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:03:35.553985 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21e676-8f2e-49a2-9069-8a319ff1fbde None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:35.681904 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25719e-6f47-4cc0-ab95-66656a8b3a67 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:35.719935 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:35.761711 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c2738-5d23-4249-ac38-874421b78e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:35.763039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c2738-5d23-4249-ac38-874421b78e02 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:35.763469 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c2738-5d23-4249-ac38-874421b78e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:35.763886 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c2738-5d23-4249-ac38-874421b78e02 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:35.764809 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c2738-5d23-4249-ac38-874421b78e02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:35.765316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c2738-5d23-4249-ac38-874421b78e02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:35.767132 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c2738-5d23-4249-ac38-874421b78e02 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:35.780036 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 18/32] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:03:35 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:35.784756 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21e676-8f2e-49a2-9069-8a319ff1fbde None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:35.787241 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc9f9a-0170-4004-bd8b-59c51babfe33 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:35.787746 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc9f9a-0170-4004-bd8b-59c51babfe33 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:35.788218 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc9f9a-0170-4004-bd8b-59c51babfe33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:35.806344 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:35.810545 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-78fc9f9a-0170-4004-bd8b-59c51babfe33 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:35.812024 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-78fc9f9a-0170-4004-bd8b-59c51babfe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:35.889632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d970e3-350c-4a95-a1d5-23af24f6a0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:35.890068 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d970e3-350c-4a95-a1d5-23af24f6a0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:35.890358 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d970e3-350c-4a95-a1d5-23af24f6a0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:35.890637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d970e3-350c-4a95-a1d5-23af24f6a0c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:35.891350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d970e3-350c-4a95-a1d5-23af24f6a0c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:35.891658 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d970e3-350c-4a95-a1d5-23af24f6a0c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:35.893241 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d970e3-350c-4a95-a1d5-23af24f6a0c0 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:35.906418 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 19/33] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:35.907784 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc9f9a-0170-4004-bd8b-59c51babfe33 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:35.938854 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 15/34] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:03:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:35.945692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d970e3-350c-4a95-a1d5-23af24f6a0c0 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:36.033657 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc9f9a-0170-4004-bd8b-59c51babfe33 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:36.046583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:36.075771 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3fc4d-1c84-48be-a0e6-db86de359937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:36.077892 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3fc4d-1c84-48be-a0e6-db86de359937 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:36.078763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3fc4d-1c84-48be-a0e6-db86de359937 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:36.079500 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3fc4d-1c84-48be-a0e6-db86de359937 None admin] PATH_INFO: `/v3/users/6845518adc8f4e04b03cfbd69adea2d2` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:36.081018 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3fc4d-1c84-48be-a0e6-db86de359937 None admin] RBAC: Authorizing `identity:get_user(user_id=6845518adc8f4e04b03cfbd69adea2d2)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:36.082699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3fc4d-1c84-48be-a0e6-db86de359937 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:36.088469 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 20/35] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:03:35 2022] GET /identity/v3/users/6845518adc8f4e04b03cfbd69adea2d2 => generated 248 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:36.094349 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3fc4d-1c84-48be-a0e6-db86de359937 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:36.164313 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d970e3-350c-4a95-a1d5-23af24f6a0c0 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:36.201228 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1495047-1f59-49bb-bca6-0e82c0859ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:36.201771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1495047-1f59-49bb-bca6-0e82c0859ee5 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:36.202052 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1495047-1f59-49bb-bca6-0e82c0859ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:36.202327 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1495047-1f59-49bb-bca6-0e82c0859ee5 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:36.203033 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1495047-1f59-49bb-bca6-0e82c0859ee5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:36.204867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1495047-1f59-49bb-bca6-0e82c0859ee5 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:36.215404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3fc4d-1c84-48be-a0e6-db86de359937 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:36.249687 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d8910-f80c-4468-8946-428eae825abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:36.250316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d8910-f80c-4468-8946-428eae825abd None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:36.250647 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d8910-f80c-4468-8946-428eae825abd None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:36.250927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d8910-f80c-4468-8946-428eae825abd None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:36.251611 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d8910-f80c-4468-8946-428eae825abd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:36.253172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d8910-f80c-4468-8946-428eae825abd None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:36.288806 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 16/36] 10.222.0.141 () {60 vars in 1136 bytes} [Tue Jul 26 16:03:35 2022] POST /identity/v3/roles => generated 226 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:03:36.289705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1495047-1f59-49bb-bca6-0e82c0859ee5 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:36.320399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:36.397785 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1495047-1f59-49bb-bca6-0e82c0859ee5 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:36.437907 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7eed82-2759-448e-869e-55c1bf34b01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:36.438848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7eed82-2759-448e-869e-55c1bf34b01f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:36.439285 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7eed82-2759-448e-869e-55c1bf34b01f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:36.439844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7eed82-2759-448e-869e-55c1bf34b01f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:36.441399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7eed82-2759-448e-869e-55c1bf34b01f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:36.443420 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7eed82-2759-448e-869e-55c1bf34b01f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:36.445068 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 17/37] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:03:36 2022] GET /identity/v3/domains/default => generated 200 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:36.446458 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dc1ed-e5be-475e-8839-403a238a8dbc None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:36.446750 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dc1ed-e5be-475e-8839-403a238a8dbc None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:36.447032 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dc1ed-e5be-475e-8839-403a238a8dbc None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:36.448247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 18/38] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:36.449310 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd6b9c-aa8c-477f-88aa-130622dc54fa None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:36.449596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd6b9c-aa8c-477f-88aa-130622dc54fa None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:36.449873 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd6b9c-aa8c-477f-88aa-130622dc54fa None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:36.451480 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 19/39] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:36.452176 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd6b9c-aa8c-477f-88aa-130622dc54fa None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:36.477842 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 21/40] 10.222.0.141 () {60 vars in 1146 bytes} [Tue Jul 26 16:03:36 2022] POST /identity/v3/projects => generated 302 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:03:36.479586 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63604a6c-2a89-47a9-808e-5b3388bf6923 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:36.479882 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63604a6c-2a89-47a9-808e-5b3388bf6923 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:36.480162 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63604a6c-2a89-47a9-808e-5b3388bf6923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:36.503853 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-63604a6c-2a89-47a9-808e-5b3388bf6923 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:36.503853 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-63604a6c-2a89-47a9-808e-5b3388bf6923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:36.536167 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:36.578881 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:36.585643 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 22/41] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:36.587229 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be0a75-b306-4c21-83ca-8e3c65433c56 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:36.587524 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be0a75-b306-4c21-83ca-8e3c65433c56 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:36.587804 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be0a75-b306-4c21-83ca-8e3c65433c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:36.602556 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd6b9c-aa8c-477f-88aa-130622dc54fa None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:36.612630 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-16be0a75-b306-4c21-83ca-8e3c65433c56 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:36.613958 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-16be0a75-b306-4c21-83ca-8e3c65433c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:36.640421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935bc06-4219-460c-a4a1-b49ccae5768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:36.641237 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935bc06-4219-460c-a4a1-b49ccae5768a None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:36.641524 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935bc06-4219-460c-a4a1-b49ccae5768a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:36.641835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935bc06-4219-460c-a4a1-b49ccae5768a None admin] PATH_INFO: `/v3/domains/default/users/6845518adc8f4e04b03cfbd69adea2d2/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:36.644035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935bc06-4219-460c-a4a1-b49ccae5768a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6845518adc8f4e04b03cfbd69adea2d2, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:36.645583 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935bc06-4219-460c-a4a1-b49ccae5768a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:36.687003 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 23/42] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:36.687927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be0a75-b306-4c21-83ca-8e3c65433c56 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:36.749766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 20/43] 10.222.0.141 () {58 vars in 1366 bytes} [Tue Jul 26 16:03:36 2022] PUT /identity/v3/domains/default/users/6845518adc8f4e04b03cfbd69adea2d2/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:03:36.750508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935bc06-4219-460c-a4a1-b49ccae5768a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:36.778137 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:36.793295 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be0a75-b306-4c21-83ca-8e3c65433c56 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:36.831159 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a91fc1-081f-4759-afe5-6e17aa674f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:36.831880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a91fc1-081f-4759-afe5-6e17aa674f8a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:36.832166 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a91fc1-081f-4759-afe5-6e17aa674f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:36.832446 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a91fc1-081f-4759-afe5-6e17aa674f8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:36.834260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a91fc1-081f-4759-afe5-6e17aa674f8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:36.836002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a91fc1-081f-4759-afe5-6e17aa674f8a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:36.837717 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 24/44] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:03:36 2022] GET /identity/v3/domains/default => generated 200 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:36.843741 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a91fc1-081f-4759-afe5-6e17aa674f8a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:36.866987 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935bc06-4219-460c-a4a1-b49ccae5768a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:36.919058 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e26d2-c935-4279-89a9-f2b856629dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:36.919780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e26d2-c935-4279-89a9-f2b856629dd4 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:36.920073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e26d2-c935-4279-89a9-f2b856629dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:36.920353 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e26d2-c935-4279-89a9-f2b856629dd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:36.922045 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e26d2-c935-4279-89a9-f2b856629dd4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:36.922487 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e26d2-c935-4279-89a9-f2b856629dd4 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:36.955717 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a91fc1-081f-4759-afe5-6e17aa674f8a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:36.990131 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19424d1d-4a09-43cf-b2dd-fe8e641f0380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:36.990789 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19424d1d-4a09-43cf-b2dd-fe8e641f0380 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:36.991077 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19424d1d-4a09-43cf-b2dd-fe8e641f0380 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:36.991360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19424d1d-4a09-43cf-b2dd-fe8e641f0380 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:36.992045 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19424d1d-4a09-43cf-b2dd-fe8e641f0380 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:36.993586 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19424d1d-4a09-43cf-b2dd-fe8e641f0380 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:36.997040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 21/45] 10.222.0.141 () {60 vars in 1136 bytes} [Tue Jul 26 16:03:36 2022] POST /identity/v3/roles => generated 224 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:03:37.096440 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 25/46] 10.222.0.141 () {60 vars in 1146 bytes} [Tue Jul 26 16:03:36 2022] POST /identity/v3/projects => generated 313 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:03:38.745879 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa4cc0-5bf3-4f28-9565-48fbff445059 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:38.746388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa4cc0-5bf3-4f28-9565-48fbff445059 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:38.746473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa4cc0-5bf3-4f28-9565-48fbff445059 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:38.747922 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 22/47] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:03:38.752931 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d330a-8f74-45c4-90d5-cb4905a3fbc4 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:38.753320 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d330a-8f74-45c4-90d5-cb4905a3fbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:38.753494 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d330a-8f74-45c4-90d5-cb4905a3fbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:38.771031 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-233d330a-8f74-45c4-90d5-cb4905a3fbc4 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:38.772200 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-233d330a-8f74-45c4-90d5-cb4905a3fbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:38.774195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:38.837456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 26/48] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:38.861493 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa4cc0-5bf3-4f28-9565-48fbff445059 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:38.879450 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:38.969728 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa4cc0-5bf3-4f28-9565-48fbff445059 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:39.004119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adbc4c-618a-4aeb-b419-edd9fe6b9506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:39.004721 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adbc4c-618a-4aeb-b419-edd9fe6b9506 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:39.005025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adbc4c-618a-4aeb-b419-edd9fe6b9506 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:39.005302 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adbc4c-618a-4aeb-b419-edd9fe6b9506 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:39.016117 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adbc4c-618a-4aeb-b419-edd9fe6b9506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:03:39.022570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-c4adbc4c-618a-4aeb-b419-edd9fe6b9506 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:03:39.022570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:03:39.022570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:03:39.022570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:03:39.022570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:03:39.022570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:03:39.022570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:03:39.022570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:03:39.022570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:03:39.022570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:03:39.022570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:03:39.022570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:03:39.022570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:03:39.022570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:03:39.022570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:03:39.022570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:03:39.023456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:03:39.023456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:03:39.023456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:03:39.023456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:03:39.023456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:03:39.023456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:03:39.023456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:03:39.023456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:03:39.023456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:03:39.023456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:03:39.023456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:03:39.023456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:03:39.023456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:03:39.023456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:03:39.023456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:03:39.023456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:03:39.024373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:03:39.024373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:03:39.024373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:03:39.024373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:03:39.024373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:03:39.024373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:03:39.024373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:03:39.024373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:03:39.024373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:03:39.024373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:03:39.024373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:03:39.024373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:03:39.024373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 23/49] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:03:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:03:39.029581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d330a-8f74-45c4-90d5-cb4905a3fbc4 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:39.108823 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a866e5-f182-4112-ae55-3b25f93d5691 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:39.109104 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a866e5-f182-4112-ae55-3b25f93d5691 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:39.109445 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a866e5-f182-4112-ae55-3b25f93d5691 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:39.110787 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 24/50] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:03:39.115702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1005a-d221-4bbf-9186-bb5f93ff7421 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:39.115983 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1005a-d221-4bbf-9186-bb5f93ff7421 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:39.116261 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1005a-d221-4bbf-9186-bb5f93ff7421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:39.127279 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d330a-8f74-45c4-90d5-cb4905a3fbc4 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:39.135115 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2cd1005a-d221-4bbf-9186-bb5f93ff7421 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:39.136635 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2cd1005a-d221-4bbf-9186-bb5f93ff7421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:39.162256 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611c73d-83df-4a8f-9048-4953953c31d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:39.162876 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611c73d-83df-4a8f-9048-4953953c31d6 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:39.163161 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611c73d-83df-4a8f-9048-4953953c31d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:39.163433 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611c73d-83df-4a8f-9048-4953953c31d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:39.164146 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611c73d-83df-4a8f-9048-4953953c31d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:39.164452 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611c73d-83df-4a8f-9048-4953953c31d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:39.165874 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611c73d-83df-4a8f-9048-4953953c31d6 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:39.170887 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:39.174414 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 27/51] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:03:39 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:39.179943 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611c73d-83df-4a8f-9048-4953953c31d6 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:39.206511 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 25/52] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:03:39.229559 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1005a-d221-4bbf-9186-bb5f93ff7421 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:39.232483 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:39.276901 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611c73d-83df-4a8f-9048-4953953c31d6 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:39.310569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b70e8-0631-42e6-87d6-f11fabe1ca3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:39.311222 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b70e8-0631-42e6-87d6-f11fabe1ca3e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:39.311510 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b70e8-0631-42e6-87d6-f11fabe1ca3e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:39.311788 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b70e8-0631-42e6-87d6-f11fabe1ca3e None admin] PATH_INFO: `/v3/users/6845518adc8f4e04b03cfbd69adea2d2` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:39.313005 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b70e8-0631-42e6-87d6-f11fabe1ca3e None admin] RBAC: Authorizing `identity:get_user(user_id=6845518adc8f4e04b03cfbd69adea2d2)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:39.314486 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b70e8-0631-42e6-87d6-f11fabe1ca3e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:39.316091 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 28/53] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:03:39 2022] GET /identity/v3/users/6845518adc8f4e04b03cfbd69adea2d2 => generated 248 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:03:39.321404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b70e8-0631-42e6-87d6-f11fabe1ca3e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:39.332285 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1005a-d221-4bbf-9186-bb5f93ff7421 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:39.367393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49bdb0-d9bb-4c99-b0f8-196893e8542c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:39.368035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49bdb0-d9bb-4c99-b0f8-196893e8542c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:39.368321 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49bdb0-d9bb-4c99-b0f8-196893e8542c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:39.368598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49bdb0-d9bb-4c99-b0f8-196893e8542c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:39.369852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49bdb0-d9bb-4c99-b0f8-196893e8542c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:39.371324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49bdb0-d9bb-4c99-b0f8-196893e8542c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:39.372949 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 26/54] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:03:39 2022] GET /identity/v3/domains/default => generated 200 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:03:39.378294 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49bdb0-d9bb-4c99-b0f8-196893e8542c None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:39.386647 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:39.419895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b70e8-0631-42e6-87d6-f11fabe1ca3e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:39.448361 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:39.454206 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ab353-63d8-440c-9c88-140d9aa75c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:39.454881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ab353-63d8-440c-9c88-140d9aa75c26 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:39.455169 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ab353-63d8-440c-9c88-140d9aa75c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:39.455446 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ab353-63d8-440c-9c88-140d9aa75c26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:39.456685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ab353-63d8-440c-9c88-140d9aa75c26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:39.464270 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ab353-63d8-440c-9c88-140d9aa75c26 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:39.464270 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 29/55] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:03:39 2022] GET /identity/v3/domains/default => generated 200 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:03:39.466876 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ab353-63d8-440c-9c88-140d9aa75c26 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:39.477486 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49bdb0-d9bb-4c99-b0f8-196893e8542c None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:39.511549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04618b-9ad6-4ef9-b1ef-b658d0580b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:39.512171 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04618b-9ad6-4ef9-b1ef-b658d0580b39 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:39.512457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04618b-9ad6-4ef9-b1ef-b658d0580b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:39.512761 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04618b-9ad6-4ef9-b1ef-b658d0580b39 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:39.513449 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04618b-9ad6-4ef9-b1ef-b658d0580b39 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:39.514904 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04618b-9ad6-4ef9-b1ef-b658d0580b39 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:39.564146 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ab353-63d8-440c-9c88-140d9aa75c26 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:39.596848 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b58222-dbda-4d2a-8729-8ff49d3b1d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:39.597476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b58222-dbda-4d2a-8729-8ff49d3b1d46 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:39.597758 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b58222-dbda-4d2a-8729-8ff49d3b1d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:39.598035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b58222-dbda-4d2a-8729-8ff49d3b1d46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:39.598145 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 27/56] 10.222.0.141 () {60 vars in 1145 bytes} [Tue Jul 26 16:03:39 2022] POST /identity/v3/projects => generated 299 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:03:39.598822 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b58222-dbda-4d2a-8729-8ff49d3b1d46 None admin] RBAC: Adding query filter params (role.id=94ecbd6c86a84b75bdb0c57fc27a9a07, scope.domain.id=default, user.id=6845518adc8f4e04b03cfbd69adea2d2) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:39.599138 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b58222-dbda-4d2a-8729-8ff49d3b1d46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:39.600586 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b58222-dbda-4d2a-8729-8ff49d3b1d46 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:39.603846 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:39.607787 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 30/57] 10.222.0.141 () {56 vars in 1327 bytes} [Tue Jul 26 16:03:39 2022] GET /identity/v3/role_assignments?user.id=6845518adc8f4e04b03cfbd69adea2d2&scope.domain.id=default&role.id=94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 532 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:03:41.625505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead9d39-326e-4548-8213-2f62350af6e0 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:41.626016 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead9d39-326e-4548-8213-2f62350af6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:41.626095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead9d39-326e-4548-8213-2f62350af6e0 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:41.627412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 28/58] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:41.632479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0e3d5-332e-48b3-9302-5803a0739bbe None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:41.632910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0e3d5-332e-48b3-9302-5803a0739bbe None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:41.633071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0e3d5-332e-48b3-9302-5803a0739bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:41.651300 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-eae0e3d5-332e-48b3-9302-5803a0739bbe None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:41.652490 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-eae0e3d5-332e-48b3-9302-5803a0739bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:41.717550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 31/59] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:41.741214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead9d39-326e-4548-8213-2f62350af6e0 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:41.840864 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead9d39-326e-4548-8213-2f62350af6e0 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:41.863129 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:41.873397 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83ac14-3101-4d18-b02c-cf66ecf7ffd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:41.876445 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83ac14-3101-4d18-b02c-cf66ecf7ffd4 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:41.876445 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83ac14-3101-4d18-b02c-cf66ecf7ffd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:41.876445 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83ac14-3101-4d18-b02c-cf66ecf7ffd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:41.876445 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83ac14-3101-4d18-b02c-cf66ecf7ffd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:41.877175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83ac14-3101-4d18-b02c-cf66ecf7ffd4 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:41.878747 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 29/60] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:03:41 2022] GET /identity/v3/domains/default => generated 200 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:41.884733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0e3d5-332e-48b3-9302-5803a0739bbe None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:41.979554 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0e3d5-332e-48b3-9302-5803a0739bbe None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:42.006536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:42.011959 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa5eb9-019b-4d93-8a27-7c8eef011984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:42.012574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa5eb9-019b-4d93-8a27-7c8eef011984 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:42.012882 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa5eb9-019b-4d93-8a27-7c8eef011984 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:42.013157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa5eb9-019b-4d93-8a27-7c8eef011984 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:42.013842 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa5eb9-019b-4d93-8a27-7c8eef011984 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:42.015273 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa5eb9-019b-4d93-8a27-7c8eef011984 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:42.122580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 32/61] 10.222.0.141 () {60 vars in 1137 bytes} [Tue Jul 26 16:03:41 2022] POST /identity/v3/users => generated 276 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:03:45.216623 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d94b6-675b-4e51-a319-3731bdfec3a7 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:45.217722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d94b6-675b-4e51-a319-3731bdfec3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:45.218206 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d94b6-675b-4e51-a319-3731bdfec3a7 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:45.219773 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 30/62] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:45.225378 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12519db-ddc1-4b53-990e-0c8475d94fb6 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:45.226256 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12519db-ddc1-4b53-990e-0c8475d94fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:45.226758 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12519db-ddc1-4b53-990e-0c8475d94fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:45.253722 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a12519db-ddc1-4b53-990e-0c8475d94fb6 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:45.255954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a12519db-ddc1-4b53-990e-0c8475d94fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:45.344913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 33/63] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:45.346744 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385494-263a-4683-ad30-54f788e68cf2 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:45.347039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385494-263a-4683-ad30-54f788e68cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:45.347321 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385494-263a-4683-ad30-54f788e68cf2 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:45.348962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 31/64] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:45.359104 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbefe22-af1d-4adc-8b97-1521d35c884f None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:45.359674 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbefe22-af1d-4adc-8b97-1521d35c884f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:45.360169 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbefe22-af1d-4adc-8b97-1521d35c884f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:45.381227 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8fbefe22-af1d-4adc-8b97-1521d35c884f None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:45.381398 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46385494-263a-4683-ad30-54f788e68cf2 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:45.382879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8fbefe22-af1d-4adc-8b97-1521d35c884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:45.487063 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 34/65] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:45.488371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97348989-863c-4473-a3f2-20923ada6d5d None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:45.488548 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97348989-863c-4473-a3f2-20923ada6d5d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:45.488861 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97348989-863c-4473-a3f2-20923ada6d5d None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:45.490695 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 35/66] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:45.497959 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c369d93-e228-4a8e-9377-f8072b3c772c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:45.498232 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c369d93-e228-4a8e-9377-f8072b3c772c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:45.498526 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c369d93-e228-4a8e-9377-f8072b3c772c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:45.523931 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-3c369d93-e228-4a8e-9377-f8072b3c772c None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:45.525250 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3c369d93-e228-4a8e-9377-f8072b3c772c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:45.538506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46385494-263a-4683-ad30-54f788e68cf2 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:45.571858 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:45.577757 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef9a9c-a069-4c03-9421-3aed7846eed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:45.578679 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef9a9c-a069-4c03-9421-3aed7846eed6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:45.579157 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef9a9c-a069-4c03-9421-3aed7846eed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:45.579624 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef9a9c-a069-4c03-9421-3aed7846eed6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:45.590827 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef9a9c-a069-4c03-9421-3aed7846eed6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:03:45.596523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-08ef9a9c-a069-4c03-9421-3aed7846eed6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:03:45.596523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:03:45.596523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:03:45.596523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:03:45.596523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:03:45.596523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:03:45.596523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:03:45.596523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:03:45.596523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:03:45.596523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:03:45.596523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:03:45.596523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:03:45.596523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:03:45.596523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:03:45.596523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:03:45.596523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:03:45.597508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:03:45.597508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:03:45.597508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:03:45.597508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:03:45.597508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:03:45.597508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:03:45.597508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:03:45.597508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:03:45.597508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:03:45.597508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:03:45.597508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:03:45.597508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:03:45.597508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:03:45.597508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:03:45.597508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:03:45.597508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:03:45.598309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:03:45.598309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:03:45.598309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:03:45.598309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:03:45.598309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:03:45.598309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:03:45.598309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:03:45.598309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:03:45.598309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:03:45.598309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:03:45.598309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:03:45.598309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:03:45.600269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 36/67] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:45.601590 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 32/68] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:03:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:03:45.607333 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef9a9c-a069-4c03-9421-3aed7846eed6 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:45.611080 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c369d93-e228-4a8e-9377-f8072b3c772c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:45.663478 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:45.715108 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef9a9c-a069-4c03-9421-3aed7846eed6 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:45.731002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c369d93-e228-4a8e-9377-f8072b3c772c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:45.751962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719dade9-1dde-4758-95df-f8396e12218f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:45.752845 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dade9-1dde-4758-95df-f8396e12218f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:45.753272 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dade9-1dde-4758-95df-f8396e12218f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:45.753724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dade9-1dde-4758-95df-f8396e12218f None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:45.754591 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719dade9-1dde-4758-95df-f8396e12218f None admin] RBAC: Adding query filter params (name=member) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:45.755068 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719dade9-1dde-4758-95df-f8396e12218f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:45.756606 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719dade9-1dde-4758-95df-f8396e12218f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:45.767339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166fb03-4aed-4eaf-b2a9-49fae70230fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:45.767989 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166fb03-4aed-4eaf-b2a9-49fae70230fd None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:45.768269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166fb03-4aed-4eaf-b2a9-49fae70230fd None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:45.768545 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166fb03-4aed-4eaf-b2a9-49fae70230fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:45.769762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 33/69] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:03:45 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:45.770751 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719dade9-1dde-4758-95df-f8396e12218f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:45.783803 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166fb03-4aed-4eaf-b2a9-49fae70230fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:03:45.789343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-6166fb03-4aed-4eaf-b2a9-49fae70230fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:03:45.789343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:03:45.789343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:03:45.789343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:03:45.789343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:03:45.789343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:03:45.789343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:03:45.789343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:03:45.789343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:03:45.789343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:03:45.789343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:03:45.789343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:03:45.789343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:03:45.789343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:03:45.789343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:03:45.789343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:03:45.790344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:03:45.790344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:03:45.790344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:03:45.790344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:03:45.790344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:03:45.790344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:03:45.790344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:03:45.790344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:03:45.790344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:03:45.790344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:03:45.790344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:03:45.790344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:03:45.790344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:03:45.790344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:03:45.790344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:03:45.790344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:03:45.791112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:03:45.791112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:03:45.791112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:03:45.791112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:03:45.791112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:03:45.791112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:03:45.791112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:03:45.791112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:03:45.791112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:03:45.791112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:03:45.791112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:03:45.791112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:03:45.791112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 37/70] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:03:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:03:45.792200 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556398e-9983-4cf8-b470-0a123ad18b5e None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:45.792458 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556398e-9983-4cf8-b470-0a123ad18b5e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:45.792759 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556398e-9983-4cf8-b470-0a123ad18b5e None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:45.794245 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 38/71] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:45.798800 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556398e-9983-4cf8-b470-0a123ad18b5e None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:45.836463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:45.880004 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719dade9-1dde-4758-95df-f8396e12218f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:45.893630 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:45.901438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556398e-9983-4cf8-b470-0a123ad18b5e None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:45.915402 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ec2e8-180b-47b6-b1ba-8f1ddf49d079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:45.916050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ec2e8-180b-47b6-b1ba-8f1ddf49d079 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:45.916401 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ec2e8-180b-47b6-b1ba-8f1ddf49d079 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:45.916701 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ec2e8-180b-47b6-b1ba-8f1ddf49d079 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:45.928261 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ec2e8-180b-47b6-b1ba-8f1ddf49d079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:03:45.933264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-7e5ec2e8-180b-47b6-b1ba-8f1ddf49d079 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:03:45.933264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:03:45.933264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:03:45.933264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:03:45.933264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:03:45.933264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:03:45.933264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:03:45.933264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:03:45.933264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:03:45.933264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:03:45.933264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:03:45.933264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:03:45.933264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:03:45.933264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:03:45.933264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:03:45.933264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:03:45.934105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:03:45.934105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:03:45.934105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:03:45.934105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:03:45.934105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:03:45.934105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:03:45.934105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:03:45.934105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:03:45.934105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:03:45.934105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:03:45.934105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:03:45.934105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:03:45.934105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:03:45.934105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:03:45.934105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:03:45.934105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:03:45.934892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:03:45.934892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:03:45.934892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:03:45.934892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:03:45.934892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:03:45.934892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:03:45.934892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:03:45.934892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:03:45.934892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:03:45.934892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:03:45.934892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:03:45.934892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:03:45.934892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 34/72] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:03:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:03:45.935510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ec2e8-180b-47b6-b1ba-8f1ddf49d079 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:45.942402 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b8188-06ce-44aa-a528-0cb4352908bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:45.943050 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b8188-06ce-44aa-a528-0cb4352908bf None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:45.943330 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b8188-06ce-44aa-a528-0cb4352908bf None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:45.943602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b8188-06ce-44aa-a528-0cb4352908bf None admin] PATH_INFO: `/v3/users/c4c00af7c7f1415b949cfc5553ea08d6` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:45.956994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b8188-06ce-44aa-a528-0cb4352908bf None admin] RBAC: Authorizing `identity:get_user(user_id=c4c00af7c7f1415b949cfc5553ea08d6)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:45.959005 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b8188-06ce-44aa-a528-0cb4352908bf None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:45.960876 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 39/73] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:03:45 2022] GET /identity/v3/users/c4c00af7c7f1415b949cfc5553ea08d6 => generated 276 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:45.962021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9555f8-58f7-4383-b273-65d8b7383512 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:45.962310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9555f8-58f7-4383-b273-65d8b7383512 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:45.962588 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9555f8-58f7-4383-b273-65d8b7383512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:45.979119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ad9555f8-58f7-4383-b273-65d8b7383512 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:45.980291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ad9555f8-58f7-4383-b273-65d8b7383512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:46.037365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ec2e8-180b-47b6-b1ba-8f1ddf49d079 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:46.045483 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 40/74] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:46.046718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c466b06-fd55-4a62-b233-d558fc181b4b None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:46.047011 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c466b06-fd55-4a62-b233-d558fc181b4b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:46.047293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c466b06-fd55-4a62-b233-d558fc181b4b None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:46.048830 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 41/75] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:46.052898 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c466b06-fd55-4a62-b233-d558fc181b4b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:46.072605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba8d3c-d1e8-49e0-8311-ed2d716364d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:46.073743 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba8d3c-d1e8-49e0-8311-ed2d716364d7 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:46.073972 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba8d3c-d1e8-49e0-8311-ed2d716364d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:46.074245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba8d3c-d1e8-49e0-8311-ed2d716364d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:46.074962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba8d3c-d1e8-49e0-8311-ed2d716364d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:46.075266 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba8d3c-d1e8-49e0-8311-ed2d716364d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:46.076679 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba8d3c-d1e8-49e0-8311-ed2d716364d7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:46.084771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 35/76] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:03:45 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:46.085554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba8d3c-d1e8-49e0-8311-ed2d716364d7 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:46.093396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:46.119929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:46.168850 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c466b06-fd55-4a62-b233-d558fc181b4b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:46.183197 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba8d3c-d1e8-49e0-8311-ed2d716364d7 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:46.203408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebc6e1-0b51-467c-ad5a-ac058787e40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:46.204032 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebc6e1-0b51-467c-ad5a-ac058787e40a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:46.204318 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebc6e1-0b51-467c-ad5a-ac058787e40a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:46.204599 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebc6e1-0b51-467c-ad5a-ac058787e40a None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:46.205351 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebc6e1-0b51-467c-ad5a-ac058787e40a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:46.205660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebc6e1-0b51-467c-ad5a-ac058787e40a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:46.207057 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebc6e1-0b51-467c-ad5a-ac058787e40a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:46.214795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 42/77] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:03:46 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:46.216604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02260518-fac2-496d-86c9-3ed8b2631e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:46.217247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02260518-fac2-496d-86c9-3ed8b2631e0b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:46.217784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02260518-fac2-496d-86c9-3ed8b2631e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:46.217784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02260518-fac2-496d-86c9-3ed8b2631e0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:46.220827 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa387e-9e93-4be5-bb19-74d389a847b0 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:46.221126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa387e-9e93-4be5-bb19-74d389a847b0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:46.221407 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa387e-9e93-4be5-bb19-74d389a847b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:46.241491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-07aa387e-9e93-4be5-bb19-74d389a847b0 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:46.241491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-07aa387e-9e93-4be5-bb19-74d389a847b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:46.286154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02260518-fac2-496d-86c9-3ed8b2631e0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:46.287681 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02260518-fac2-496d-86c9-3ed8b2631e0b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:46.306597 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 43/78] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:46.307430 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa387e-9e93-4be5-bb19-74d389a847b0 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:46.324742 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:46.328109 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:46.392832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 36/79] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:03:46 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:03:46.393836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02260518-fac2-496d-86c9-3ed8b2631e0b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:46.406718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa387e-9e93-4be5-bb19-74d389a847b0 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:46.439403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284d1d7-9849-4661-b280-18611dc9f92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:46.440041 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284d1d7-9849-4661-b280-18611dc9f92d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:46.440325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284d1d7-9849-4661-b280-18611dc9f92d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:46.440601 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284d1d7-9849-4661-b280-18611dc9f92d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:46.451437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284d1d7-9849-4661-b280-18611dc9f92d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:03:46.456368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-4284d1d7-9849-4661-b280-18611dc9f92d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:03:46.456368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:03:46.456368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:03:46.456368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:03:46.456368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:03:46.456368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:03:46.456368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:03:46.456368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:03:46.456368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:03:46.456368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:03:46.456368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:03:46.456368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:03:46.456368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:03:46.456368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:03:46.456368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:03:46.456368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:03:46.457247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:03:46.457247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:03:46.457247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:03:46.457247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:03:46.457247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:03:46.457247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:03:46.457247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:03:46.457247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:03:46.457247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:03:46.457247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:03:46.457247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:03:46.457247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:03:46.457247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:03:46.457247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:03:46.457247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:03:46.457247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:03:46.458569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:03:46.458569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:03:46.458569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:03:46.458569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:03:46.458569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:03:46.458569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:03:46.458569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:03:46.458569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:03:46.458569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:03:46.458569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:03:46.458569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:03:46.458569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:03:46.458569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 44/80] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:03:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:03:46.459206 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284d1d7-9849-4661-b280-18611dc9f92d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:46.495768 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02260518-fac2-496d-86c9-3ed8b2631e0b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:46.529633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4043758-11e1-4e9e-bcb7-439976cfa4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:46.530274 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4043758-11e1-4e9e-bcb7-439976cfa4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:46.530566 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4043758-11e1-4e9e-bcb7-439976cfa4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:46.530842 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4043758-11e1-4e9e-bcb7-439976cfa4e2 None admin] PATH_INFO: `/v3/users/6845518adc8f4e04b03cfbd69adea2d2` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:46.532005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4043758-11e1-4e9e-bcb7-439976cfa4e2 None admin] RBAC: Authorizing `identity:get_user(user_id=6845518adc8f4e04b03cfbd69adea2d2)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:46.532532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:46.533494 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4043758-11e1-4e9e-bcb7-439976cfa4e2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:46.535140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 37/81] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:03:46 2022] GET /identity/v3/users/6845518adc8f4e04b03cfbd69adea2d2 => generated 248 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:46.535849 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4043758-11e1-4e9e-bcb7-439976cfa4e2 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:46.539276 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:46.559317 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284d1d7-9849-4661-b280-18611dc9f92d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:46.593895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465de952-35e6-4da1-b8b8-7ede01b220e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:46.594541 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465de952-35e6-4da1-b8b8-7ede01b220e4 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:46.594826 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465de952-35e6-4da1-b8b8-7ede01b220e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:46.595108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465de952-35e6-4da1-b8b8-7ede01b220e4 None admin] PATH_INFO: `/v3/users/c4c00af7c7f1415b949cfc5553ea08d6` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:46.596284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465de952-35e6-4da1-b8b8-7ede01b220e4 None admin] RBAC: Authorizing `identity:get_user(user_id=c4c00af7c7f1415b949cfc5553ea08d6)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:46.597765 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465de952-35e6-4da1-b8b8-7ede01b220e4 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:46.599362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 45/82] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:03:46 2022] GET /identity/v3/users/c4c00af7c7f1415b949cfc5553ea08d6 => generated 276 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:46.600117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465de952-35e6-4da1-b8b8-7ede01b220e4 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:46.640418 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4043758-11e1-4e9e-bcb7-439976cfa4e2 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:46.672732 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cc12f-eff9-46a6-93b7-0d5c7609f970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:46.673630 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cc12f-eff9-46a6-93b7-0d5c7609f970 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:46.673913 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cc12f-eff9-46a6-93b7-0d5c7609f970 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:46.674187 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cc12f-eff9-46a6-93b7-0d5c7609f970 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:46.675394 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cc12f-eff9-46a6-93b7-0d5c7609f970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:46.677376 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cc12f-eff9-46a6-93b7-0d5c7609f970 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:46.678967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 38/83] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:03:46 2022] GET /identity/v3/domains/default => generated 200 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:46.679719 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cc12f-eff9-46a6-93b7-0d5c7609f970 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:46.699370 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465de952-35e6-4da1-b8b8-7ede01b220e4 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:46.732048 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b1da6-7a41-4f76-80b6-7591ab29e613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:46.732717 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b1da6-7a41-4f76-80b6-7591ab29e613 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:46.733009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b1da6-7a41-4f76-80b6-7591ab29e613 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:46.733290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b1da6-7a41-4f76-80b6-7591ab29e613 None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:46.734458 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b1da6-7a41-4f76-80b6-7591ab29e613 None admin] RBAC: Authorizing `identity:get_project(project_id=844e7dec0aec49598b6b69437d09d460)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:46.735920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b1da6-7a41-4f76-80b6-7591ab29e613 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:46.737607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 46/84] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:03:46 2022] GET /identity/v3/projects/844e7dec0aec49598b6b69437d09d460 => generated 299 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:46.738370 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b1da6-7a41-4f76-80b6-7591ab29e613 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:46.749432 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:46.754388 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:46.779193 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cc12f-eff9-46a6-93b7-0d5c7609f970 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:46.812942 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c03f94-fa13-4bf4-b6ee-de7500412d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:46.813498 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c03f94-fa13-4bf4-b6ee-de7500412d00 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:46.813783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c03f94-fa13-4bf4-b6ee-de7500412d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:46.814062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c03f94-fa13-4bf4-b6ee-de7500412d00 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:46.814774 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c03f94-fa13-4bf4-b6ee-de7500412d00 None admin] RBAC: Adding query filter params (name=member) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:46.815083 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c03f94-fa13-4bf4-b6ee-de7500412d00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:46.816464 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c03f94-fa13-4bf4-b6ee-de7500412d00 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:46.825427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 39/85] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:03:46 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:46.826403 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c03f94-fa13-4bf4-b6ee-de7500412d00 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:46.842996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b1da6-7a41-4f76-80b6-7591ab29e613 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:46.876723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460f7e3-bc5b-4249-8b34-c29707d83fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:46.877343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460f7e3-bc5b-4249-8b34-c29707d83fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:46.877629 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460f7e3-bc5b-4249-8b34-c29707d83fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:46.877908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460f7e3-bc5b-4249-8b34-c29707d83fe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:46.927849 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c03f94-fa13-4bf4-b6ee-de7500412d00 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:46.952078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460f7e3-bc5b-4249-8b34-c29707d83fe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:46.953610 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460f7e3-bc5b-4249-8b34-c29707d83fe0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:46.962016 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6431de-fc22-4e25-bc5f-d895631b247c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:46.962646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6431de-fc22-4e25-bc5f-d895631b247c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:46.962938 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6431de-fc22-4e25-bc5f-d895631b247c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:46.963222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6431de-fc22-4e25-bc5f-d895631b247c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:46.965875 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:46.967102 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:47.030618 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6431de-fc22-4e25-bc5f-d895631b247c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:47.032064 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6431de-fc22-4e25-bc5f-d895631b247c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:47.052738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 47/86] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:03:46 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:03:47.053560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460f7e3-bc5b-4249-8b34-c29707d83fe0 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:47.134374 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 40/87] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:03:46 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:03:47.135208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6431de-fc22-4e25-bc5f-d895631b247c None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:47.153811 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460f7e3-bc5b-4249-8b34-c29707d83fe0 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:47.166807 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:47.166935 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:47.187951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575388b-697b-4537-9b35-4795d78cab27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:47.188577 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575388b-697b-4537-9b35-4795d78cab27 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:47.188908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575388b-697b-4537-9b35-4795d78cab27 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:47.189195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575388b-697b-4537-9b35-4795d78cab27 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:47.189885 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575388b-697b-4537-9b35-4795d78cab27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:47.191330 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575388b-697b-4537-9b35-4795d78cab27 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:47.230739 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6431de-fc22-4e25-bc5f-d895631b247c None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:47.264401 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03beac12-8adc-4638-b676-82930ead79ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:47.265045 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beac12-8adc-4638-b676-82930ead79ac None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:47.265330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beac12-8adc-4638-b676-82930ead79ac None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:47.265609 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beac12-8adc-4638-b676-82930ead79ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:47.266397 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03beac12-8adc-4638-b676-82930ead79ac None admin] RBAC: Adding query filter params (role.id=61321ad01e84416981d4c7208c55bbe7, scope.project.id=844e7dec0aec49598b6b69437d09d460, user.id=c4c00af7c7f1415b949cfc5553ea08d6) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:47.266716 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03beac12-8adc-4638-b676-82930ead79ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:47.268153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03beac12-8adc-4638-b676-82930ead79ac None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:47.276333 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 41/88] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:03:47 2022] GET /identity/v3/role_assignments?user.id=c4c00af7c7f1415b949cfc5553ea08d6&scope.project.id=844e7dec0aec49598b6b69437d09d460&role.id=61321ad01e84416981d4c7208c55bbe7 => generated 260 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:47.277147 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03beac12-8adc-4638-b676-82930ead79ac None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:47.277580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 48/89] 10.222.0.141 () {60 vars in 1137 bytes} [Tue Jul 26 16:03:47 2022] POST /identity/v3/users => generated 290 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:03:47.278531 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575388b-697b-4537-9b35-4795d78cab27 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:47.396266 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:47.401197 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03beac12-8adc-4638-b676-82930ead79ac None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:47.443026 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2301d-11a3-4c72-827f-8b501c0a422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:47.444691 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2301d-11a3-4c72-827f-8b501c0a422f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:47.445088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2301d-11a3-4c72-827f-8b501c0a422f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:47.445681 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2301d-11a3-4c72-827f-8b501c0a422f None admin] PATH_INFO: `/v3/users/c4c00af7c7f1415b949cfc5553ea08d6` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:47.447752 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2301d-11a3-4c72-827f-8b501c0a422f None admin] RBAC: Authorizing `identity:get_user(user_id=c4c00af7c7f1415b949cfc5553ea08d6)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:47.449706 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2301d-11a3-4c72-827f-8b501c0a422f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:47.452905 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 42/90] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:03:47 2022] GET /identity/v3/users/c4c00af7c7f1415b949cfc5553ea08d6 => generated 276 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:47.455722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2301d-11a3-4c72-827f-8b501c0a422f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:47.463620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575388b-697b-4537-9b35-4795d78cab27 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:47.506873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b910a11-946a-4284-aa9a-9834b9934e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:47.507529 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b910a11-946a-4284-aa9a-9834b9934e62 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:47.507816 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b910a11-946a-4284-aa9a-9834b9934e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:47.508098 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b910a11-946a-4284-aa9a-9834b9934e62 None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:47.509419 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b910a11-946a-4284-aa9a-9834b9934e62 None admin] RBAC: Authorizing `identity:get_project(project_id=844e7dec0aec49598b6b69437d09d460)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:47.511101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b910a11-946a-4284-aa9a-9834b9934e62 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:47.513733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 49/91] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:03:47 2022] GET /identity/v3/projects/844e7dec0aec49598b6b69437d09d460 => generated 299 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:47.518485 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b910a11-946a-4284-aa9a-9834b9934e62 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:47.566605 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:47.590387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2301d-11a3-4c72-827f-8b501c0a422f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:47.647373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5093b97-0533-49a1-a47e-f96b60b47fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:47.648344 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5093b97-0533-49a1-a47e-f96b60b47fae None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:47.648635 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5093b97-0533-49a1-a47e-f96b60b47fae None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:47.648952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5093b97-0533-49a1-a47e-f96b60b47fae None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:47.650457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5093b97-0533-49a1-a47e-f96b60b47fae None admin] RBAC: Authorizing `identity:get_project(project_id=844e7dec0aec49598b6b69437d09d460)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:47.652465 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5093b97-0533-49a1-a47e-f96b60b47fae None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:47.654855 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 43/92] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:03:47 2022] GET /identity/v3/projects/844e7dec0aec49598b6b69437d09d460 => generated 299 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:47.655576 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5093b97-0533-49a1-a47e-f96b60b47fae None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:47.655747 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b910a11-946a-4284-aa9a-9834b9934e62 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:47.696330 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3addfe6-9eea-4f70-a670-399f21574aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:47.697085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3addfe6-9eea-4f70-a670-399f21574aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:47.697373 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3addfe6-9eea-4f70-a670-399f21574aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:47.697652 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3addfe6-9eea-4f70-a670-399f21574aa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:47.704605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:47.788725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5093b97-0533-49a1-a47e-f96b60b47fae None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:47.789242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3addfe6-9eea-4f70-a670-399f21574aa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:47.792920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3addfe6-9eea-4f70-a670-399f21574aa8 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:47.830484 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1351d-165d-44e9-a698-954c0f7c16a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:47.831123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1351d-165d-44e9-a698-954c0f7c16a2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:47.831412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1351d-165d-44e9-a698-954c0f7c16a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:47.831698 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1351d-165d-44e9-a698-954c0f7c16a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:47.832501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1351d-165d-44e9-a698-954c0f7c16a2 None admin] RBAC: Adding query filter params (role.id=94ecbd6c86a84b75bdb0c57fc27a9a07, scope.project.id=844e7dec0aec49598b6b69437d09d460, user.id=6845518adc8f4e04b03cfbd69adea2d2) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:47.833410 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1351d-165d-44e9-a698-954c0f7c16a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:47.834951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1351d-165d-44e9-a698-954c0f7c16a2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:47.845026 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:47.853671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 44/93] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:03:47 2022] GET /identity/v3/role_assignments?user.id=6845518adc8f4e04b03cfbd69adea2d2&scope.project.id=844e7dec0aec49598b6b69437d09d460&role.id=94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:47.858598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1351d-165d-44e9-a698-954c0f7c16a2 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:47.979774 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 50/94] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:03:47 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:03:47.986075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3addfe6-9eea-4f70-a670-399f21574aa8 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:48.069244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:48.074919 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1351d-165d-44e9-a698-954c0f7c16a2 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:48.145613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e726c6-5975-48b7-8350-a91d84ba6a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:48.146287 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e726c6-5975-48b7-8350-a91d84ba6a9a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:48.146577 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e726c6-5975-48b7-8350-a91d84ba6a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:48.146859 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e726c6-5975-48b7-8350-a91d84ba6a9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:48.147674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e726c6-5975-48b7-8350-a91d84ba6a9a None admin] RBAC: Adding query filter params (role.id=33fa4ece26464ae98122f3279db92307, scope.project.id=844e7dec0aec49598b6b69437d09d460, user.id=c4c00af7c7f1415b949cfc5553ea08d6) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:48.147992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e726c6-5975-48b7-8350-a91d84ba6a9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:48.149494 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e726c6-5975-48b7-8350-a91d84ba6a9a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:48.155559 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 45/95] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:03:47 2022] GET /identity/v3/role_assignments?user.id=c4c00af7c7f1415b949cfc5553ea08d6&scope.project.id=844e7dec0aec49598b6b69437d09d460&role.id=33fa4ece26464ae98122f3279db92307 => generated 260 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:48.186654 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3addfe6-9eea-4f70-a670-399f21574aa8 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:48.231901 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4b9f7-09e4-4067-98b3-a08162574477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:48.232572 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4b9f7-09e4-4067-98b3-a08162574477 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:48.232881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4b9f7-09e4-4067-98b3-a08162574477 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:48.233163 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4b9f7-09e4-4067-98b3-a08162574477 None admin] PATH_INFO: `/v3/projects/a186f83e93294da3a08585fd3618aadb` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:48.234377 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4b9f7-09e4-4067-98b3-a08162574477 None admin] RBAC: Authorizing `identity:get_project(project_id=a186f83e93294da3a08585fd3618aadb)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:48.235826 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4b9f7-09e4-4067-98b3-a08162574477 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:48.237930 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 51/96] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:03:47 2022] GET /identity/v3/projects/a186f83e93294da3a08585fd3618aadb => generated 313 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:48.245835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e726c6-5975-48b7-8350-a91d84ba6a9a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:48.379941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e726c6-5975-48b7-8350-a91d84ba6a9a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:48.419811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ed1f1-f9a0-4326-88c1-cae0528bab93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:48.420449 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ed1f1-f9a0-4326-88c1-cae0528bab93 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:48.420763 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ed1f1-f9a0-4326-88c1-cae0528bab93 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:48.421044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ed1f1-f9a0-4326-88c1-cae0528bab93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:48.421849 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ed1f1-f9a0-4326-88c1-cae0528bab93 None admin] RBAC: Adding query filter params (role.id=61321ad01e84416981d4c7208c55bbe7, scope.project.id=a186f83e93294da3a08585fd3618aadb, user.id=c4c00af7c7f1415b949cfc5553ea08d6) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:48.422166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ed1f1-f9a0-4326-88c1-cae0528bab93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:48.423871 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ed1f1-f9a0-4326-88c1-cae0528bab93 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:48.430050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 46/97] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:03:48 2022] GET /identity/v3/role_assignments?user.id=c4c00af7c7f1415b949cfc5553ea08d6&scope.project.id=a186f83e93294da3a08585fd3618aadb&role.id=61321ad01e84416981d4c7208c55bbe7 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:49.950888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ccafd-eb0e-4c09-8892-18b081eb1feb None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:49.951392 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ccafd-eb0e-4c09-8892-18b081eb1feb None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:49.951475 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ccafd-eb0e-4c09-8892-18b081eb1feb None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:49.952796 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 52/98] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:49.958656 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e97ae-1e04-4e27-a593-fe222134275b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:49.959044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e97ae-1e04-4e27-a593-fe222134275b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:49.959235 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e97ae-1e04-4e27-a593-fe222134275b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:49.990248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6c2e97ae-1e04-4e27-a593-fe222134275b None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:49.991479 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6c2e97ae-1e04-4e27-a593-fe222134275b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:50.017580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:50.083295 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 47/99] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:03:50.118449 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ccafd-eb0e-4c09-8892-18b081eb1feb None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:50.122495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:50.157025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061f65a-e602-48ad-b315-53c84b0062dc None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:50.157359 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061f65a-e602-48ad-b315-53c84b0062dc None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:50.157593 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061f65a-e602-48ad-b315-53c84b0062dc None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:50.159051 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 48/100] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:03:50.164411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e285ca-aade-4dba-bdf3-0b3d38429ba9 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:50.164723 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e285ca-aade-4dba-bdf3-0b3d38429ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:50.165009 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e285ca-aade-4dba-bdf3-0b3d38429ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:50.197763 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-75e285ca-aade-4dba-bdf3-0b3d38429ba9 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:50.199411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-75e285ca-aade-4dba-bdf3-0b3d38429ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:50.314993 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 49/101] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:03:50.345392 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ccafd-eb0e-4c09-8892-18b081eb1feb None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:50.355251 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e285ca-aade-4dba-bdf3-0b3d38429ba9 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:50.412153 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3acc6d-f672-4d05-9f92-8424ecdf06ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:50.412844 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3acc6d-f672-4d05-9f92-8424ecdf06ce None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:50.413134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3acc6d-f672-4d05-9f92-8424ecdf06ce None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:50.413414 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3acc6d-f672-4d05-9f92-8424ecdf06ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:50.438903 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3acc6d-f672-4d05-9f92-8424ecdf06ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:03:50.444514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-0a3acc6d-f672-4d05-9f92-8424ecdf06ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:03:50.444514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:03:50.444514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:03:50.444514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:03:50.444514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:03:50.444514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:03:50.444514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:03:50.444514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:03:50.444514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:03:50.444514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:03:50.444514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:03:50.444514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:03:50.444514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:03:50.444514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:03:50.444514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:03:50.444514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:03:50.445362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:03:50.445362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:03:50.445362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:03:50.445362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:03:50.445362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:03:50.445362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:03:50.445362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:03:50.445362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:03:50.445362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:03:50.445362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:03:50.445362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:03:50.445362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:03:50.445362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:03:50.445362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:03:50.445362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:03:50.445362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:03:50.446523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:03:50.446523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:03:50.446523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:03:50.446523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:03:50.446523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:03:50.446523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:03:50.446523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:03:50.446523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:03:50.446523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:03:50.446523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:03:50.446523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:03:50.446523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:03:50.446523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 53/102] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:03:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:03:50.447351 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7c3f1-8557-40a3-9a40-b9fdec0422ff None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:50.447351 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7c3f1-8557-40a3-9a40-b9fdec0422ff None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:50.447462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7c3f1-8557-40a3-9a40-b9fdec0422ff None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:50.448746 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 54/103] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:50 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:50.460303 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d197a5-2363-4f1e-8b44-fa7977c735ca None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:50.460598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d197a5-2363-4f1e-8b44-fa7977c735ca None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:50.460908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d197a5-2363-4f1e-8b44-fa7977c735ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:50.506193 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c7d197a5-2363-4f1e-8b44-fa7977c735ca None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:50.507516 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c7d197a5-2363-4f1e-8b44-fa7977c735ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:50.512330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:50.527916 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e285ca-aade-4dba-bdf3-0b3d38429ba9 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:50.564575 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c833c-62ed-47eb-8832-3494c282d84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:50.565624 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c833c-62ed-47eb-8832-3494c282d84e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:50.566109 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c833c-62ed-47eb-8832-3494c282d84e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:50.566605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c833c-62ed-47eb-8832-3494c282d84e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:50.568591 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c833c-62ed-47eb-8832-3494c282d84e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:50.570370 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c833c-62ed-47eb-8832-3494c282d84e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:50.572177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 50/104] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:03:50 2022] GET /identity/v3/domains/default => generated 200 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:03:50.573450 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c833c-62ed-47eb-8832-3494c282d84e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:50.621020 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:50.635242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 55/105] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:50.638005 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d197a5-2363-4f1e-8b44-fa7977c735ca None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:50.756234 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c833c-62ed-47eb-8832-3494c282d84e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:50.816601 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d197a5-2363-4f1e-8b44-fa7977c735ca None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:50.819476 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b2f4d-eeb6-489f-95bb-6b550e2597a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:50.820108 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b2f4d-eeb6-489f-95bb-6b550e2597a4 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:50.820393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b2f4d-eeb6-489f-95bb-6b550e2597a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:50.820691 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b2f4d-eeb6-489f-95bb-6b550e2597a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:50.821481 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b2f4d-eeb6-489f-95bb-6b550e2597a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:50.821794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b2f4d-eeb6-489f-95bb-6b550e2597a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:50.823167 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b2f4d-eeb6-489f-95bb-6b550e2597a4 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:50.833444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 51/106] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:03:50 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:50.835244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b2f4d-eeb6-489f-95bb-6b550e2597a4 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:50.859930 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:50.863537 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6ea71-3297-4cbb-bb3e-6115ba33fe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:50.864999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6ea71-3297-4cbb-bb3e-6115ba33fe51 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:50.865476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6ea71-3297-4cbb-bb3e-6115ba33fe51 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:50.865939 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6ea71-3297-4cbb-bb3e-6115ba33fe51 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:50.866807 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6ea71-3297-4cbb-bb3e-6115ba33fe51 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:50.868453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6ea71-3297-4cbb-bb3e-6115ba33fe51 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:50.954582 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b2f4d-eeb6-489f-95bb-6b550e2597a4 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:50.968758 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 56/107] 10.222.0.141 () {60 vars in 1146 bytes} [Tue Jul 26 16:03:50 2022] POST /identity/v3/projects => generated 303 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:03:50.968758 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0696030-026f-44c0-be06-1a1834842077 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:50.968758 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0696030-026f-44c0-be06-1a1834842077 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:50.968758 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0696030-026f-44c0-be06-1a1834842077 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:50.968758 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 57/108] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:50.969544 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0696030-026f-44c0-be06-1a1834842077 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:51.019436 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b380cf0-6398-41dc-952f-18b47c752868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:51.020188 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b380cf0-6398-41dc-952f-18b47c752868 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:51.020480 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b380cf0-6398-41dc-952f-18b47c752868 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:51.021861 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b380cf0-6398-41dc-952f-18b47c752868 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:51.045981 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b380cf0-6398-41dc-952f-18b47c752868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:03:51.056810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-7b380cf0-6398-41dc-952f-18b47c752868 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 16:03:51.056810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:03:51.056810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:03:51.056810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:03:51.056810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:03:51.056810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:03:51.056810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:03:51.056810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:03:51.056810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:03:51.056810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:03:51.056810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:03:51.056810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:03:51.056810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:03:51.056810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:03:51.056810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:03:51.056810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:03:51.057724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:03:51.057724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:03:51.057724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:03:51.057724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:03:51.057724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:03:51.057724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:03:51.057724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:03:51.057724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:03:51.057724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:03:51.057724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:03:51.057724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:03:51.057724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:03:51.057724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:03:51.057724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:03:51.057724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:03:51.057724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:03:51.058448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:03:51.058448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:03:51.058448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:03:51.058448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:03:51.058448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:03:51.058448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:03:51.058448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:03:51.058448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:03:51.058448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:03:51.058448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:03:51.058448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 16:03:51.058448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:03:51.063500 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 52/109] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:03:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:03:51.064528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425c5a4-3730-457c-8cdc-594127a6d939 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:51.066702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425c5a4-3730-457c-8cdc-594127a6d939 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:51.067048 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425c5a4-3730-457c-8cdc-594127a6d939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:51.079142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:51.103099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f425c5a4-3730-457c-8cdc-594127a6d939 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:51.104323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f425c5a4-3730-457c-8cdc-594127a6d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:51.180262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0696030-026f-44c0-be06-1a1834842077 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:51.228170 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 53/110] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:51.228170 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425c5a4-3730-457c-8cdc-594127a6d939 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:51.232832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64da9c7-a6e2-48e6-80b2-e3ef1c9477ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:51.233507 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64da9c7-a6e2-48e6-80b2-e3ef1c9477ab None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:51.233790 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64da9c7-a6e2-48e6-80b2-e3ef1c9477ab None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:51.234064 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64da9c7-a6e2-48e6-80b2-e3ef1c9477ab None admin] PATH_INFO: `/v3/users/c4c00af7c7f1415b949cfc5553ea08d6` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:51.235838 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64da9c7-a6e2-48e6-80b2-e3ef1c9477ab None admin] RBAC: Authorizing `identity:get_user(user_id=c4c00af7c7f1415b949cfc5553ea08d6)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:51.237361 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64da9c7-a6e2-48e6-80b2-e3ef1c9477ab None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:51.246155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 58/111] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:03:50 2022] GET /identity/v3/users/c4c00af7c7f1415b949cfc5553ea08d6 => generated 276 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:51.246733 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:51.251387 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64da9c7-a6e2-48e6-80b2-e3ef1c9477ab None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:51.349807 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425c5a4-3730-457c-8cdc-594127a6d939 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:51.383563 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64da9c7-a6e2-48e6-80b2-e3ef1c9477ab None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:51.386608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dc86b-f74a-4059-aa5b-d058b618c6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:51.387244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dc86b-f74a-4059-aa5b-d058b618c6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:51.387530 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dc86b-f74a-4059-aa5b-d058b618c6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:51.387810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dc86b-f74a-4059-aa5b-d058b618c6d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:51.388532 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dc86b-f74a-4059-aa5b-d058b618c6d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:51.388876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dc86b-f74a-4059-aa5b-d058b618c6d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:51.390293 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dc86b-f74a-4059-aa5b-d058b618c6d2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:51.399931 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 54/112] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:03:51 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:51.401214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a385b74-f2be-483f-a986-715fafd9fd48 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:51.401514 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a385b74-f2be-483f-a986-715fafd9fd48 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:51.401795 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a385b74-f2be-483f-a986-715fafd9fd48 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:51.402813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:51.404447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 55/113] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:51 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:51.404838 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a385b74-f2be-483f-a986-715fafd9fd48 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:51.429059 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0e4dd-be29-4cd3-8ea3-0a801ea0ec52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:51.429766 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0e4dd-be29-4cd3-8ea3-0a801ea0ec52 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:51.430054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0e4dd-be29-4cd3-8ea3-0a801ea0ec52 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:51.430391 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0e4dd-be29-4cd3-8ea3-0a801ea0ec52 None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:51.431589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0e4dd-be29-4cd3-8ea3-0a801ea0ec52 None admin] RBAC: Authorizing `identity:get_project(project_id=844e7dec0aec49598b6b69437d09d460)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:51.433116 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0e4dd-be29-4cd3-8ea3-0a801ea0ec52 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:51.435521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 59/114] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:03:51 2022] GET /identity/v3/projects/844e7dec0aec49598b6b69437d09d460 => generated 299 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:51.436504 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0e4dd-be29-4cd3-8ea3-0a801ea0ec52 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:51.481884 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:51.522479 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a385b74-f2be-483f-a986-715fafd9fd48 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:51.551969 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0e4dd-be29-4cd3-8ea3-0a801ea0ec52 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:51.558833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79726e-8276-447d-a2ef-a14ea0fadb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:51.559486 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79726e-8276-447d-a2ef-a14ea0fadb8b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:51.559771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79726e-8276-447d-a2ef-a14ea0fadb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:51.560051 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79726e-8276-447d-a2ef-a14ea0fadb8b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:51.571501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79726e-8276-447d-a2ef-a14ea0fadb8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:03:51.577095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-0e79726e-8276-447d-a2ef-a14ea0fadb8b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:03:51.577095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:03:51.577095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:03:51.577095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:03:51.577095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:03:51.577095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:03:51.577095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:03:51.577095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:03:51.577095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:03:51.577095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:03:51.577095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:03:51.577095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:03:51.577095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:03:51.577095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:03:51.577095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:03:51.577095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:03:51.578030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:03:51.578030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:03:51.578030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:03:51.578030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:03:51.578030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:03:51.578030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:03:51.578030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:03:51.578030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:03:51.578030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:03:51.578030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:03:51.578030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:03:51.578030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:03:51.578030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:03:51.578030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:03:51.578030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:03:51.578030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:03:51.578943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:03:51.578943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:03:51.578943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:03:51.578943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:03:51.578943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:03:51.578943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:03:51.578943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:03:51.578943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:03:51.578943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:03:51.578943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:03:51.578943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:03:51.578943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:03:51.578943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 56/115] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:03:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:03:51.579702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f9db3-13f8-403d-a7f1-0de42f6ccc11 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:51.580056 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f9db3-13f8-403d-a7f1-0de42f6ccc11 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:51.580056 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f9db3-13f8-403d-a7f1-0de42f6ccc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:51.593871 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20875380-5a8c-40fd-922f-da895e65143d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:51.594653 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20875380-5a8c-40fd-922f-da895e65143d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:51.595081 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20875380-5a8c-40fd-922f-da895e65143d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:51.595432 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20875380-5a8c-40fd-922f-da895e65143d None admin] PATH_INFO: `/v3/users/b1f8a58392954fb29fdb04ffa4276e09` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:51.603610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-be2f9db3-13f8-403d-a7f1-0de42f6ccc11 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:51.605271 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-be2f9db3-13f8-403d-a7f1-0de42f6ccc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:51.612473 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20875380-5a8c-40fd-922f-da895e65143d None admin] RBAC: Authorizing `identity:get_user(user_id=b1f8a58392954fb29fdb04ffa4276e09)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:51.614048 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20875380-5a8c-40fd-922f-da895e65143d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:51.617066 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 60/116] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:03:51 2022] GET /identity/v3/users/b1f8a58392954fb29fdb04ffa4276e09 => generated 290 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:51.617066 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20875380-5a8c-40fd-922f-da895e65143d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:51.668558 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:51.682426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 57/117] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:51.683852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62386707-6542-452d-af8c-2ee5353d2f8b None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:51.684151 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62386707-6542-452d-af8c-2ee5353d2f8b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:51.684433 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62386707-6542-452d-af8c-2ee5353d2f8b None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:51.687162 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 58/118] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:51 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:51.687809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62386707-6542-452d-af8c-2ee5353d2f8b None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:51.739343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20875380-5a8c-40fd-922f-da895e65143d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:51.759296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:51.777183 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6905a1-7736-46e0-9c34-a7248e4cb728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:51.777920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6905a1-7736-46e0-9c34-a7248e4cb728 None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:51.778209 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6905a1-7736-46e0-9c34-a7248e4cb728 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:51.778498 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6905a1-7736-46e0-9c34-a7248e4cb728 None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460/users/c4c00af7c7f1415b949cfc5553ea08d6/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:51.780491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6905a1-7736-46e0-9c34-a7248e4cb728 None admin] RBAC: Authorizing `identity:create_grant(project_id=844e7dec0aec49598b6b69437d09d460, user_id=c4c00af7c7f1415b949cfc5553ea08d6, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:51.782016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6905a1-7736-46e0-9c34-a7248e4cb728 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:51.804891 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62386707-6542-452d-af8c-2ee5353d2f8b None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:51.839831 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9a2c0-00d7-4bec-b63e-6f38af6a5561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:51.840527 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9a2c0-00d7-4bec-b63e-6f38af6a5561 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:51.840837 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9a2c0-00d7-4bec-b63e-6f38af6a5561 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:51.841187 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9a2c0-00d7-4bec-b63e-6f38af6a5561 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:51.841843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9a2c0-00d7-4bec-b63e-6f38af6a5561 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:51.842145 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9a2c0-00d7-4bec-b63e-6f38af6a5561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:51.843574 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9a2c0-00d7-4bec-b63e-6f38af6a5561 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:51.852693 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 59/119] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:03:51 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:51.853990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9a2c0-00d7-4bec-b63e-6f38af6a5561 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:51.863529 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 61/120] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:03:51 2022] PUT /identity/v3/projects/844e7dec0aec49598b6b69437d09d460/users/c4c00af7c7f1415b949cfc5553ea08d6/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:03:51.870372 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8f457-a9bf-42f6-866e-45062ee24cd0 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:51.870668 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8f457-a9bf-42f6-866e-45062ee24cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:51.870985 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8f457-a9bf-42f6-866e-45062ee24cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:51.924940 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8ef8f457-a9bf-42f6-866e-45062ee24cd0 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:51.927346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8ef8f457-a9bf-42f6-866e-45062ee24cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:51.995134 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9a2c0-00d7-4bec-b63e-6f38af6a5561 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:52.020477 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 62/121] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:52.021539 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8f457-a9bf-42f6-866e-45062ee24cd0 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:52.024863 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:52.043562 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50746d9f-932e-4ff1-a6cc-3a5101c9f203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:52.044736 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50746d9f-932e-4ff1-a6cc-3a5101c9f203 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:52.045515 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50746d9f-932e-4ff1-a6cc-3a5101c9f203 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:52.046005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50746d9f-932e-4ff1-a6cc-3a5101c9f203 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:52.059104 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:52.137714 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50746d9f-932e-4ff1-a6cc-3a5101c9f203 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:52.139249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50746d9f-932e-4ff1-a6cc-3a5101c9f203 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:52.149059 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8f457-a9bf-42f6-866e-45062ee24cd0 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:52.198385 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d2200-34ac-42d9-90a7-56675afcb99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:52.199131 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d2200-34ac-42d9-90a7-56675afcb99a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:52.199415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d2200-34ac-42d9-90a7-56675afcb99a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:52.199739 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d2200-34ac-42d9-90a7-56675afcb99a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:52.212394 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d2200-34ac-42d9-90a7-56675afcb99a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:03:52.217688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-325d2200-34ac-42d9-90a7-56675afcb99a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:03:52.217688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:03:52.217688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:03:52.217688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:03:52.217688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:03:52.217688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:03:52.217688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:03:52.217688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:03:52.217688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:03:52.217688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:03:52.217688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:03:52.217688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:03:52.217688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:03:52.217688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:03:52.217688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:03:52.217688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:03:52.218532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:03:52.218532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:03:52.218532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:03:52.218532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:03:52.218532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:03:52.218532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:03:52.218532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:03:52.218532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:03:52.218532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:03:52.218532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:03:52.218532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:03:52.218532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:03:52.218532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:03:52.218532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:03:52.218532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:03:52.218532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:03:52.219262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:03:52.219262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:03:52.219262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:03:52.219262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:03:52.219262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:03:52.219262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:03:52.219262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:03:52.219262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:03:52.219262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:03:52.219262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:03:52.219262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:03:52.219262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:03:52.219262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 63/122] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:03:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:03:52.220357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d2200-34ac-42d9-90a7-56675afcb99a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:52.253181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 60/123] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:03:51 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:03:52.254001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50746d9f-932e-4ff1-a6cc-3a5101c9f203 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:52.277091 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:52.337209 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:52.352101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d2200-34ac-42d9-90a7-56675afcb99a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:52.364244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50746d9f-932e-4ff1-a6cc-3a5101c9f203 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:52.399569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de1516-b829-467e-a384-dfa5910ba407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:52.400140 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de1516-b829-467e-a384-dfa5910ba407 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:52.400423 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de1516-b829-467e-a384-dfa5910ba407 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:52.400721 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de1516-b829-467e-a384-dfa5910ba407 None admin] PATH_INFO: `/v3/users/c4c00af7c7f1415b949cfc5553ea08d6` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:52.401949 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de1516-b829-467e-a384-dfa5910ba407 None admin] RBAC: Authorizing `identity:get_user(user_id=c4c00af7c7f1415b949cfc5553ea08d6)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:52.403324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386e21e-14db-4f6b-ad0d-94dc095f340f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:52.403450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de1516-b829-467e-a384-dfa5910ba407 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:52.404184 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386e21e-14db-4f6b-ad0d-94dc095f340f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:52.404615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386e21e-14db-4f6b-ad0d-94dc095f340f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:52.405227 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386e21e-14db-4f6b-ad0d-94dc095f340f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:52.405334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 64/124] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:03:52 2022] GET /identity/v3/users/c4c00af7c7f1415b949cfc5553ea08d6 => generated 276 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:52.405862 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de1516-b829-467e-a384-dfa5910ba407 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:52.417192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386e21e-14db-4f6b-ad0d-94dc095f340f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:03:52.422427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-b386e21e-14db-4f6b-ad0d-94dc095f340f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:03:52.422427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:03:52.422427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:03:52.422427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:03:52.422427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:03:52.422427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:03:52.422427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:03:52.422427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:03:52.422427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:03:52.422427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:03:52.422427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:03:52.422427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:03:52.422427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:03:52.422427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:03:52.422427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:03:52.422427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:03:52.424393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:03:52.424393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:03:52.424393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:03:52.424393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:03:52.424393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:03:52.424393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:03:52.424393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:03:52.424393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:03:52.424393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:03:52.424393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:03:52.424393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:03:52.424393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:03:52.424393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:03:52.424393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:03:52.424393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:03:52.424393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:03:52.426366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:03:52.426366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:03:52.426366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:03:52.426366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:03:52.426366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:03:52.426366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:03:52.426366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:03:52.426366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:03:52.426366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:03:52.426366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:03:52.426366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:03:52.426366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:03:52.426366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 61/125] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:03:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:03:52.427781 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386e21e-14db-4f6b-ad0d-94dc095f340f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:52.528637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:52.529411 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de1516-b829-467e-a384-dfa5910ba407 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:52.554159 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386e21e-14db-4f6b-ad0d-94dc095f340f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:52.569030 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df091b-ae37-407d-b78f-4b815154da9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:52.569655 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df091b-ae37-407d-b78f-4b815154da9a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:52.570185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df091b-ae37-407d-b78f-4b815154da9a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:52.570469 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df091b-ae37-407d-b78f-4b815154da9a None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:52.571631 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df091b-ae37-407d-b78f-4b815154da9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:52.571940 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df091b-ae37-407d-b78f-4b815154da9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:52.573855 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df091b-ae37-407d-b78f-4b815154da9a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:52.585576 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 65/126] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:03:52 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:52.586707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df091b-ae37-407d-b78f-4b815154da9a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:52.593206 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bf83e-fdff-4001-bd9b-40c6d7d88283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:52.593995 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bf83e-fdff-4001-bd9b-40c6d7d88283 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:52.594347 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bf83e-fdff-4001-bd9b-40c6d7d88283 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:52.594693 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bf83e-fdff-4001-bd9b-40c6d7d88283 None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:52.595993 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bf83e-fdff-4001-bd9b-40c6d7d88283 None admin] RBAC: Authorizing `identity:get_project(project_id=844e7dec0aec49598b6b69437d09d460)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:52.597575 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bf83e-fdff-4001-bd9b-40c6d7d88283 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:52.599604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 62/127] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:03:52 2022] GET /identity/v3/projects/844e7dec0aec49598b6b69437d09d460 => generated 299 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:52.600463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bf83e-fdff-4001-bd9b-40c6d7d88283 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:52.615728 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:52.713347 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bf83e-fdff-4001-bd9b-40c6d7d88283 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:52.716755 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df091b-ae37-407d-b78f-4b815154da9a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:52.753369 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e4bbc-080e-42cd-8379-9f734aaa0307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:52.754102 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e4bbc-080e-42cd-8379-9f734aaa0307 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:52.754517 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e4bbc-080e-42cd-8379-9f734aaa0307 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:52.755256 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e4bbc-080e-42cd-8379-9f734aaa0307 None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:52.756439 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e4bbc-080e-42cd-8379-9f734aaa0307 None admin] RBAC: Authorizing `identity:get_project(project_id=844e7dec0aec49598b6b69437d09d460)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:52.757157 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17ce41-b128-4485-ba02-e91b41e9ccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:52.757943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17ce41-b128-4485-ba02-e91b41e9ccee None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:52.758106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e4bbc-080e-42cd-8379-9f734aaa0307 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:52.758492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17ce41-b128-4485-ba02-e91b41e9ccee None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:52.758900 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17ce41-b128-4485-ba02-e91b41e9ccee None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:52.759741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17ce41-b128-4485-ba02-e91b41e9ccee None admin] RBAC: Adding query filter params (name=member) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:52.759857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 66/128] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:03:52 2022] GET /identity/v3/projects/844e7dec0aec49598b6b69437d09d460 => generated 299 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:52.760274 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17ce41-b128-4485-ba02-e91b41e9ccee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:52.760692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e4bbc-080e-42cd-8379-9f734aaa0307 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:52.761945 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17ce41-b128-4485-ba02-e91b41e9ccee None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:52.772755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 63/129] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:03:52 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:52.774209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17ce41-b128-4485-ba02-e91b41e9ccee None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:52.790385 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:52.859253 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:52.872147 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e4bbc-080e-42cd-8379-9f734aaa0307 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:52.908291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3c18b-5308-4661-b873-d6bcd3a0e179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:52.909021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3c18b-5308-4661-b873-d6bcd3a0e179 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:52.909270 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3c18b-5308-4661-b873-d6bcd3a0e179 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:52.909552 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3c18b-5308-4661-b873-d6bcd3a0e179 None admin] PATH_INFO: `/v3/users/6845518adc8f4e04b03cfbd69adea2d2` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:52.910765 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3c18b-5308-4661-b873-d6bcd3a0e179 None admin] RBAC: Authorizing `identity:get_user(user_id=6845518adc8f4e04b03cfbd69adea2d2)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:52.911701 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17ce41-b128-4485-ba02-e91b41e9ccee None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:52.912222 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3c18b-5308-4661-b873-d6bcd3a0e179 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:52.914027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 67/130] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:03:52 2022] GET /identity/v3/users/6845518adc8f4e04b03cfbd69adea2d2 => generated 248 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:52.920694 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3c18b-5308-4661-b873-d6bcd3a0e179 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:52.953523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f8cad-cb1b-4e17-b98e-4543f41994a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:52.954152 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f8cad-cb1b-4e17-b98e-4543f41994a9 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:52.954439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f8cad-cb1b-4e17-b98e-4543f41994a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:52.954722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f8cad-cb1b-4e17-b98e-4543f41994a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:52.955515 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f8cad-cb1b-4e17-b98e-4543f41994a9 None admin] RBAC: Adding query filter params (role.id=caee5723a1744eba93eee74ec02c8b8f, scope.project.id=844e7dec0aec49598b6b69437d09d460, user.id=b1f8a58392954fb29fdb04ffa4276e09) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:52.955833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f8cad-cb1b-4e17-b98e-4543f41994a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:52.957350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f8cad-cb1b-4e17-b98e-4543f41994a9 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:52.963051 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 64/131] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:03:52 2022] GET /identity/v3/role_assignments?user.id=b1f8a58392954fb29fdb04ffa4276e09&scope.project.id=844e7dec0aec49598b6b69437d09d460&role.id=caee5723a1744eba93eee74ec02c8b8f => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:52.963690 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f8cad-cb1b-4e17-b98e-4543f41994a9 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:53.045322 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3c18b-5308-4661-b873-d6bcd3a0e179 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:53.090492 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6133ca-46fa-4e4f-b908-16107c87955a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:53.092985 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6133ca-46fa-4e4f-b908-16107c87955a None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:53.092985 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6133ca-46fa-4e4f-b908-16107c87955a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:53.092985 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6133ca-46fa-4e4f-b908-16107c87955a None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460/users/c4c00af7c7f1415b949cfc5553ea08d6/roles/33fa4ece26464ae98122f3279db92307` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:53.095101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6133ca-46fa-4e4f-b908-16107c87955a None admin] RBAC: Authorizing `identity:create_grant(project_id=844e7dec0aec49598b6b69437d09d460, user_id=c4c00af7c7f1415b949cfc5553ea08d6, role_id=33fa4ece26464ae98122f3279db92307)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:53.096842 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6133ca-46fa-4e4f-b908-16107c87955a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:53.160648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:53.188578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f8cad-cb1b-4e17-b98e-4543f41994a9 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:53.225832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7207731-2571-4891-a3b9-8130961a5ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:53.226434 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7207731-2571-4891-a3b9-8130961a5ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:53.226731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7207731-2571-4891-a3b9-8130961a5ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:53.227017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7207731-2571-4891-a3b9-8130961a5ee3 None admin] PATH_INFO: `/v3/users/c4c00af7c7f1415b949cfc5553ea08d6` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:53.228512 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7207731-2571-4891-a3b9-8130961a5ee3 None admin] RBAC: Authorizing `identity:get_user(user_id=c4c00af7c7f1415b949cfc5553ea08d6)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:53.231782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7207731-2571-4891-a3b9-8130961a5ee3 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:53.231908 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 65/133] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:03:52 2022] GET /identity/v3/users/c4c00af7c7f1415b949cfc5553ea08d6 => generated 276 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:53.232375 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 68/133] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:03:52 2022] PUT /identity/v3/projects/844e7dec0aec49598b6b69437d09d460/users/c4c00af7c7f1415b949cfc5553ea08d6/roles/33fa4ece26464ae98122f3279db92307 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:03:53.233563 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7207731-2571-4891-a3b9-8130961a5ee3 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:53.242210 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6133ca-46fa-4e4f-b908-16107c87955a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:53.278687 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:53.351005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7207731-2571-4891-a3b9-8130961a5ee3 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:53.392845 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba47eca-c990-4c13-9df4-c35d07b83a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:53.393529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba47eca-c990-4c13-9df4-c35d07b83a5a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:53.393816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba47eca-c990-4c13-9df4-c35d07b83a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:53.394096 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba47eca-c990-4c13-9df4-c35d07b83a5a None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:53.397613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba47eca-c990-4c13-9df4-c35d07b83a5a None admin] RBAC: Authorizing `identity:get_project(project_id=844e7dec0aec49598b6b69437d09d460)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:53.399102 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba47eca-c990-4c13-9df4-c35d07b83a5a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:53.401970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 66/134] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:03:53 2022] GET /identity/v3/projects/844e7dec0aec49598b6b69437d09d460 => generated 299 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:53.404321 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8c6bc-016c-4465-b9d9-b1240cb31257 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:53.404613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8c6bc-016c-4465-b9d9-b1240cb31257 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:53.410420 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8c6bc-016c-4465-b9d9-b1240cb31257 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:53.414504 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 67/135] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:53 2022] GET /identity => generated 271 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:53.416173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8c6bc-016c-4465-b9d9-b1240cb31257 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:53.445432 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:53.461794 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6133ca-46fa-4e4f-b908-16107c87955a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:53.512099 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a8866-d5e6-4429-8574-856769d21fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:53.512723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a8866-d5e6-4429-8574-856769d21fbc None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:53.513023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a8866-d5e6-4429-8574-856769d21fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:53.513306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a8866-d5e6-4429-8574-856769d21fbc None admin] PATH_INFO: `/v3/projects/a186f83e93294da3a08585fd3618aadb` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:53.514500 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a8866-d5e6-4429-8574-856769d21fbc None admin] RBAC: Authorizing `identity:get_project(project_id=a186f83e93294da3a08585fd3618aadb)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:53.516078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a8866-d5e6-4429-8574-856769d21fbc None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:53.517783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 69/136] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:03:53 2022] GET /identity/v3/projects/a186f83e93294da3a08585fd3618aadb => generated 313 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:03:53.518915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c6477-0a38-4de2-a3d4-f985d7398945 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:53.519201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c6477-0a38-4de2-a3d4-f985d7398945 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:53.519480 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c6477-0a38-4de2-a3d4-f985d7398945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:53.543308 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-0a9c6477-0a38-4de2-a3d4-f985d7398945 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:53.544516 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0a9c6477-0a38-4de2-a3d4-f985d7398945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:53.571841 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8c6bc-016c-4465-b9d9-b1240cb31257 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:53.610191 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa921f73-fa17-49f5-90f7-fcbbed9d7b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:53.610943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa921f73-fa17-49f5-90f7-fcbbed9d7b17 None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:53.611236 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa921f73-fa17-49f5-90f7-fcbbed9d7b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:53.611530 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa921f73-fa17-49f5-90f7-fcbbed9d7b17 None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460/users/6845518adc8f4e04b03cfbd69adea2d2/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:53.613527 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa921f73-fa17-49f5-90f7-fcbbed9d7b17 None admin] RBAC: Authorizing `identity:create_grant(project_id=844e7dec0aec49598b6b69437d09d460, user_id=6845518adc8f4e04b03cfbd69adea2d2, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:53.615555 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa921f73-fa17-49f5-90f7-fcbbed9d7b17 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:53.616551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 70/137] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:53.617255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c6477-0a38-4de2-a3d4-f985d7398945 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:53.645142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:53.700605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 68/138] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:03:53 2022] PUT /identity/v3/projects/844e7dec0aec49598b6b69437d09d460/users/6845518adc8f4e04b03cfbd69adea2d2/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:03:53.701882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa921f73-fa17-49f5-90f7-fcbbed9d7b17 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:53.742349 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c6477-0a38-4de2-a3d4-f985d7398945 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:53.781420 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9825707-81f9-4109-bf9a-17013b219fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:53.782096 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9825707-81f9-4109-bf9a-17013b219fb9 None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:53.782390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9825707-81f9-4109-bf9a-17013b219fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:53.782682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9825707-81f9-4109-bf9a-17013b219fb9 None admin] PATH_INFO: `/v3/projects/a186f83e93294da3a08585fd3618aadb/users/c4c00af7c7f1415b949cfc5553ea08d6/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:53.784802 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9825707-81f9-4109-bf9a-17013b219fb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a186f83e93294da3a08585fd3618aadb, user_id=c4c00af7c7f1415b949cfc5553ea08d6, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:53.786876 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9825707-81f9-4109-bf9a-17013b219fb9 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:53.859579 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:53.874946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 71/139] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:03:53 2022] PUT /identity/v3/projects/a186f83e93294da3a08585fd3618aadb/users/c4c00af7c7f1415b949cfc5553ea08d6/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:03:53.914750 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa921f73-fa17-49f5-90f7-fcbbed9d7b17 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:53.963742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa2ca5-07d2-4655-97c3-6b605a808578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:53.964393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa2ca5-07d2-4655-97c3-6b605a808578 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:53.964700 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa2ca5-07d2-4655-97c3-6b605a808578 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:53.964969 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa2ca5-07d2-4655-97c3-6b605a808578 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:53.966686 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa2ca5-07d2-4655-97c3-6b605a808578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:53.968182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa2ca5-07d2-4655-97c3-6b605a808578 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:53.969966 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 69/140] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:03:53 2022] GET /identity/v3/domains/default => generated 200 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:53.976026 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9825707-81f9-4109-bf9a-17013b219fb9 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:54.091577 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:54.119694 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9825707-81f9-4109-bf9a-17013b219fb9 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:54.158224 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c77c88-aab1-45e0-b607-663e91768357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:54.158858 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c77c88-aab1-45e0-b607-663e91768357 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:54.159156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c77c88-aab1-45e0-b607-663e91768357 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:54.159435 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c77c88-aab1-45e0-b607-663e91768357 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:54.160289 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c77c88-aab1-45e0-b607-663e91768357 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:54.161898 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c77c88-aab1-45e0-b607-663e91768357 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:54.287215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251d496-1e0a-4f65-bc7b-45f5a17df4df None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:54.287798 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251d496-1e0a-4f65-bc7b-45f5a17df4df None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:54.287879 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251d496-1e0a-4f65-bc7b-45f5a17df4df None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:54.289513 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 70/141] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:54.296091 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e35995-da93-43f8-a1b8-09336521042e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:54.302079 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e35995-da93-43f8-a1b8-09336521042e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:54.302079 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e35995-da93-43f8-a1b8-09336521042e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:54.320844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-22e35995-da93-43f8-a1b8-09336521042e None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:54.322033 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-22e35995-da93-43f8-a1b8-09336521042e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:54.354907 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 72/142] 10.222.0.141 () {60 vars in 1137 bytes} [Tue Jul 26 16:03:53 2022] POST /identity/v3/users => generated 284 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:03:54.397753 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 71/143] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:03:54.420491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c77c88-aab1-45e0-b607-663e91768357 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:54.529205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c77c88-aab1-45e0-b607-663e91768357 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:54.566409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:54.572913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e5a12-3b8c-4069-8423-4e2ef26a1ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:54.573562 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e5a12-3b8c-4069-8423-4e2ef26a1ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:54.573842 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e5a12-3b8c-4069-8423-4e2ef26a1ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:54.574115 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e5a12-3b8c-4069-8423-4e2ef26a1ad6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:54.589637 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e5a12-3b8c-4069-8423-4e2ef26a1ad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:03:54.594603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-ec6e5a12-3b8c-4069-8423-4e2ef26a1ad6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:03:54.594603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:03:54.594603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:03:54.594603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:03:54.594603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:03:54.594603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:03:54.594603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:03:54.594603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:03:54.594603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:03:54.594603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:03:54.594603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:03:54.594603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:03:54.594603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:03:54.594603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:03:54.594603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:03:54.594603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:03:54.595450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:03:54.595450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:03:54.595450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:03:54.595450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:03:54.595450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:03:54.595450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:03:54.595450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:03:54.595450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:03:54.595450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:03:54.595450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:03:54.595450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:03:54.595450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:03:54.595450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:03:54.595450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:03:54.595450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:03:54.595450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:03:54.596934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:03:54.596934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:03:54.596934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:03:54.596934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:03:54.596934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:03:54.596934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:03:54.596934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:03:54.596934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:03:54.596934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:03:54.596934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:03:54.596934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:03:54.596934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:03:54.596934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 73/144] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:03:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:03:54.602897 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e35995-da93-43f8-a1b8-09336521042e None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:54.674125 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:54.710267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e35995-da93-43f8-a1b8-09336521042e None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:54.748941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f0405-e1f5-4745-839f-86b6f41eb85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:54.749569 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f0405-e1f5-4745-839f-86b6f41eb85b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:54.749849 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f0405-e1f5-4745-839f-86b6f41eb85b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:54.750125 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f0405-e1f5-4745-839f-86b6f41eb85b None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:54.750840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f0405-e1f5-4745-839f-86b6f41eb85b None admin] RBAC: Adding query filter params (name=member) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:54.751143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f0405-e1f5-4745-839f-86b6f41eb85b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:54.752513 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f0405-e1f5-4745-839f-86b6f41eb85b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:54.761350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 72/145] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:03:54 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:54.766897 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e5a12-3b8c-4069-8423-4e2ef26a1ad6 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:54.873672 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e5a12-3b8c-4069-8423-4e2ef26a1ad6 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:54.913771 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a883c8e-7e55-45e8-ae58-b030439220c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:54.914479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a883c8e-7e55-45e8-ae58-b030439220c8 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:54.914765 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a883c8e-7e55-45e8-ae58-b030439220c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:54.915036 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a883c8e-7e55-45e8-ae58-b030439220c8 None admin] PATH_INFO: `/v3/users/c4c00af7c7f1415b949cfc5553ea08d6` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:54.916240 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a883c8e-7e55-45e8-ae58-b030439220c8 None admin] RBAC: Authorizing `identity:get_user(user_id=c4c00af7c7f1415b949cfc5553ea08d6)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:54.917757 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a883c8e-7e55-45e8-ae58-b030439220c8 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:54.919631 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 74/146] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:03:54 2022] GET /identity/v3/users/c4c00af7c7f1415b949cfc5553ea08d6 => generated 276 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:54.925373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f0405-e1f5-4745-839f-86b6f41eb85b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:55.031611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f0405-e1f5-4745-839f-86b6f41eb85b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:55.067001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa2d49-4149-47af-ab88-ccb2f17a6728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:55.067677 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa2d49-4149-47af-ab88-ccb2f17a6728 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:55.067974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa2d49-4149-47af-ab88-ccb2f17a6728 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:55.068245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa2d49-4149-47af-ab88-ccb2f17a6728 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:55.073422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:55.139901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa2d49-4149-47af-ab88-ccb2f17a6728 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:55.141387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa2d49-4149-47af-ab88-ccb2f17a6728 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:55.243491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 73/147] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:03:54 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:03:55.249124 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a883c8e-7e55-45e8-ae58-b030439220c8 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:55.311229 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:55.368540 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a883c8e-7e55-45e8-ae58-b030439220c8 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:55.412237 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc6d4a-e100-4125-a2e6-3c156ab60ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:55.412929 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc6d4a-e100-4125-a2e6-3c156ab60ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:55.413216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc6d4a-e100-4125-a2e6-3c156ab60ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:55.413498 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc6d4a-e100-4125-a2e6-3c156ab60ba5 None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:55.414701 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc6d4a-e100-4125-a2e6-3c156ab60ba5 None admin] RBAC: Authorizing `identity:get_project(project_id=844e7dec0aec49598b6b69437d09d460)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:55.416184 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc6d4a-e100-4125-a2e6-3c156ab60ba5 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:55.417945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 75/148] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:03:55 2022] GET /identity/v3/projects/844e7dec0aec49598b6b69437d09d460 => generated 299 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:55.424088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa2d49-4149-47af-ab88-ccb2f17a6728 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:55.481071 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:55.568646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa2d49-4149-47af-ab88-ccb2f17a6728 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:55.605249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556d133-0676-44ec-bbec-b4848a9461ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:55.605862 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9513c-11c0-40e3-a0f2-56c7e0aeb17b None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:55.606052 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556d133-0676-44ec-bbec-b4848a9461ee None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:55.606208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556d133-0676-44ec-bbec-b4848a9461ee None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:55.606358 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9513c-11c0-40e3-a0f2-56c7e0aeb17b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:55.606517 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556d133-0676-44ec-bbec-b4848a9461ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:55.606681 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9513c-11c0-40e3-a0f2-56c7e0aeb17b None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:55.607235 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556d133-0676-44ec-bbec-b4848a9461ee None admin] RBAC: Adding query filter params (role.id=61321ad01e84416981d4c7208c55bbe7, scope.project.id=844e7dec0aec49598b6b69437d09d460, user.id=c4c00af7c7f1415b949cfc5553ea08d6) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:55.607549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556d133-0676-44ec-bbec-b4848a9461ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:55.607777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 76/149] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:55.609084 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556d133-0676-44ec-bbec-b4848a9461ee None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:55.615903 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 74/150] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:03:55 2022] GET /identity/v3/role_assignments?user.id=c4c00af7c7f1415b949cfc5553ea08d6&scope.project.id=844e7dec0aec49598b6b69437d09d460&role.id=61321ad01e84416981d4c7208c55bbe7 => generated 610 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:55.623726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e06ee-641b-4ed0-847f-20c4d5c8d983 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:55.624042 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e06ee-641b-4ed0-847f-20c4d5c8d983 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:55.624283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e06ee-641b-4ed0-847f-20c4d5c8d983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:55.661765 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8f5e06ee-641b-4ed0-847f-20c4d5c8d983 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:55.663018 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8f5e06ee-641b-4ed0-847f-20c4d5c8d983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:55.763070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 77/151] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:55.803339 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556d133-0676-44ec-bbec-b4848a9461ee None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:55.951378 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556d133-0676-44ec-bbec-b4848a9461ee None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:55.952979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:55.987523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8de682-bd62-4454-9edd-6a480056a3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:55.988170 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8de682-bd62-4454-9edd-6a480056a3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:55.988450 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8de682-bd62-4454-9edd-6a480056a3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:55.989408 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8de682-bd62-4454-9edd-6a480056a3d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:56.000641 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8de682-bd62-4454-9edd-6a480056a3d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:03:56.006025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-0b8de682-bd62-4454-9edd-6a480056a3d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 16:03:56.006025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:03:56.006025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:03:56.006025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:03:56.006025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:03:56.006025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:03:56.006025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:03:56.006025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:03:56.006025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:03:56.006025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:03:56.006025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:03:56.006025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:03:56.006025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:03:56.006025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:03:56.006025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:03:56.006025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:03:56.006867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:03:56.006867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:03:56.006867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:03:56.006867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:03:56.006867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:03:56.006867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:03:56.006867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:03:56.006867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:03:56.006867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:03:56.006867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:03:56.006867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:03:56.006867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:03:56.006867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:03:56.006867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:03:56.006867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:03:56.006867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:03:56.008011 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:03:56.008011 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:03:56.008011 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:03:56.008011 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:03:56.008011 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:03:56.008011 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:03:56.008011 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:03:56.008011 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:03:56.008011 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:03:56.008011 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:03:56.008011 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 16:03:56.008011 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:03:56.008011 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 75/152] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:03:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:03:56.013102 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e06ee-641b-4ed0-847f-20c4d5c8d983 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:56.092730 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:56.143744 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e06ee-641b-4ed0-847f-20c4d5c8d983 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:56.184266 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384367e-98f3-4951-bcc1-73f9aa1f594e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:56.185320 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384367e-98f3-4951-bcc1-73f9aa1f594e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:56.185833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384367e-98f3-4951-bcc1-73f9aa1f594e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:56.186320 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384367e-98f3-4951-bcc1-73f9aa1f594e None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:56.187393 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384367e-98f3-4951-bcc1-73f9aa1f594e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:56.187911 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384367e-98f3-4951-bcc1-73f9aa1f594e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:56.189531 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384367e-98f3-4951-bcc1-73f9aa1f594e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:56.202710 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 78/153] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:03:56 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:56.208792 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8de682-bd62-4454-9edd-6a480056a3d8 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:56.355871 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8de682-bd62-4454-9edd-6a480056a3d8 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:56.402847 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f5f60-ee3c-43bf-bc87-17d944700002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:56.403505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f5f60-ee3c-43bf-bc87-17d944700002 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:56.403782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f5f60-ee3c-43bf-bc87-17d944700002 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:56.404055 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f5f60-ee3c-43bf-bc87-17d944700002 None admin] PATH_INFO: `/v3/users/b1f8a58392954fb29fdb04ffa4276e09` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:56.405355 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f5f60-ee3c-43bf-bc87-17d944700002 None admin] RBAC: Authorizing `identity:get_user(user_id=b1f8a58392954fb29fdb04ffa4276e09)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:56.406787 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f5f60-ee3c-43bf-bc87-17d944700002 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:56.408377 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 76/154] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:03:56 2022] GET /identity/v3/users/b1f8a58392954fb29fdb04ffa4276e09 => generated 290 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:56.414413 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384367e-98f3-4951-bcc1-73f9aa1f594e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:56.550741 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384367e-98f3-4951-bcc1-73f9aa1f594e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:56.555633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f533b2e-6f35-44a1-ae23-a35c3cab63ff None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:56.556100 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f533b2e-6f35-44a1-ae23-a35c3cab63ff None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:56.556189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f533b2e-6f35-44a1-ae23-a35c3cab63ff None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:56.557535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 77/155] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:03:56.572912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa8a2d-54bf-41a8-acfc-6d38f44e7187 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:56.573201 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa8a2d-54bf-41a8-acfc-6d38f44e7187 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:56.573461 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa8a2d-54bf-41a8-acfc-6d38f44e7187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:56.575340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:56.594437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ccf42-3115-43cd-aeaa-23b23c7ef724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:56.595432 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ccf42-3115-43cd-aeaa-23b23c7ef724 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:56.595935 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ccf42-3115-43cd-aeaa-23b23c7ef724 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:56.596576 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ccf42-3115-43cd-aeaa-23b23c7ef724 None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:56.598156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ccf42-3115-43cd-aeaa-23b23c7ef724 None admin] RBAC: Authorizing `identity:get_project(project_id=844e7dec0aec49598b6b69437d09d460)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:56.600056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ccf42-3115-43cd-aeaa-23b23c7ef724 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:56.601988 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 79/156] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:03:56 2022] GET /identity/v3/projects/844e7dec0aec49598b6b69437d09d460 => generated 299 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:56.603455 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d1aa8a2d-54bf-41a8-acfc-6d38f44e7187 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:56.609164 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d1aa8a2d-54bf-41a8-acfc-6d38f44e7187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:56.610039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ccf42-3115-43cd-aeaa-23b23c7ef724 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:56.635396 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:56.734401 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 78/157] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:56.782141 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa8a2d-54bf-41a8-acfc-6d38f44e7187 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:56.843094 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ccf42-3115-43cd-aeaa-23b23c7ef724 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:56.935130 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922898b-2efc-4626-b582-62eb8e29e2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:56.935827 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922898b-2efc-4626-b582-62eb8e29e2ca None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:56.936110 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922898b-2efc-4626-b582-62eb8e29e2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:56.936388 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922898b-2efc-4626-b582-62eb8e29e2ca None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460/users/b1f8a58392954fb29fdb04ffa4276e09/roles/caee5723a1744eba93eee74ec02c8b8f` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:56.945508 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922898b-2efc-4626-b582-62eb8e29e2ca None admin] RBAC: Authorizing `identity:create_grant(project_id=844e7dec0aec49598b6b69437d09d460, user_id=b1f8a58392954fb29fdb04ffa4276e09, role_id=caee5723a1744eba93eee74ec02c8b8f)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:56.947011 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922898b-2efc-4626-b582-62eb8e29e2ca None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:56.957559 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa8a2d-54bf-41a8-acfc-6d38f44e7187 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:57.026889 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 80/158] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:03:56 2022] PUT /identity/v3/projects/844e7dec0aec49598b6b69437d09d460/users/b1f8a58392954fb29fdb04ffa4276e09/roles/caee5723a1744eba93eee74ec02c8b8f => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:03:57.048191 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093d243-eaf1-419c-bd2b-84d72ba9935d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:57.048908 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093d243-eaf1-419c-bd2b-84d72ba9935d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:57.049194 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093d243-eaf1-419c-bd2b-84d72ba9935d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:57.049479 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093d243-eaf1-419c-bd2b-84d72ba9935d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:57.073866 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093d243-eaf1-419c-bd2b-84d72ba9935d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:03:57.079835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-2093d243-eaf1-419c-bd2b-84d72ba9935d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:03:57.079835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:03:57.079835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:03:57.079835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:03:57.079835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:03:57.079835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:03:57.079835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:03:57.079835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:03:57.079835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:03:57.079835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:03:57.079835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:03:57.079835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:03:57.079835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:03:57.079835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:03:57.079835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:03:57.079835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:03:57.081148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:03:57.081148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:03:57.081148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:03:57.081148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:03:57.081148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:03:57.081148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:03:57.081148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:03:57.081148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:03:57.081148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:03:57.081148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:03:57.081148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:03:57.081148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:03:57.081148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:03:57.081148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:03:57.081148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:03:57.081148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:03:57.083340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:03:57.083340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:03:57.083340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:03:57.083340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:03:57.083340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:03:57.083340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:03:57.083340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:03:57.083340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:03:57.083340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:03:57.083340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:03:57.083340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:03:57.083340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:03:57.083340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 79/159] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:03:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:03:57.090492 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922898b-2efc-4626-b582-62eb8e29e2ca None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:57.182537 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:57.261616 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922898b-2efc-4626-b582-62eb8e29e2ca None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:57.278256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c08ce-c4b8-4945-a414-2f2fb0889f86 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:57.278579 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c08ce-c4b8-4945-a414-2f2fb0889f86 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:57.278807 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c08ce-c4b8-4945-a414-2f2fb0889f86 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:57.284132 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 80/160] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:57.290147 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc697c-12ec-4726-a441-102ca83b577f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:57.290430 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc697c-12ec-4726-a441-102ca83b577f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:57.290686 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc697c-12ec-4726-a441-102ca83b577f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:57.304276 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73120791-1ced-4929-ac02-6981f0395097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:57.304952 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73120791-1ced-4929-ac02-6981f0395097 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:57.305238 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73120791-1ced-4929-ac02-6981f0395097 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:57.305511 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73120791-1ced-4929-ac02-6981f0395097 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:57.306248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73120791-1ced-4929-ac02-6981f0395097 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:57.306556 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73120791-1ced-4929-ac02-6981f0395097 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:57.307980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73120791-1ced-4929-ac02-6981f0395097 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:57.317496 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 81/161] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:03:57 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:57.323758 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5bdc697c-12ec-4726-a441-102ca83b577f None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:57.324034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73120791-1ced-4929-ac02-6981f0395097 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:57.325118 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5bdc697c-12ec-4726-a441-102ca83b577f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:57.339207 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:57.441580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 81/162] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:57.506832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc697c-12ec-4726-a441-102ca83b577f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:57.511019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73120791-1ced-4929-ac02-6981f0395097 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:57.530269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:57.582918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580a434-caf0-4bee-98c0-57e4e39a9585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:57.583952 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580a434-caf0-4bee-98c0-57e4e39a9585 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:57.584519 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580a434-caf0-4bee-98c0-57e4e39a9585 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:57.585048 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580a434-caf0-4bee-98c0-57e4e39a9585 None admin] PATH_INFO: `/v3/users/c4c00af7c7f1415b949cfc5553ea08d6` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:57.586473 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580a434-caf0-4bee-98c0-57e4e39a9585 None admin] RBAC: Authorizing `identity:get_user(user_id=c4c00af7c7f1415b949cfc5553ea08d6)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:57.588240 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580a434-caf0-4bee-98c0-57e4e39a9585 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:57.590156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 82/163] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:03:57 2022] GET /identity/v3/users/c4c00af7c7f1415b949cfc5553ea08d6 => generated 276 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:03:57.595739 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580a434-caf0-4bee-98c0-57e4e39a9585 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:57.652912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc697c-12ec-4726-a441-102ca83b577f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:57.704776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd887107-498b-4bfa-b2ba-19e9552f2b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:57.705505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd887107-498b-4bfa-b2ba-19e9552f2b35 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:57.705790 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd887107-498b-4bfa-b2ba-19e9552f2b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:57.706063 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd887107-498b-4bfa-b2ba-19e9552f2b35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:57.722112 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd887107-498b-4bfa-b2ba-19e9552f2b35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:03:57.731578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-bd887107-498b-4bfa-b2ba-19e9552f2b35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:03:57.731578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:03:57.731578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:03:57.731578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:03:57.731578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:03:57.731578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:03:57.731578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:03:57.731578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:03:57.731578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:03:57.731578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:03:57.731578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:03:57.731578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:03:57.731578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:03:57.731578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:03:57.731578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:03:57.731578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:03:57.732518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:03:57.732518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:03:57.732518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:03:57.732518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:03:57.732518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:03:57.732518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:03:57.732518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:03:57.732518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:03:57.732518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:03:57.732518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:03:57.732518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:03:57.732518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:03:57.732518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:03:57.732518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:03:57.732518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:03:57.732518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:03:57.733291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:03:57.733291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:03:57.733291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:03:57.733291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:03:57.733291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:03:57.733291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:03:57.733291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:03:57.733291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:03:57.733291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:03:57.733291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:03:57.733291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:03:57.733291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:03:57.733291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 82/164] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:03:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:03:57.740852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd887107-498b-4bfa-b2ba-19e9552f2b35 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:57.746777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:57.857439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd887107-498b-4bfa-b2ba-19e9552f2b35 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:57.883494 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580a434-caf0-4bee-98c0-57e4e39a9585 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:57.905197 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df37e52-c5e7-4938-81a1-c6506c0c47ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:57.906240 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df37e52-c5e7-4938-81a1-c6506c0c47ce None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:57.906733 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df37e52-c5e7-4938-81a1-c6506c0c47ce None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:57.907219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df37e52-c5e7-4938-81a1-c6506c0c47ce None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:57.908383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df37e52-c5e7-4938-81a1-c6506c0c47ce None admin] RBAC: Adding query filter params (name=member) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:57.910972 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df37e52-c5e7-4938-81a1-c6506c0c47ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:57.912627 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df37e52-c5e7-4938-81a1-c6506c0c47ce None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:57.937263 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 83/165] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:03:57 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:03:57.938549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09aebd-f638-47b7-91e9-ffa706e3c5c9 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:57.939750 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09aebd-f638-47b7-91e9-ffa706e3c5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:57.940028 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09aebd-f638-47b7-91e9-ffa706e3c5c9 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:57.941290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 84/166] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:57.951280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455e9f6-64cd-4c4e-8ff5-f53b457159ab None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:57.951554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455e9f6-64cd-4c4e-8ff5-f53b457159ab None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:57.951831 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455e9f6-64cd-4c4e-8ff5-f53b457159ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:57.983518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca4824-d558-4b4c-9dd5-47949df0b043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:57.984078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca4824-d558-4b4c-9dd5-47949df0b043 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:57.984417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca4824-d558-4b4c-9dd5-47949df0b043 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:57.984713 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca4824-d558-4b4c-9dd5-47949df0b043 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:57.996774 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a455e9f6-64cd-4c4e-8ff5-f53b457159ab None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:57.998378 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a455e9f6-64cd-4c4e-8ff5-f53b457159ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:58.070157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:58.115927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca4824-d558-4b4c-9dd5-47949df0b043 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:58.117456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca4824-d558-4b4c-9dd5-47949df0b043 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:58.150993 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:58.170944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 85/167] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:58.171953 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455e9f6-64cd-4c4e-8ff5-f53b457159ab None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:58.317701 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 83/168] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:03:57 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:03:58.318473 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca4824-d558-4b4c-9dd5-47949df0b043 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:58.388891 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455e9f6-64cd-4c4e-8ff5-f53b457159ab None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:58.428156 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be0027-b236-49ab-ad46-67774285c3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:58.428849 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be0027-b236-49ab-ad46-67774285c3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:58.429130 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be0027-b236-49ab-ad46-67774285c3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:58.429403 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be0027-b236-49ab-ad46-67774285c3f5 None admin] PATH_INFO: `/v3/users/c4c00af7c7f1415b949cfc5553ea08d6` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:58.430602 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be0027-b236-49ab-ad46-67774285c3f5 None admin] RBAC: Authorizing `identity:get_user(user_id=c4c00af7c7f1415b949cfc5553ea08d6)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:58.432066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be0027-b236-49ab-ad46-67774285c3f5 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:58.434784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 86/169] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:03:58 2022] GET /identity/v3/users/c4c00af7c7f1415b949cfc5553ea08d6 => generated 276 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:58.435571 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be0027-b236-49ab-ad46-67774285c3f5 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:58.467065 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:58.509943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:58.538645 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca4824-d558-4b4c-9dd5-47949df0b043 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:58.580285 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be0027-b236-49ab-ad46-67774285c3f5 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:58.625407 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d60a62-9c37-4a6a-937a-e7d6d9c59847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:58.626076 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d60a62-9c37-4a6a-937a-e7d6d9c59847 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:58.626362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d60a62-9c37-4a6a-937a-e7d6d9c59847 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:58.626637 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d60a62-9c37-4a6a-937a-e7d6d9c59847 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:58.650697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80350ae-31e6-4fa4-a22b-b18c858a7c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:58.650884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d60a62-9c37-4a6a-937a-e7d6d9c59847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:03:58.651787 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80350ae-31e6-4fa4-a22b-b18c858a7c6c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:58.652282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80350ae-31e6-4fa4-a22b-b18c858a7c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:58.652784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80350ae-31e6-4fa4-a22b-b18c858a7c6c None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:58.656006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-07d60a62-9c37-4a6a-937a-e7d6d9c59847 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:03:58.656006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:03:58.656006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:03:58.656006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:03:58.656006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:03:58.656006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:03:58.656006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:03:58.656006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:03:58.656006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:03:58.656006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:03:58.656006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:03:58.656006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:03:58.656006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:03:58.656006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:03:58.656006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:03:58.656006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:03:58.656910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:03:58.656910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:03:58.656910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:03:58.656910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:03:58.656910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:03:58.656910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:03:58.656910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:03:58.656910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:03:58.656910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:03:58.656910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:03:58.656910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:03:58.656910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:03:58.656910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:03:58.656910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:03:58.656910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:03:58.656910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:03:58.657696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:03:58.657696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:03:58.657696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:03:58.657696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:03:58.657696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:03:58.657696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:03:58.657696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:03:58.657696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:03:58.657696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:03:58.657696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:03:58.657696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:03:58.657696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:03:58.657696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 84/170] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:03:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:03:58.658855 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d60a62-9c37-4a6a-937a-e7d6d9c59847 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:58.659713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80350ae-31e6-4fa4-a22b-b18c858a7c6c None admin] RBAC: Authorizing `identity:get_project(project_id=844e7dec0aec49598b6b69437d09d460)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:58.661908 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80350ae-31e6-4fa4-a22b-b18c858a7c6c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:58.664086 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 87/171] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:03:58 2022] GET /identity/v3/projects/844e7dec0aec49598b6b69437d09d460 => generated 299 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:58.665083 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80350ae-31e6-4fa4-a22b-b18c858a7c6c None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:58.809585 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80350ae-31e6-4fa4-a22b-b18c858a7c6c None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:58.841096 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:58.848143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b243b-6566-43d6-8f77-9d3b5b99e550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:58.849051 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b243b-6566-43d6-8f77-9d3b5b99e550 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:58.849642 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b243b-6566-43d6-8f77-9d3b5b99e550 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:58.855755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b243b-6566-43d6-8f77-9d3b5b99e550 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:58.855755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b243b-6566-43d6-8f77-9d3b5b99e550 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:58.855755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b243b-6566-43d6-8f77-9d3b5b99e550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:58.855755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b243b-6566-43d6-8f77-9d3b5b99e550 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:58.866731 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d60a62-9c37-4a6a-937a-e7d6d9c59847 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:58.872137 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 88/172] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:03:58 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:58.877607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b243b-6566-43d6-8f77-9d3b5b99e550 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:58.941041 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c74a20-4cdc-43b3-b7c4-45b19c151db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:58.942243 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c74a20-4cdc-43b3-b7c4-45b19c151db6 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:58.942519 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c74a20-4cdc-43b3-b7c4-45b19c151db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:58.942795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c74a20-4cdc-43b3-b7c4-45b19c151db6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:58.952071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:58.998230 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b243b-6566-43d6-8f77-9d3b5b99e550 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:59.033026 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da18dd6-2211-42b8-a1e9-a5de98b4401c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:59.036704 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da18dd6-2211-42b8-a1e9-a5de98b4401c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:59.036704 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da18dd6-2211-42b8-a1e9-a5de98b4401c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:59.036704 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da18dd6-2211-42b8-a1e9-a5de98b4401c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:59.036704 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da18dd6-2211-42b8-a1e9-a5de98b4401c None admin] RBAC: Adding query filter params (role.id=33fa4ece26464ae98122f3279db92307, scope.project.id=844e7dec0aec49598b6b69437d09d460, user.id=c4c00af7c7f1415b949cfc5553ea08d6) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:03:59.036704 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da18dd6-2211-42b8-a1e9-a5de98b4401c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:59.037637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da18dd6-2211-42b8-a1e9-a5de98b4401c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:59.043977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 89/173] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:03:58 2022] GET /identity/v3/role_assignments?user.id=c4c00af7c7f1415b949cfc5553ea08d6&scope.project.id=844e7dec0aec49598b6b69437d09d460&role.id=33fa4ece26464ae98122f3279db92307 => generated 610 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:59.044873 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da18dd6-2211-42b8-a1e9-a5de98b4401c None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:59.110433 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:59.133627 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c74a20-4cdc-43b3-b7c4-45b19c151db6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:59.135151 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c74a20-4cdc-43b3-b7c4-45b19c151db6 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:59.167661 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da18dd6-2211-42b8-a1e9-a5de98b4401c None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:59.209657 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cab21-6b0f-41ef-bf2c-602db90c96be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:59.210473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cab21-6b0f-41ef-bf2c-602db90c96be None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:59.211075 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cab21-6b0f-41ef-bf2c-602db90c96be None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:59.211472 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cab21-6b0f-41ef-bf2c-602db90c96be None admin] PATH_INFO: `/v3/users/6845518adc8f4e04b03cfbd69adea2d2` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:59.212950 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cab21-6b0f-41ef-bf2c-602db90c96be None admin] RBAC: Authorizing `identity:get_user(user_id=6845518adc8f4e04b03cfbd69adea2d2)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:59.215494 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cab21-6b0f-41ef-bf2c-602db90c96be None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:59.217249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 90/174] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:03:59 2022] GET /identity/v3/users/6845518adc8f4e04b03cfbd69adea2d2 => generated 248 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:59.218465 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a57cb9-b97d-4c28-a7e8-501003713462 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:59.218750 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a57cb9-b97d-4c28-a7e8-501003713462 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:59.219065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a57cb9-b97d-4c28-a7e8-501003713462 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:59.222236 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 91/175] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:59.222236 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d39d94-d352-4fc0-83ed-52958dc40a6a None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:59.222236 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d39d94-d352-4fc0-83ed-52958dc40a6a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:59.222514 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d39d94-d352-4fc0-83ed-52958dc40a6a None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:59.224829 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 92/176] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:59.225324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb7cbd-3b56-4a0b-b01d-eb41b73408a5 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:59.225603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb7cbd-3b56-4a0b-b01d-eb41b73408a5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:59.225876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb7cbd-3b56-4a0b-b01d-eb41b73408a5 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:59.227943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 93/177] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:03:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:03:59.228823 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb7cbd-3b56-4a0b-b01d-eb41b73408a5 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:59.299950 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 85/178] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:03:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:03:59.301486 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a3775-5ed2-4e7b-ad3a-6cb632c91c9e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:59.301857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a3775-5ed2-4e7b-ad3a-6cb632c91c9e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:59.302231 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a3775-5ed2-4e7b-ad3a-6cb632c91c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:59.325622 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-843a3775-5ed2-4e7b-ad3a-6cb632c91c9e None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:59.327338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-843a3775-5ed2-4e7b-ad3a-6cb632c91c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:59.358857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb7cbd-3b56-4a0b-b01d-eb41b73408a5 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:59.369101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:59.384040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:59.396620 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed815fe-3232-4d8a-a1ba-57e5b4d3a203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:59.397707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed815fe-3232-4d8a-a1ba-57e5b4d3a203 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:59.398188 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed815fe-3232-4d8a-a1ba-57e5b4d3a203 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:59.398684 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed815fe-3232-4d8a-a1ba-57e5b4d3a203 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:59.410191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 86/179] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:59 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:59.412030 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ea52d-1907-468b-89ee-676bd8a79074 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:59.414153 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ea52d-1907-468b-89ee-676bd8a79074 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:59.414153 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ea52d-1907-468b-89ee-676bd8a79074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:59.435856 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-cd3ea52d-1907-468b-89ee-676bd8a79074 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:59.437082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-cd3ea52d-1907-468b-89ee-676bd8a79074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:59.479056 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed815fe-3232-4d8a-a1ba-57e5b4d3a203 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:59.480528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed815fe-3232-4d8a-a1ba-57e5b4d3a203 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:59.510353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 87/180] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:59 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:59.511631 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522b9d8-2222-4b5e-840a-4f39cb206c01 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:59.511919 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522b9d8-2222-4b5e-840a-4f39cb206c01 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:59.512196 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522b9d8-2222-4b5e-840a-4f39cb206c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:59.529314 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-f522b9d8-2222-4b5e-840a-4f39cb206c01 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:03:59.530494 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f522b9d8-2222-4b5e-840a-4f39cb206c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:03:59.596460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 94/181] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:03:59 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:03:59.597770 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed815fe-3232-4d8a-a1ba-57e5b4d3a203 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:59.610428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 88/182] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:03:59 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:03:59.611284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522b9d8-2222-4b5e-840a-4f39cb206c01 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:59.631393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:59.646019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:59.715269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed815fe-3232-4d8a-a1ba-57e5b4d3a203 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:59.726635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522b9d8-2222-4b5e-840a-4f39cb206c01 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:59.751440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c24b32-edd4-4b46-b128-19a7f9358e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:59.752083 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c24b32-edd4-4b46-b128-19a7f9358e7f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:59.752367 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c24b32-edd4-4b46-b128-19a7f9358e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:59.752643 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c24b32-edd4-4b46-b128-19a7f9358e7f None admin] PATH_INFO: `/v3/projects/a186f83e93294da3a08585fd3618aadb` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:59.753832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c24b32-edd4-4b46-b128-19a7f9358e7f None admin] RBAC: Authorizing `identity:get_project(project_id=a186f83e93294da3a08585fd3618aadb)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:59.755402 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c24b32-edd4-4b46-b128-19a7f9358e7f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:59.757319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 95/183] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:03:59 2022] GET /identity/v3/projects/a186f83e93294da3a08585fd3618aadb => generated 313 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:59.757891 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c24b32-edd4-4b46-b128-19a7f9358e7f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:59.764343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e55b3-9e2d-4fb6-a95e-bf26af352b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:59.765027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e55b3-9e2d-4fb6-a95e-bf26af352b4e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:59.765349 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e55b3-9e2d-4fb6-a95e-bf26af352b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:59.765587 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e55b3-9e2d-4fb6-a95e-bf26af352b4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:59.766844 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e55b3-9e2d-4fb6-a95e-bf26af352b4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:59.768421 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e55b3-9e2d-4fb6-a95e-bf26af352b4e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:59.774534 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 89/184] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:03:59 2022] GET /identity/v3/domains/default => generated 200 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:59.774534 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e55b3-9e2d-4fb6-a95e-bf26af352b4e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:59.857838 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:59.867797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c24b32-edd4-4b46-b128-19a7f9358e7f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:59.873000 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:03:59.880790 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e55b3-9e2d-4fb6-a95e-bf26af352b4e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:03:59.902995 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc3e82-27bb-4434-87ad-27af402d2a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:59.903567 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc3e82-27bb-4434-87ad-27af402d2a9f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:59.903849 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc3e82-27bb-4434-87ad-27af402d2a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:59.904128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc3e82-27bb-4434-87ad-27af402d2a9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:59.918084 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc3e82-27bb-4434-87ad-27af402d2a9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:03:59.919816 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d2919-561a-4175-9cc1-9d0ecd76deea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:03:59.920543 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d2919-561a-4175-9cc1-9d0ecd76deea None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:03:59.920923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d2919-561a-4175-9cc1-9d0ecd76deea None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:03:59.921270 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d2919-561a-4175-9cc1-9d0ecd76deea None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:03:59.922539 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d2919-561a-4175-9cc1-9d0ecd76deea None admin] RBAC: Authorizing `identity:get_project(project_id=844e7dec0aec49598b6b69437d09d460)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:03:59.923426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-28bc3e82-27bb-4434-87ad-27af402d2a9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:03:59.923426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:03:59.923426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:03:59.923426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:03:59.923426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:03:59.923426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:03:59.923426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:03:59.923426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:03:59.923426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:03:59.923426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:03:59.923426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:03:59.923426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:03:59.923426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:03:59.923426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:03:59.923426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:03:59.923426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:03:59.924281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:03:59.924281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:03:59.924281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:03:59.924281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:03:59.924281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:03:59.924281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:03:59.924281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:03:59.924281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:03:59.924281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:03:59.924281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:03:59.924281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:03:59.924281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:03:59.924281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:03:59.924281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:03:59.924281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:03:59.924281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:03:59.925076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:03:59.925076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:03:59.925076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:03:59.925076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:03:59.925076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:03:59.925076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:03:59.925076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:03:59.925076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:03:59.925076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:03:59.925076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:03:59.925076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:03:59.925076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:03:59.925076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 96/185] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:03:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:03:59.925742 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d2919-561a-4175-9cc1-9d0ecd76deea None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:03:59.925807 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc3e82-27bb-4434-87ad-27af402d2a9f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:03:59.927345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 90/186] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:03:59 2022] GET /identity/v3/projects/844e7dec0aec49598b6b69437d09d460 => generated 299 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:03:59.930845 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d2919-561a-4175-9cc1-9d0ecd76deea None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:00.037832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d2919-561a-4175-9cc1-9d0ecd76deea None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:00.040327 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc3e82-27bb-4434-87ad-27af402d2a9f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:00.075694 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48008593-716f-4742-ae3e-2203e656869e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:00.076635 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48008593-716f-4742-ae3e-2203e656869e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:00.077163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48008593-716f-4742-ae3e-2203e656869e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:00.077589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79413a75-f5a4-4f95-9e20-67d13f2f1ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:00.077814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48008593-716f-4742-ae3e-2203e656869e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:00.078215 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79413a75-f5a4-4f95-9e20-67d13f2f1ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:00.078497 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79413a75-f5a4-4f95-9e20-67d13f2f1ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:00.078769 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79413a75-f5a4-4f95-9e20-67d13f2f1ff1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:00.079565 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79413a75-f5a4-4f95-9e20-67d13f2f1ff1 None admin] RBAC: Adding query filter params (role.id=61321ad01e84416981d4c7208c55bbe7, scope.project.id=a186f83e93294da3a08585fd3618aadb, user.id=c4c00af7c7f1415b949cfc5553ea08d6) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:00.079875 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79413a75-f5a4-4f95-9e20-67d13f2f1ff1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:00.081356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79413a75-f5a4-4f95-9e20-67d13f2f1ff1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:00.089039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 91/187] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:03:59 2022] GET /identity/v3/role_assignments?user.id=c4c00af7c7f1415b949cfc5553ea08d6&scope.project.id=a186f83e93294da3a08585fd3618aadb&role.id=61321ad01e84416981d4c7208c55bbe7 => generated 610 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:00.096916 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79413a75-f5a4-4f95-9e20-67d13f2f1ff1 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:00.097083 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48008593-716f-4742-ae3e-2203e656869e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:00.097911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-48008593-716f-4742-ae3e-2203e656869e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:04:00.097911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:00.097911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:00.097911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:00.097911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:00.097911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:00.097911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:00.097911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:00.097911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:00.097911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:00.097911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:00.097911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:00.097911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:00.097911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:00.097911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:00.097911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:00.099248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:00.099248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:00.099248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:00.099248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:00.099248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:00.099248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:00.099248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:00.099248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:00.099248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:00.099248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:00.099248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:00.099248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:00.099248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:00.099248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:00.099248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:00.099248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:00.100035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:00.100035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:00.100035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:00.100035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:00.100035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:00.100035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:00.100035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:00.100035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:00.100035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:00.100035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:00.100035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:04:00.100035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:00.100035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 97/188] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:03:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:00.100842 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48008593-716f-4742-ae3e-2203e656869e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:00.118597 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:00.133841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:00.212752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79413a75-f5a4-4f95-9e20-67d13f2f1ff1 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:00.217756 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48008593-716f-4742-ae3e-2203e656869e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:00.253299 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1797d6-b06f-440b-821e-61b0e3fbcafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:00.254354 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1797d6-b06f-440b-821e-61b0e3fbcafc None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:00.254640 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1797d6-b06f-440b-821e-61b0e3fbcafc None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:00.254914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1797d6-b06f-440b-821e-61b0e3fbcafc None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:00.255607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1797d6-b06f-440b-821e-61b0e3fbcafc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:00.257093 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1797d6-b06f-440b-821e-61b0e3fbcafc None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:00.258815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d28e5-b01b-4910-8ba0-acf8dfa5353f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:00.259437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d28e5-b01b-4910-8ba0-acf8dfa5353f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:00.259717 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d28e5-b01b-4910-8ba0-acf8dfa5353f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:00.259995 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d28e5-b01b-4910-8ba0-acf8dfa5353f None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:00.260830 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d28e5-b01b-4910-8ba0-acf8dfa5353f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:00.261137 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d28e5-b01b-4910-8ba0-acf8dfa5353f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:00.262513 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d28e5-b01b-4910-8ba0-acf8dfa5353f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:00.273408 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 98/189] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:00 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:00.274314 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d28e5-b01b-4910-8ba0-acf8dfa5353f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:00.349756 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:00.373298 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d28e5-b01b-4910-8ba0-acf8dfa5353f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:00.373958 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 92/190] 10.222.0.141 () {60 vars in 1137 bytes} [Tue Jul 26 16:04:00 2022] POST /identity/v3/users => generated 298 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:04:00.375342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017b9a9-fb5e-4a5b-969d-0d6501dcd021 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:00.375663 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017b9a9-fb5e-4a5b-969d-0d6501dcd021 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:00.375938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017b9a9-fb5e-4a5b-969d-0d6501dcd021 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:00.377600 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 93/191] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:00.378391 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017b9a9-fb5e-4a5b-969d-0d6501dcd021 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:00.420577 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5e5d6-9bb3-48ab-889c-b6f0bfa975b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:00.421598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5e5d6-9bb3-48ab-889c-b6f0bfa975b7 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:00.422072 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5e5d6-9bb3-48ab-889c-b6f0bfa975b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:00.422539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5e5d6-9bb3-48ab-889c-b6f0bfa975b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:00.424225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5e5d6-9bb3-48ab-889c-b6f0bfa975b7 None admin] RBAC: Adding query filter params (role.id=94ecbd6c86a84b75bdb0c57fc27a9a07, scope.project.id=844e7dec0aec49598b6b69437d09d460, user.id=6845518adc8f4e04b03cfbd69adea2d2) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:00.424766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5e5d6-9bb3-48ab-889c-b6f0bfa975b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:00.427476 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5e5d6-9bb3-48ab-889c-b6f0bfa975b7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:00.436822 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 99/192] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:04:00 2022] GET /identity/v3/role_assignments?user.id=6845518adc8f4e04b03cfbd69adea2d2&scope.project.id=844e7dec0aec49598b6b69437d09d460&role.id=94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 610 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:00.437474 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5e5d6-9bb3-48ab-889c-b6f0bfa975b7 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:00.518161 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:00.545638 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017b9a9-fb5e-4a5b-969d-0d6501dcd021 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:00.589421 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449a382-ae1b-4e70-a345-93088b24e3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:00.590103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449a382-ae1b-4e70-a345-93088b24e3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:00.590383 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449a382-ae1b-4e70-a345-93088b24e3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:00.590653 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449a382-ae1b-4e70-a345-93088b24e3c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:00.591394 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449a382-ae1b-4e70-a345-93088b24e3c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:00.591700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449a382-ae1b-4e70-a345-93088b24e3c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:00.594050 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449a382-ae1b-4e70-a345-93088b24e3c1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:00.603833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 94/193] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:00 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:00.605140 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b6670-f7e5-4d76-ac0a-93c6910977ca None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:00.605486 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b6670-f7e5-4d76-ac0a-93c6910977ca None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:00.605768 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b6670-f7e5-4d76-ac0a-93c6910977ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:00.626575 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a86b6670-f7e5-4d76-ac0a-93c6910977ca None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:00.627788 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a86b6670-f7e5-4d76-ac0a-93c6910977ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:00.641463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5e5d6-9bb3-48ab-889c-b6f0bfa975b7 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:00.698474 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a1a52-1e3a-40c8-b930-2529efabe105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:00.699447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a1a52-1e3a-40c8-b930-2529efabe105 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:00.699907 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a1a52-1e3a-40c8-b930-2529efabe105 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:00.700374 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a1a52-1e3a-40c8-b930-2529efabe105 None admin] PATH_INFO: `/v3/users/b2827b7427414679a01a936c3eaac97e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:00.712608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:00.724266 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 95/194] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:00.725697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a1a52-1e3a-40c8-b930-2529efabe105 None admin] RBAC: Authorizing `identity:get_user(user_id=b2827b7427414679a01a936c3eaac97e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:00.731221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b6670-f7e5-4d76-ac0a-93c6910977ca None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:00.731355 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a1a52-1e3a-40c8-b930-2529efabe105 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:00.731355 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 100/195] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:04:00 2022] GET /identity/v3/users/b2827b7427414679a01a936c3eaac97e => generated 284 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:00.734185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a1a52-1e3a-40c8-b930-2529efabe105 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:00.823581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:00.852426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b6670-f7e5-4d76-ac0a-93c6910977ca None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:00.871300 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a1a52-1e3a-40c8-b930-2529efabe105 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:00.899290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4287c7-2cc8-4f27-b988-17482caac4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:00.899953 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4287c7-2cc8-4f27-b988-17482caac4ba None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:00.900239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4287c7-2cc8-4f27-b988-17482caac4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:00.900795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4287c7-2cc8-4f27-b988-17482caac4ba None admin] PATH_INFO: `/v3/users/b2827b7427414679a01a936c3eaac97e` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:00.902508 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4287c7-2cc8-4f27-b988-17482caac4ba None admin] RBAC: Authorizing `identity:get_user(user_id=b2827b7427414679a01a936c3eaac97e)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:00.904410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4287c7-2cc8-4f27-b988-17482caac4ba None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:00.907066 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 96/196] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:04:00 2022] GET /identity/v3/users/b2827b7427414679a01a936c3eaac97e => generated 284 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:00.907997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4287c7-2cc8-4f27-b988-17482caac4ba None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:00.909698 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393259e-e6be-49a4-b32d-8327eec6d38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:00.910489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393259e-e6be-49a4-b32d-8327eec6d38b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:00.910868 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393259e-e6be-49a4-b32d-8327eec6d38b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:00.911348 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393259e-e6be-49a4-b32d-8327eec6d38b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:00.984782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:00.993673 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393259e-e6be-49a4-b32d-8327eec6d38b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:01.011731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393259e-e6be-49a4-b32d-8327eec6d38b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:01.034490 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4287c7-2cc8-4f27-b988-17482caac4ba None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:01.075387 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c569a-8284-4a3f-b75d-383d68bae015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:01.076139 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c569a-8284-4a3f-b75d-383d68bae015 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:01.076516 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c569a-8284-4a3f-b75d-383d68bae015 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:01.076931 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c569a-8284-4a3f-b75d-383d68bae015 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:01.088174 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c569a-8284-4a3f-b75d-383d68bae015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:01.093426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-295c569a-8284-4a3f-b75d-383d68bae015 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 16:04:01.093426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:01.093426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:01.093426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:01.093426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:01.093426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:01.093426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:01.093426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:01.093426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:01.093426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:01.093426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:01.093426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:01.093426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:01.093426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:01.093426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:01.093426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:01.094283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:01.094283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:01.094283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:01.094283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:01.094283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:01.094283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:01.094283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:01.094283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:01.094283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:01.094283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:01.094283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:01.094283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:01.094283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:01.094283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:01.094283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:01.094283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:01.095043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:01.095043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:01.095043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:01.095043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:01.095043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:01.095043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:01.095043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:01.095043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:01.095043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:01.095043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:01.095043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 16:04:01.095043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:01.095043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 97/197] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:01.095686 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c569a-8284-4a3f-b75d-383d68bae015 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:01.114534 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:01.123947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 101/198] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:00 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 16:04:01.124905 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393259e-e6be-49a4-b32d-8327eec6d38b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:01.209914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c569a-8284-4a3f-b75d-383d68bae015 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:01.221865 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:01.230737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393259e-e6be-49a4-b32d-8327eec6d38b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:01.253396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e94a7-6823-4cc0-a193-a4679791c5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:01.254260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e94a7-6823-4cc0-a193-a4679791c5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:01.254683 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e94a7-6823-4cc0-a193-a4679791c5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:01.255097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e94a7-6823-4cc0-a193-a4679791c5a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:01.266545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae2978-64a0-43ba-a175-4289ff44c4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:01.267373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae2978-64a0-43ba-a175-4289ff44c4db None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:01.267489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae2978-64a0-43ba-a175-4289ff44c4db None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:01.267722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae2978-64a0-43ba-a175-4289ff44c4db None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:01.268445 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae2978-64a0-43ba-a175-4289ff44c4db None admin] RBAC: Adding query filter params (name=reader) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:01.268781 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae2978-64a0-43ba-a175-4289ff44c4db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:01.270313 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae2978-64a0-43ba-a175-4289ff44c4db None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:01.278709 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 102/199] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:04:01 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:01.279978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae2978-64a0-43ba-a175-4289ff44c4db None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:01.328907 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e94a7-6823-4cc0-a193-a4679791c5a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:01.330717 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e94a7-6823-4cc0-a193-a4679791c5a9 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:01.333353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:01.382494 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae2978-64a0-43ba-a175-4289ff44c4db None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:01.416907 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb5691-60eb-4bd5-911c-08597967759b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:01.417560 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb5691-60eb-4bd5-911c-08597967759b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:01.417837 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb5691-60eb-4bd5-911c-08597967759b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:01.418174 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb5691-60eb-4bd5-911c-08597967759b None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:01.419272 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb5691-60eb-4bd5-911c-08597967759b None admin] RBAC: Authorizing `identity:get_project(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:01.420759 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb5691-60eb-4bd5-911c-08597967759b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:01.422424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 103/200] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:01 2022] GET /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7 => generated 303 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:01.423525 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb5691-60eb-4bd5-911c-08597967759b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:01.438181 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 98/201] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:01 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:01.439309 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e94a7-6823-4cc0-a193-a4679791c5a9 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:01.453068 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:01.527499 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb5691-60eb-4bd5-911c-08597967759b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:01.542341 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e94a7-6823-4cc0-a193-a4679791c5a9 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:01.544118 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:01.563200 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671cf24-d4f6-4f9a-8653-3ae125a0003e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:01.563848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671cf24-d4f6-4f9a-8653-3ae125a0003e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:01.564131 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671cf24-d4f6-4f9a-8653-3ae125a0003e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:01.564408 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671cf24-d4f6-4f9a-8653-3ae125a0003e None admin] PATH_INFO: `/v3/users/b1f8a58392954fb29fdb04ffa4276e09` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:01.565690 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671cf24-d4f6-4f9a-8653-3ae125a0003e None admin] RBAC: Authorizing `identity:get_user(user_id=b1f8a58392954fb29fdb04ffa4276e09)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:01.567714 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671cf24-d4f6-4f9a-8653-3ae125a0003e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:01.569506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 104/202] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:04:01 2022] GET /identity/v3/users/b1f8a58392954fb29fdb04ffa4276e09 => generated 290 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:01.570377 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671cf24-d4f6-4f9a-8653-3ae125a0003e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:01.591787 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacc867-58d4-4f6e-8378-724f59698b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:01.592434 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacc867-58d4-4f6e-8378-724f59698b6c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:01.592739 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacc867-58d4-4f6e-8378-724f59698b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:01.593013 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacc867-58d4-4f6e-8378-724f59698b6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:01.593822 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacc867-58d4-4f6e-8378-724f59698b6c None admin] RBAC: Adding query filter params (role.id=94ecbd6c86a84b75bdb0c57fc27a9a07, scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7, user.id=b2827b7427414679a01a936c3eaac97e) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:01.594129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacc867-58d4-4f6e-8378-724f59698b6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:01.595675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacc867-58d4-4f6e-8378-724f59698b6c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:01.601603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 99/203] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:04:01 2022] GET /identity/v3/role_assignments?user.id=b2827b7427414679a01a936c3eaac97e&scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7&role.id=94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:01.602520 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacc867-58d4-4f6e-8378-724f59698b6c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:01.675608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:01.683540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671cf24-d4f6-4f9a-8653-3ae125a0003e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:01.715616 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacc867-58d4-4f6e-8378-724f59698b6c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:01.720961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e01d73-2b88-4a33-9a4f-fdfca2b3ca87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:01.721756 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e01d73-2b88-4a33-9a4f-fdfca2b3ca87 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:01.722111 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e01d73-2b88-4a33-9a4f-fdfca2b3ca87 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:01.722459 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e01d73-2b88-4a33-9a4f-fdfca2b3ca87 None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:01.723936 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e01d73-2b88-4a33-9a4f-fdfca2b3ca87 None admin] RBAC: Authorizing `identity:get_project(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:01.725614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e01d73-2b88-4a33-9a4f-fdfca2b3ca87 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:01.728149 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 105/204] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:01 2022] GET /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7 => generated 303 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:01.741993 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e01d73-2b88-4a33-9a4f-fdfca2b3ca87 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:01.770943 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92675b73-3cfc-4298-bf15-bb9eadbda5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:01.772345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92675b73-3cfc-4298-bf15-bb9eadbda5bd None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:01.772625 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92675b73-3cfc-4298-bf15-bb9eadbda5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:01.773108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92675b73-3cfc-4298-bf15-bb9eadbda5bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:01.849334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:01.902376 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e01d73-2b88-4a33-9a4f-fdfca2b3ca87 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:01.912246 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92675b73-3cfc-4298-bf15-bb9eadbda5bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:01.914064 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92675b73-3cfc-4298-bf15-bb9eadbda5bd None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:01.966730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69b957-071e-45a9-909d-0a84b3dd316d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:01.967410 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69b957-071e-45a9-909d-0a84b3dd316d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:01.967692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69b957-071e-45a9-909d-0a84b3dd316d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:01.968017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69b957-071e-45a9-909d-0a84b3dd316d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:01.968840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69b957-071e-45a9-909d-0a84b3dd316d None admin] RBAC: Adding query filter params (role.id=33fa4ece26464ae98122f3279db92307, scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7, user.id=b2827b7427414679a01a936c3eaac97e) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:01.969152 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69b957-071e-45a9-909d-0a84b3dd316d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:01.970589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69b957-071e-45a9-909d-0a84b3dd316d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:01.981591 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 106/205] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:04:01 2022] GET /identity/v3/role_assignments?user.id=b2827b7427414679a01a936c3eaac97e&scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7&role.id=33fa4ece26464ae98122f3279db92307 => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:02.032006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 100/206] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:01 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:02.041835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69b957-071e-45a9-909d-0a84b3dd316d None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:02.090881 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:02.186700 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69b957-071e-45a9-909d-0a84b3dd316d None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:02.225430 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b9619-e075-473d-9870-f5680814abc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:02.226453 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b9619-e075-473d-9870-f5680814abc9 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:02.226937 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b9619-e075-473d-9870-f5680814abc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:02.227414 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b9619-e075-473d-9870-f5680814abc9 None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:02.228862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b9619-e075-473d-9870-f5680814abc9 None admin] RBAC: Authorizing `identity:get_project(project_id=844e7dec0aec49598b6b69437d09d460)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:02.230530 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b9619-e075-473d-9870-f5680814abc9 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:02.232816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 107/207] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:02 2022] GET /identity/v3/projects/844e7dec0aec49598b6b69437d09d460 => generated 299 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:02.242330 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92675b73-3cfc-4298-bf15-bb9eadbda5bd None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:02.353309 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:02.387197 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92675b73-3cfc-4298-bf15-bb9eadbda5bd None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:02.423273 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346f157-aead-4ae7-b4bd-a60e8eb5748a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:02.423899 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346f157-aead-4ae7-b4bd-a60e8eb5748a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:02.424179 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346f157-aead-4ae7-b4bd-a60e8eb5748a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:02.424451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346f157-aead-4ae7-b4bd-a60e8eb5748a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:02.425275 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346f157-aead-4ae7-b4bd-a60e8eb5748a None admin] RBAC: Adding query filter params (role.id=caee5723a1744eba93eee74ec02c8b8f, scope.project.id=844e7dec0aec49598b6b69437d09d460, user.id=b1f8a58392954fb29fdb04ffa4276e09) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:02.425580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346f157-aead-4ae7-b4bd-a60e8eb5748a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:02.427556 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346f157-aead-4ae7-b4bd-a60e8eb5748a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:02.433829 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 101/208] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:04:02 2022] GET /identity/v3/role_assignments?user.id=b1f8a58392954fb29fdb04ffa4276e09&scope.project.id=844e7dec0aec49598b6b69437d09d460&role.id=caee5723a1744eba93eee74ec02c8b8f => generated 610 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:02.862439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c58555-8fc7-419d-b9a1-2c96fd807240 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:02.864041 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c58555-8fc7-419d-b9a1-2c96fd807240 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:02.864530 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c58555-8fc7-419d-b9a1-2c96fd807240 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:02.866183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 108/209] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:02 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:02.871658 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b092ee-e7d4-4cbe-8ddf-c606143e5f32 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:02.872147 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b092ee-e7d4-4cbe-8ddf-c606143e5f32 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:02.872224 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b092ee-e7d4-4cbe-8ddf-c606143e5f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:02.890819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-24b092ee-e7d4-4cbe-8ddf-c606143e5f32 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:02.892007 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-24b092ee-e7d4-4cbe-8ddf-c606143e5f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:02.963601 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 102/210] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:02.986867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c58555-8fc7-419d-b9a1-2c96fd807240 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:03.085016 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:03.092715 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c58555-8fc7-419d-b9a1-2c96fd807240 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:03.128900 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18837069-65eb-457a-a7a1-ce633b938472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:03.129546 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18837069-65eb-457a-a7a1-ce633b938472 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:03.129825 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18837069-65eb-457a-a7a1-ce633b938472 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:03.130097 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18837069-65eb-457a-a7a1-ce633b938472 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:03.141444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18837069-65eb-457a-a7a1-ce633b938472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:03.147031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-18837069-65eb-457a-a7a1-ce633b938472 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:03.147031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:03.147031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:03.147031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:03.147031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:03.147031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:03.147031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:03.147031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:03.147031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:03.147031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:03.147031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:03.147031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:03.147031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:03.147031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:03.147031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:03.147031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:03.147857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:03.147857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:03.147857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:03.147857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:03.147857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:03.147857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:03.147857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:03.147857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:03.147857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:03.147857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:03.147857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:03.147857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:03.147857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:03.147857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:03.147857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:03.147857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:03.148626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:03.148626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:03.148626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:03.148626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:03.148626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:03.148626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:03.148626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:03.148626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:03.148626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:03.148626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:03.148626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:03.148626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:03.148626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 109/211] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:03.154569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b092ee-e7d4-4cbe-8ddf-c606143e5f32 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:03.177432 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af86b8-b10e-4a2a-a27f-80b3c386a04e None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:03.177750 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af86b8-b10e-4a2a-a27f-80b3c386a04e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:03.177977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af86b8-b10e-4a2a-a27f-80b3c386a04e None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:03.179317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 110/212] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:03.184173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04566103-820b-4fec-88c3-fc369d57fec3 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:03.184455 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04566103-820b-4fec-88c3-fc369d57fec3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:03.184757 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04566103-820b-4fec-88c3-fc369d57fec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:03.203592 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-04566103-820b-4fec-88c3-fc369d57fec3 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:03.204799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-04566103-820b-4fec-88c3-fc369d57fec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:03.227965 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:03.273764 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b092ee-e7d4-4cbe-8ddf-c606143e5f32 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:03.297461 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 111/213] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:03.315620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029da7e-dc41-445c-af26-b6e6e480eddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:03.316305 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029da7e-dc41-445c-af26-b6e6e480eddd None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:03.316639 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029da7e-dc41-445c-af26-b6e6e480eddd None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:03.316976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029da7e-dc41-445c-af26-b6e6e480eddd None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:03.317714 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029da7e-dc41-445c-af26-b6e6e480eddd None admin] RBAC: Adding query filter params (name=member) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:03.318023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029da7e-dc41-445c-af26-b6e6e480eddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:03.319464 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029da7e-dc41-445c-af26-b6e6e480eddd None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:03.322273 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04566103-820b-4fec-88c3-fc369d57fec3 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:03.328956 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 103/214] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:04:03 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:03.336288 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029da7e-dc41-445c-af26-b6e6e480eddd None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:03.423751 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:03.442186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04566103-820b-4fec-88c3-fc369d57fec3 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:03.442640 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029da7e-dc41-445c-af26-b6e6e480eddd None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:03.466164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:03.477754 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d383d7-2c6e-49d1-9e7a-5df65b37e4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:03.478474 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d383d7-2c6e-49d1-9e7a-5df65b37e4db None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:03.478996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d383d7-2c6e-49d1-9e7a-5df65b37e4db None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:03.479281 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d383d7-2c6e-49d1-9e7a-5df65b37e4db None admin] PATH_INFO: `/v3/users/b50b030d2cc64a718dcc5e5e91462f24` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:03.483040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea415ac-dcb3-4433-b106-c930938bb0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:03.484015 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea415ac-dcb3-4433-b106-c930938bb0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:03.484571 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea415ac-dcb3-4433-b106-c930938bb0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:03.485066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea415ac-dcb3-4433-b106-c930938bb0c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:03.486468 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea415ac-dcb3-4433-b106-c930938bb0c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:03.488180 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea415ac-dcb3-4433-b106-c930938bb0c2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:03.493398 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d383d7-2c6e-49d1-9e7a-5df65b37e4db None admin] RBAC: Authorizing `identity:get_user(user_id=b50b030d2cc64a718dcc5e5e91462f24)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:03.493929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 112/215] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:03 2022] GET /identity/v3/domains/default => generated 200 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:03.495285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d383d7-2c6e-49d1-9e7a-5df65b37e4db None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:03.496297 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea415ac-dcb3-4433-b106-c930938bb0c2 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:03.497193 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 104/216] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:04:03 2022] GET /identity/v3/users/b50b030d2cc64a718dcc5e5e91462f24 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:03.508934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d383d7-2c6e-49d1-9e7a-5df65b37e4db None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:03.610848 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d383d7-2c6e-49d1-9e7a-5df65b37e4db None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:03.616693 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea415ac-dcb3-4433-b106-c930938bb0c2 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:03.646750 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee144f-6742-463e-bd53-379f08f66cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:03.647374 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee144f-6742-463e-bd53-379f08f66cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:03.647660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee144f-6742-463e-bd53-379f08f66cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:03.647939 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee144f-6742-463e-bd53-379f08f66cf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:03.654975 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37942f3-01ca-46ef-b10c-5e0548bfe8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:03.655861 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37942f3-01ca-46ef-b10c-5e0548bfe8e5 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:03.656330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37942f3-01ca-46ef-b10c-5e0548bfe8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:03.656907 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37942f3-01ca-46ef-b10c-5e0548bfe8e5 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:03.657792 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37942f3-01ca-46ef-b10c-5e0548bfe8e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:03.659427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37942f3-01ca-46ef-b10c-5e0548bfe8e5 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:03.701806 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:03.720571 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee144f-6742-463e-bd53-379f08f66cf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:03.722084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee144f-6742-463e-bd53-379f08f66cf7 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:03.765588 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 113/217] 10.222.0.141 () {60 vars in 1137 bytes} [Tue Jul 26 16:04:03 2022] POST /identity/v3/users => generated 298 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:04:03.841868 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 105/218] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:03 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:03.847982 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37942f3-01ca-46ef-b10c-5e0548bfe8e5 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:03.860946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:03.887278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261ea05-7417-4f36-b556-8ad06e204903 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:03.888185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261ea05-7417-4f36-b556-8ad06e204903 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:03.888373 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261ea05-7417-4f36-b556-8ad06e204903 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:03.889952 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 106/219] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:03.897285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c1897-50b9-44ea-a533-9c62928d5b9a None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:03.897769 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c1897-50b9-44ea-a533-9c62928d5b9a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:03.898294 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c1897-50b9-44ea-a533-9c62928d5b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:03.920531 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-948c1897-50b9-44ea-a533-9c62928d5b9a None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:03.921803 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-948c1897-50b9-44ea-a533-9c62928d5b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:03.991234 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37942f3-01ca-46ef-b10c-5e0548bfe8e5 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:04.012316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 107/220] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:04:04.032386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76fb54-042a-487a-9018-e10eb916b556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:04.033142 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76fb54-042a-487a-9018-e10eb916b556 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:04.033422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76fb54-042a-487a-9018-e10eb916b556 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:04.033697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76fb54-042a-487a-9018-e10eb916b556 None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:04.033933 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c1897-50b9-44ea-a533-9c62928d5b9a None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:04.034887 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76fb54-042a-487a-9018-e10eb916b556 None admin] RBAC: Authorizing `identity:get_project(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:04.036613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76fb54-042a-487a-9018-e10eb916b556 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:04.039348 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 114/221] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:03 2022] GET /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7 => generated 303 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:04.045821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76fb54-042a-487a-9018-e10eb916b556 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:04.046554 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:04.153900 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:04.163809 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c1897-50b9-44ea-a533-9c62928d5b9a None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:04.179660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76fb54-042a-487a-9018-e10eb916b556 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:04.212995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef85b01-fc81-4864-b412-8aa7b54f2323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:04.213198 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef85b01-fc81-4864-b412-8aa7b54f2323 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:04.213439 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef85b01-fc81-4864-b412-8aa7b54f2323 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:04.213689 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef85b01-fc81-4864-b412-8aa7b54f2323 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:04.232036 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef85b01-fc81-4864-b412-8aa7b54f2323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:04.236639 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec192b7-ea83-4f32-8b13-d97b8e042efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:04.237213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-fef85b01-fc81-4864-b412-8aa7b54f2323 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:04:04.237213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:04.237213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:04.237213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:04.237213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:04.237213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:04.237213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:04.237213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:04.237213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:04.237213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:04.237213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:04.237213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:04.237213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:04.237213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:04.237213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:04.237213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:04.238082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:04.238082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:04.238082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:04.238082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:04.238082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:04.238082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:04.238082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:04.238082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:04.238082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:04.238082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:04.238082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:04.238082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:04.238082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:04.238082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:04.238082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:04.238082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:04.239501 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:04.239501 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:04.239501 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:04.239501 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:04.239501 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:04.239501 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:04.239501 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:04.239501 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:04.239501 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:04.239501 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:04.239501 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:04:04.239501 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:04.240538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec192b7-ea83-4f32-8b13-d97b8e042efb None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:04.240538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec192b7-ea83-4f32-8b13-d97b8e042efb None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:04.240538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec192b7-ea83-4f32-8b13-d97b8e042efb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:04.240868 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 108/222] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:04:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:04:04.240936 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec192b7-ea83-4f32-8b13-d97b8e042efb None admin] RBAC: Adding query filter params (role.id=61321ad01e84416981d4c7208c55bbe7, scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7, user.id=b50b030d2cc64a718dcc5e5e91462f24) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:04.240936 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec192b7-ea83-4f32-8b13-d97b8e042efb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:04.241068 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec192b7-ea83-4f32-8b13-d97b8e042efb None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:04.243901 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98744966-fb24-41a0-850f-c3f0abd2ca7b None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:04.244125 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98744966-fb24-41a0-850f-c3f0abd2ca7b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:04.244401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98744966-fb24-41a0-850f-c3f0abd2ca7b None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:04.245895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 109/223] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:04.247214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 115/224] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:04:04 2022] GET /identity/v3/role_assignments?user.id=b50b030d2cc64a718dcc5e5e91462f24&scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7&role.id=61321ad01e84416981d4c7208c55bbe7 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:04.250692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98744966-fb24-41a0-850f-c3f0abd2ca7b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:04.254615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8819be7-794c-43d4-83f7-6ae6a808868f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:04.254907 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8819be7-794c-43d4-83f7-6ae6a808868f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:04.255215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8819be7-794c-43d4-83f7-6ae6a808868f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:04.286699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a8819be7-794c-43d4-83f7-6ae6a808868f None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:04.288741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a8819be7-794c-43d4-83f7-6ae6a808868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:04.341056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:04.382957 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98744966-fb24-41a0-850f-c3f0abd2ca7b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:04.420677 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 116/225] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:04 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:04.431408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb95bf-dab6-4a2a-ad84-f1971b741c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:04.432133 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb95bf-dab6-4a2a-ad84-f1971b741c0d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:04.432542 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb95bf-dab6-4a2a-ad84-f1971b741c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:04.432914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb95bf-dab6-4a2a-ad84-f1971b741c0d None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:04.433714 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb95bf-dab6-4a2a-ad84-f1971b741c0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:04.434132 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb95bf-dab6-4a2a-ad84-f1971b741c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:04.435655 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb95bf-dab6-4a2a-ad84-f1971b741c0d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:04.450955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 110/226] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:04 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:04.456756 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8819be7-794c-43d4-83f7-6ae6a808868f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:04.460907 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb95bf-dab6-4a2a-ad84-f1971b741c0d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:04.558432 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:04.591442 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8819be7-794c-43d4-83f7-6ae6a808868f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:04.640261 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea7744-9fe1-4c45-b25a-c994cadbd34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:04.640938 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea7744-9fe1-4c45-b25a-c994cadbd34b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:04.641217 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea7744-9fe1-4c45-b25a-c994cadbd34b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:04.641490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea7744-9fe1-4c45-b25a-c994cadbd34b None admin] PATH_INFO: `/v3/users/b2827b7427414679a01a936c3eaac97e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:04.642685 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea7744-9fe1-4c45-b25a-c994cadbd34b None admin] RBAC: Authorizing `identity:get_user(user_id=b2827b7427414679a01a936c3eaac97e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:04.644146 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea7744-9fe1-4c45-b25a-c994cadbd34b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:04.645396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb95bf-dab6-4a2a-ad84-f1971b741c0d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:04.646342 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 117/227] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:04:04 2022] GET /identity/v3/users/b2827b7427414679a01a936c3eaac97e => generated 284 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:04.657845 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea7744-9fe1-4c45-b25a-c994cadbd34b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:04.704467 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:04.717488 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b010e64-1f63-4ffa-8192-6ea284f60778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:04.718145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b010e64-1f63-4ffa-8192-6ea284f60778 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:04.718426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b010e64-1f63-4ffa-8192-6ea284f60778 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:04.731066 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b010e64-1f63-4ffa-8192-6ea284f60778 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:04.745660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b010e64-1f63-4ffa-8192-6ea284f60778 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:04.751157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-9b010e64-1f63-4ffa-8192-6ea284f60778 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:04:04.751157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:04.751157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:04.751157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:04.751157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:04.751157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:04.751157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:04.751157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:04.751157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:04.751157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:04.751157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:04.751157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:04.751157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:04.751157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:04.751157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:04.751157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:04.752010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:04.752010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:04.752010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:04.752010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:04.752010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:04.752010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:04.752010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:04.752010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:04.752010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:04.752010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:04.752010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:04.752010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:04.752010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:04.752010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:04.752010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:04.752010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:04.752835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:04.752835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:04.752835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:04.752835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:04.752835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:04.752835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:04.752835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:04.752835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:04.752835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:04.752835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:04.752835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:04:04.752835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:04.752835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 111/228] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:04:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:04.770406 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b010e64-1f63-4ffa-8192-6ea284f60778 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:04.813678 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea7744-9fe1-4c45-b25a-c994cadbd34b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:04.874180 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a0b86-d776-40af-ba67-ecd1875ebc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:04.874879 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a0b86-d776-40af-ba67-ecd1875ebc0e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:04.875227 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a0b86-d776-40af-ba67-ecd1875ebc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:04.876230 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a0b86-d776-40af-ba67-ecd1875ebc0e None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:04.881608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a0b86-d776-40af-ba67-ecd1875ebc0e None admin] RBAC: Authorizing `identity:get_project(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:04.882889 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a0b86-d776-40af-ba67-ecd1875ebc0e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:04.884819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 118/229] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:04 2022] GET /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7 => generated 303 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:04.890571 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a0b86-d776-40af-ba67-ecd1875ebc0e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:04.914348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b010e64-1f63-4ffa-8192-6ea284f60778 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:04.917137 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:04.963467 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448674e5-8cc8-4ce8-a0ac-e1bb95d9907b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:04.964430 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448674e5-8cc8-4ce8-a0ac-e1bb95d9907b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:04.965130 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448674e5-8cc8-4ce8-a0ac-e1bb95d9907b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:04.966618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448674e5-8cc8-4ce8-a0ac-e1bb95d9907b None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:04.967614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448674e5-8cc8-4ce8-a0ac-e1bb95d9907b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:04.968813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448674e5-8cc8-4ce8-a0ac-e1bb95d9907b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:04.970456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448674e5-8cc8-4ce8-a0ac-e1bb95d9907b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:04.989304 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 112/230] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:04 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:04.993704 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448674e5-8cc8-4ce8-a0ac-e1bb95d9907b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:05.058931 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a0b86-d776-40af-ba67-ecd1875ebc0e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:05.096242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:05.143464 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448674e5-8cc8-4ce8-a0ac-e1bb95d9907b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:05.153357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c9a17-658b-4b17-b44a-118698409087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:05.154368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c9a17-658b-4b17-b44a-118698409087 None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:05.154862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c9a17-658b-4b17-b44a-118698409087 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:05.155351 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c9a17-658b-4b17-b44a-118698409087 None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7/users/b2827b7427414679a01a936c3eaac97e/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:05.161435 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c9a17-658b-4b17-b44a-118698409087 None admin] RBAC: Authorizing `identity:create_grant(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7, user_id=b2827b7427414679a01a936c3eaac97e, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:05.163091 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c9a17-658b-4b17-b44a-118698409087 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:05.180993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187b821-4939-4b45-a8d9-5bb66553d35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:05.181642 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187b821-4939-4b45-a8d9-5bb66553d35f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:05.181927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187b821-4939-4b45-a8d9-5bb66553d35f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:05.182262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187b821-4939-4b45-a8d9-5bb66553d35f None admin] PATH_INFO: `/v3/users/b2827b7427414679a01a936c3eaac97e` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:05.186517 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187b821-4939-4b45-a8d9-5bb66553d35f None admin] RBAC: Authorizing `identity:get_user(user_id=b2827b7427414679a01a936c3eaac97e)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:05.186517 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187b821-4939-4b45-a8d9-5bb66553d35f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:05.186674 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 113/231] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:04:04 2022] GET /identity/v3/users/b2827b7427414679a01a936c3eaac97e => generated 284 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:05.192853 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187b821-4939-4b45-a8d9-5bb66553d35f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:05.246112 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 119/232] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:04:04 2022] PUT /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7/users/b2827b7427414679a01a936c3eaac97e/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:04:05.302629 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187b821-4939-4b45-a8d9-5bb66553d35f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:05.328830 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:05.342272 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c06ea-0461-481f-9a96-612d43f88790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:05.342932 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c06ea-0461-481f-9a96-612d43f88790 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:05.343217 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c06ea-0461-481f-9a96-612d43f88790 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:05.343497 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c06ea-0461-481f-9a96-612d43f88790 None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:05.344758 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c06ea-0461-481f-9a96-612d43f88790 None admin] RBAC: Authorizing `identity:get_project(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:05.346216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c06ea-0461-481f-9a96-612d43f88790 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:05.348235 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 114/233] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:05 2022] GET /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7 => generated 303 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:05.354438 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c9a17-658b-4b17-b44a-118698409087 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:05.475573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:05.517078 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c9a17-658b-4b17-b44a-118698409087 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:05.554868 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce6cad-c1a7-40e4-b5be-c7c1defca753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:05.555598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce6cad-c1a7-40e4-b5be-c7c1defca753 None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:05.555878 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce6cad-c1a7-40e4-b5be-c7c1defca753 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:05.556151 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce6cad-c1a7-40e4-b5be-c7c1defca753 None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7/users/b2827b7427414679a01a936c3eaac97e/roles/33fa4ece26464ae98122f3279db92307` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:05.558514 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce6cad-c1a7-40e4-b5be-c7c1defca753 None admin] RBAC: Authorizing `identity:create_grant(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7, user_id=b2827b7427414679a01a936c3eaac97e, role_id=33fa4ece26464ae98122f3279db92307)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:05.560034 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce6cad-c1a7-40e4-b5be-c7c1defca753 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:05.664184 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 120/234] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:04:05 2022] PUT /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7/users/b2827b7427414679a01a936c3eaac97e/roles/33fa4ece26464ae98122f3279db92307 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:04:06.340496 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20be720-6e5b-484e-8b49-d2d5def358b5 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:06.341427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20be720-6e5b-484e-8b49-d2d5def358b5 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:06.341892 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20be720-6e5b-484e-8b49-d2d5def358b5 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:06.343690 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 115/235] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:06.348647 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9eb3a-00e3-41be-a87b-de7a3493afc5 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:06.349424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9eb3a-00e3-41be-a87b-de7a3493afc5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:06.349895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9eb3a-00e3-41be-a87b-de7a3493afc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:06.377578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-26f9eb3a-00e3-41be-a87b-de7a3493afc5 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:06.379654 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-26f9eb3a-00e3-41be-a87b-de7a3493afc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:06.470331 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 121/236] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:06.516268 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20be720-6e5b-484e-8b49-d2d5def358b5 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:06.557993 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85411701-ed9d-424d-badc-4c31a5a264cf None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:06.558628 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85411701-ed9d-424d-badc-4c31a5a264cf None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:06.559141 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85411701-ed9d-424d-badc-4c31a5a264cf None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:06.561082 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 122/237] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:06.566688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24877dc-fd91-410c-a6f0-4a8c0f2c2eb9 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:06.567238 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24877dc-fd91-410c-a6f0-4a8c0f2c2eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:06.567734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24877dc-fd91-410c-a6f0-4a8c0f2c2eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:06.586492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a24877dc-fd91-410c-a6f0-4a8c0f2c2eb9 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:06.587999 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a24877dc-fd91-410c-a6f0-4a8c0f2c2eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:06.644033 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:06.662135 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20be720-6e5b-484e-8b49-d2d5def358b5 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:06.663178 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 123/238] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:04:06.690376 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24877dc-fd91-410c-a6f0-4a8c0f2c2eb9 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:06.714359 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e72c0-d33e-4fca-ae85-23dcb2fb9513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:06.715013 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e72c0-d33e-4fca-ae85-23dcb2fb9513 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:06.715342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e72c0-d33e-4fca-ae85-23dcb2fb9513 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:06.715567 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e72c0-d33e-4fca-ae85-23dcb2fb9513 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:06.726493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e72c0-d33e-4fca-ae85-23dcb2fb9513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:06.731891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-7e7e72c0-d33e-4fca-ae85-23dcb2fb9513 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 16:04:06.731891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:06.731891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:06.731891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:06.731891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:06.731891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:06.731891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:06.731891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:06.731891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:06.731891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:06.731891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:06.731891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:06.731891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:06.731891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:06.731891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:06.731891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:06.732798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:06.732798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:06.732798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:06.732798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:06.732798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:06.732798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:06.732798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:06.732798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:06.732798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:06.732798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:06.732798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:06.732798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:06.732798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:06.732798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:06.732798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:06.732798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:06.733553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:06.733553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:06.733553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:06.733553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:06.733553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:06.733553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:06.733553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:06.733553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:06.733553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:06.733553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:06.733553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 16:04:06.733553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:06.733553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 116/239] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:06.739638 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e72c0-d33e-4fca-ae85-23dcb2fb9513 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:06.794289 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:06.807651 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24877dc-fd91-410c-a6f0-4a8c0f2c2eb9 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:06.844468 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146ed13-f99b-41fe-b4e6-2a34e0be137d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:06.845740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146ed13-f99b-41fe-b4e6-2a34e0be137d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:06.846258 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146ed13-f99b-41fe-b4e6-2a34e0be137d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:06.846728 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146ed13-f99b-41fe-b4e6-2a34e0be137d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:06.846981 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e72c0-d33e-4fca-ae85-23dcb2fb9513 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:06.848860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146ed13-f99b-41fe-b4e6-2a34e0be137d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:06.850521 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146ed13-f99b-41fe-b4e6-2a34e0be137d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:06.856914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 124/240] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:06 2022] GET /identity/v3/domains/default => generated 200 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:06.858387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39125c17-afb6-48bc-9056-7840e20e787a None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:06.858871 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39125c17-afb6-48bc-9056-7840e20e787a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:06.859338 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39125c17-afb6-48bc-9056-7840e20e787a None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:06.861028 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 125/241] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:06.861913 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39125c17-afb6-48bc-9056-7840e20e787a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:06.883554 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9916c-bc9c-4600-8943-174c4e0b960c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:06.884184 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9916c-bc9c-4600-8943-174c4e0b960c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:06.884465 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9916c-bc9c-4600-8943-174c4e0b960c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:06.884928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9916c-bc9c-4600-8943-174c4e0b960c None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:06.885871 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9916c-bc9c-4600-8943-174c4e0b960c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:06.886346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9916c-bc9c-4600-8943-174c4e0b960c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:06.887904 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9916c-bc9c-4600-8943-174c4e0b960c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:06.899485 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 117/242] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:04:06 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:06.901349 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0f17a-f67b-4e94-9a4d-6cf196aedfe9 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:06.901820 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0f17a-f67b-4e94-9a4d-6cf196aedfe9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:06.902291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0f17a-f67b-4e94-9a4d-6cf196aedfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:06.923613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-36c0f17a-f67b-4e94-9a4d-6cf196aedfe9 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:06.925118 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-36c0f17a-f67b-4e94-9a4d-6cf196aedfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:06.927377 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:06.974952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39125c17-afb6-48bc-9056-7840e20e787a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:06.998218 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 118/243] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:06.999447 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0f17a-f67b-4e94-9a4d-6cf196aedfe9 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:07.029924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a30a63-ce9e-4727-a5a7-01e442ca2533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:07.030643 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a30a63-ce9e-4727-a5a7-01e442ca2533 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:07.030992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a30a63-ce9e-4727-a5a7-01e442ca2533 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:07.031599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a30a63-ce9e-4727-a5a7-01e442ca2533 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:07.032364 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a30a63-ce9e-4727-a5a7-01e442ca2533 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:07.034647 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a30a63-ce9e-4727-a5a7-01e442ca2533 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:07.054700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:07.110438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0f17a-f67b-4e94-9a4d-6cf196aedfe9 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:07.122506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 126/244] 10.222.0.141 () {60 vars in 1137 bytes} [Tue Jul 26 16:04:06 2022] POST /identity/v3/users => generated 294 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:04:07.130207 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a30a63-ce9e-4727-a5a7-01e442ca2533 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:07.176598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498498c-3e82-490d-a15b-c8f94104ab5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:07.177664 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498498c-3e82-490d-a15b-c8f94104ab5f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:07.178120 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498498c-3e82-490d-a15b-c8f94104ab5f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:07.178774 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498498c-3e82-490d-a15b-c8f94104ab5f None admin] PATH_INFO: `/v3/users/2dcc690a0ee146c6a19989e81cceb59c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:07.212760 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498498c-3e82-490d-a15b-c8f94104ab5f None admin] RBAC: Authorizing `identity:get_user(user_id=2dcc690a0ee146c6a19989e81cceb59c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:07.214541 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498498c-3e82-490d-a15b-c8f94104ab5f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:07.220395 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 119/245] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:04:06 2022] GET /identity/v3/users/2dcc690a0ee146c6a19989e81cceb59c => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:07.224415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498498c-3e82-490d-a15b-c8f94104ab5f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:07.352600 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a30a63-ce9e-4727-a5a7-01e442ca2533 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:07.367228 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:07.397687 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:07.401228 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48449f4-8291-4628-b6f9-4fb6d6787f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:07.401450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498498c-3e82-490d-a15b-c8f94104ab5f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:07.402276 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48449f4-8291-4628-b6f9-4fb6d6787f62 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:07.402731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48449f4-8291-4628-b6f9-4fb6d6787f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:07.403309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48449f4-8291-4628-b6f9-4fb6d6787f62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:07.419612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48449f4-8291-4628-b6f9-4fb6d6787f62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:07.427322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-a48449f4-8291-4628-b6f9-4fb6d6787f62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:07.427322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:07.427322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:07.427322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:07.427322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:07.427322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:07.427322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:07.427322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:07.427322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:07.427322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:07.427322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:07.427322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:07.427322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:07.427322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:07.427322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:07.427322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:07.428177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:07.428177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:07.428177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:07.428177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:07.428177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:07.428177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:07.428177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:07.428177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:07.428177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:07.428177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:07.428177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:07.428177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:07.428177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:07.428177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:07.428177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:07.428177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:07.429010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:07.429010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:07.429010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:07.429010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:07.429010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:07.429010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:07.429010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:07.429010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:07.429010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:07.429010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:07.429010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:07.429010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:07.430549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 127/246] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:07.436675 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48449f4-8291-4628-b6f9-4fb6d6787f62 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:07.454455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ed289-dc74-421f-be6c-cc7fd8185a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:07.454879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ed289-dc74-421f-be6c-cc7fd8185a4c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:07.455168 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ed289-dc74-421f-be6c-cc7fd8185a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:07.455440 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ed289-dc74-421f-be6c-cc7fd8185a4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:07.555955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ed289-dc74-421f-be6c-cc7fd8185a4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:07.557499 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ed289-dc74-421f-be6c-cc7fd8185a4c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:07.585955 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48449f4-8291-4628-b6f9-4fb6d6787f62 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:07.630411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd309b9-c90a-4e0a-ade4-2e6ccfc0c1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:07.631934 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd309b9-c90a-4e0a-ade4-2e6ccfc0c1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:07.632439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd309b9-c90a-4e0a-ade4-2e6ccfc0c1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:07.633720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd309b9-c90a-4e0a-ade4-2e6ccfc0c1b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:07.635056 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd309b9-c90a-4e0a-ade4-2e6ccfc0c1b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:07.636085 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd309b9-c90a-4e0a-ade4-2e6ccfc0c1b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:07.638061 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd309b9-c90a-4e0a-ade4-2e6ccfc0c1b5 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:07.651605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 128/247] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:04:07 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:07.652737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ed3a0-8f3e-456e-baf9-d5a727d847e7 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:07.653028 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ed3a0-8f3e-456e-baf9-d5a727d847e7 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:07.653367 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ed3a0-8f3e-456e-baf9-d5a727d847e7 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:07.654891 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 129/248] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:07.659570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ed3a0-8f3e-456e-baf9-d5a727d847e7 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:07.679653 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:07.684534 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 120/249] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:07 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:07.686140 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e9283-7c15-4097-a475-b80be1b06d0a None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:07.686635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e9283-7c15-4097-a475-b80be1b06d0a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:07.687104 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e9283-7c15-4097-a475-b80be1b06d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:07.699271 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:07.708554 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-827e9283-7c15-4097-a475-b80be1b06d0a None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:07.710000 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-827e9283-7c15-4097-a475-b80be1b06d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:07.787178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 121/250] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:07.788326 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e9283-7c15-4097-a475-b80be1b06d0a None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:07.789286 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ed3a0-8f3e-456e-baf9-d5a727d847e7 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:07.847909 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb1ba0-4a10-4bb9-b501-0f63a49b6eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:07.848577 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb1ba0-4a10-4bb9-b501-0f63a49b6eae None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:07.848881 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb1ba0-4a10-4bb9-b501-0f63a49b6eae None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:07.849159 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb1ba0-4a10-4bb9-b501-0f63a49b6eae None admin] PATH_INFO: `/v3/users/b50b030d2cc64a718dcc5e5e91462f24` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:07.851372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb1ba0-4a10-4bb9-b501-0f63a49b6eae None admin] RBAC: Authorizing `identity:get_user(user_id=b50b030d2cc64a718dcc5e5e91462f24)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:07.852872 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb1ba0-4a10-4bb9-b501-0f63a49b6eae None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:07.854664 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 130/251] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:04:07 2022] GET /identity/v3/users/b50b030d2cc64a718dcc5e5e91462f24 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:07.855257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb1ba0-4a10-4bb9-b501-0f63a49b6eae None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:07.998849 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e9283-7c15-4097-a475-b80be1b06d0a None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:08.007179 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:08.011559 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb1ba0-4a10-4bb9-b501-0f63a49b6eae None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:08.055746 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8f323-d5e8-4ecc-81b8-4a0162561932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:08.056398 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8f323-d5e8-4ecc-81b8-4a0162561932 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:08.056685 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8f323-d5e8-4ecc-81b8-4a0162561932 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:08.056974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8f323-d5e8-4ecc-81b8-4a0162561932 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:08.059292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:08.073862 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff553cb-ace7-4174-bdcf-86fc769c12fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:08.074728 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff553cb-ace7-4174-bdcf-86fc769c12fa None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:08.075010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff553cb-ace7-4174-bdcf-86fc769c12fa None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:08.075284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff553cb-ace7-4174-bdcf-86fc769c12fa None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:08.076751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff553cb-ace7-4174-bdcf-86fc769c12fa None admin] RBAC: Authorizing `identity:get_project(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:08.077551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8f323-d5e8-4ecc-81b8-4a0162561932 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:08.078228 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff553cb-ace7-4174-bdcf-86fc769c12fa None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:08.080197 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 122/252] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:07 2022] GET /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7 => generated 303 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:08.086882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-b1e8f323-d5e8-4ecc-81b8-4a0162561932 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:04:08.086882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:08.086882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:08.086882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:08.086882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:08.086882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:08.086882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:08.086882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:08.086882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:08.086882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:08.086882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:08.086882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:08.086882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:08.086882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:08.086882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:08.086882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:08.087778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:08.087778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:08.087778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:08.087778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:08.087778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:08.087778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:08.087778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:08.087778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:08.087778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:08.087778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:08.087778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:08.087778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:08.087778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:08.087778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:08.087778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:08.087778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:08.088548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:08.088548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:08.088548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:08.088548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:08.088548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:08.088548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:08.088548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:08.088548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:08.088548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:08.088548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:08.088548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:04:08.088548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:08.089178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff553cb-ace7-4174-bdcf-86fc769c12fa None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:08.090767 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 131/253] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:04:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:08.091706 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8f323-d5e8-4ecc-81b8-4a0162561932 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:08.230350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff553cb-ace7-4174-bdcf-86fc769c12fa None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:08.271470 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f3008-bb0f-4624-bd18-55430ecb1fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:08.272271 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f3008-bb0f-4624-bd18-55430ecb1fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:08.272871 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f3008-bb0f-4624-bd18-55430ecb1fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:08.273147 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f3008-bb0f-4624-bd18-55430ecb1fe1 None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:08.274320 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f3008-bb0f-4624-bd18-55430ecb1fe1 None admin] RBAC: Authorizing `identity:get_project(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:08.276211 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f3008-bb0f-4624-bd18-55430ecb1fe1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:08.278398 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 123/254] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:08 2022] GET /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7 => generated 303 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:08.279164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f3008-bb0f-4624-bd18-55430ecb1fe1 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:08.293265 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8f323-d5e8-4ecc-81b8-4a0162561932 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:08.331010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246814d8-2682-4c84-b512-9fd20eddb1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:08.331636 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246814d8-2682-4c84-b512-9fd20eddb1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:08.331988 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246814d8-2682-4c84-b512-9fd20eddb1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:08.332266 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246814d8-2682-4c84-b512-9fd20eddb1b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:08.333188 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246814d8-2682-4c84-b512-9fd20eddb1b6 None admin] RBAC: Adding query filter params (role.id=caee5723a1744eba93eee74ec02c8b8f, scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7, user.id=2dcc690a0ee146c6a19989e81cceb59c) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:08.333503 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246814d8-2682-4c84-b512-9fd20eddb1b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:08.335067 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246814d8-2682-4c84-b512-9fd20eddb1b6 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:08.341398 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 132/255] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:04:08 2022] GET /identity/v3/role_assignments?user.id=2dcc690a0ee146c6a19989e81cceb59c&scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7&role.id=caee5723a1744eba93eee74ec02c8b8f => generated 260 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:08.342910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e738a-e75c-4802-934a-5aac85c6af55 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:08.343202 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e738a-e75c-4802-934a-5aac85c6af55 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:08.343479 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e738a-e75c-4802-934a-5aac85c6af55 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:08.344891 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 133/256] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:08.349015 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e738a-e75c-4802-934a-5aac85c6af55 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:08.361239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:08.395146 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:08.431143 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f3008-bb0f-4624-bd18-55430ecb1fe1 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:08.485583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3d52d-d1a0-4b73-bbd8-4ca639db0c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:08.486363 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3d52d-d1a0-4b73-bbd8-4ca639db0c1d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:08.486649 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3d52d-d1a0-4b73-bbd8-4ca639db0c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:08.488879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3d52d-d1a0-4b73-bbd8-4ca639db0c1d None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:08.489632 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3d52d-d1a0-4b73-bbd8-4ca639db0c1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:08.489937 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3d52d-d1a0-4b73-bbd8-4ca639db0c1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:08.491351 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3d52d-d1a0-4b73-bbd8-4ca639db0c1d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:08.505152 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e738a-e75c-4802-934a-5aac85c6af55 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:08.511422 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 124/257] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:08 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:08.515569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482d74f-3323-4db4-bc5f-bcef0eb53902 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:08.516752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482d74f-3323-4db4-bc5f-bcef0eb53902 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:08.517041 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482d74f-3323-4db4-bc5f-bcef0eb53902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:08.552378 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-0482d74f-3323-4db4-bc5f-bcef0eb53902 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:08.554448 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0482d74f-3323-4db4-bc5f-bcef0eb53902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:08.572120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced4a84-7dfd-4b40-b09f-b5393cb2c6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:08.572881 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced4a84-7dfd-4b40-b09f-b5393cb2c6e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:08.573117 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced4a84-7dfd-4b40-b09f-b5393cb2c6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:08.573395 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced4a84-7dfd-4b40-b09f-b5393cb2c6e3 None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7/users/b50b030d2cc64a718dcc5e5e91462f24/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:08.575476 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced4a84-7dfd-4b40-b09f-b5393cb2c6e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7, user_id=b50b030d2cc64a718dcc5e5e91462f24, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:08.577166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced4a84-7dfd-4b40-b09f-b5393cb2c6e3 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:08.632077 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 125/258] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:08.633334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482d74f-3323-4db4-bc5f-bcef0eb53902 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:08.683738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 134/259] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:04:08 2022] PUT /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7/users/b50b030d2cc64a718dcc5e5e91462f24/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:04:08.684797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced4a84-7dfd-4b40-b09f-b5393cb2c6e3 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:08.701919 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:08.739785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482d74f-3323-4db4-bc5f-bcef0eb53902 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:08.777351 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339958cb-e550-407b-9e7e-868fddf7cb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:08.778485 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339958cb-e550-407b-9e7e-868fddf7cb98 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:08.779007 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339958cb-e550-407b-9e7e-868fddf7cb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:08.779474 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339958cb-e550-407b-9e7e-868fddf7cb98 None admin] PATH_INFO: `/v3/users/b2827b7427414679a01a936c3eaac97e` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:08.780916 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339958cb-e550-407b-9e7e-868fddf7cb98 None admin] RBAC: Authorizing `identity:get_user(user_id=b2827b7427414679a01a936c3eaac97e)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:08.782608 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339958cb-e550-407b-9e7e-868fddf7cb98 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:08.784654 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 126/260] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:04:08 2022] GET /identity/v3/users/b2827b7427414679a01a936c3eaac97e => generated 284 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:08.790878 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339958cb-e550-407b-9e7e-868fddf7cb98 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:08.855669 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:08.884230 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced4a84-7dfd-4b40-b09f-b5393cb2c6e3 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:08.913136 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339958cb-e550-407b-9e7e-868fddf7cb98 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:08.945095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:08.952292 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebce6c-0895-44b8-8c63-377da6afd171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:08.953190 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebce6c-0895-44b8-8c63-377da6afd171 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:08.953643 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebce6c-0895-44b8-8c63-377da6afd171 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:08.954092 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebce6c-0895-44b8-8c63-377da6afd171 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:08.960808 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61829a75-2ee2-42cf-aa4c-011bfede460a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:08.960808 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61829a75-2ee2-42cf-aa4c-011bfede460a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:08.960808 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61829a75-2ee2-42cf-aa4c-011bfede460a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:08.960808 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61829a75-2ee2-42cf-aa4c-011bfede460a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:08.990449 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebce6c-0895-44b8-8c63-377da6afd171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:08.995423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-d4ebce6c-0895-44b8-8c63-377da6afd171 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:04:08.995423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:08.995423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:08.995423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:08.995423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:08.995423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:08.995423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:08.995423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:08.995423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:08.995423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:08.995423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:08.995423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:08.995423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:08.995423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:08.995423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:08.995423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:08.996282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:08.996282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:08.996282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:08.996282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:08.996282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:08.996282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:08.996282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:08.996282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:08.996282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:08.996282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:08.996282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:08.996282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:08.996282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:08.996282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:08.996282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:08.996282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:08.997119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:08.997119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:08.997119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:08.997119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:08.997119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:08.997119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:08.997119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:08.997119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:08.997119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:08.997119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:08.997119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:04:08.997119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:09.002249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 135/261] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:04:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:09.003164 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebce6c-0895-44b8-8c63-377da6afd171 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:09.039228 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61829a75-2ee2-42cf-aa4c-011bfede460a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:09.042015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61829a75-2ee2-42cf-aa4c-011bfede460a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:09.151527 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 127/262] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:08 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:09.157175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61829a75-2ee2-42cf-aa4c-011bfede460a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:09.189024 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:09.265217 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61829a75-2ee2-42cf-aa4c-011bfede460a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:09.303838 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b7937-ddaf-4d25-a490-0dac555f7ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:09.305116 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b7937-ddaf-4d25-a490-0dac555f7ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:09.305545 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b7937-ddaf-4d25-a490-0dac555f7ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:09.305963 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b7937-ddaf-4d25-a490-0dac555f7ea3 None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:09.307339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b7937-ddaf-4d25-a490-0dac555f7ea3 None admin] RBAC: Authorizing `identity:get_project(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:09.308977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b7937-ddaf-4d25-a490-0dac555f7ea3 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:09.311495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 128/263] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:09 2022] GET /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7 => generated 303 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:09.319020 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b7937-ddaf-4d25-a490-0dac555f7ea3 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:09.378634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebce6c-0895-44b8-8c63-377da6afd171 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:09.428583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b7937-ddaf-4d25-a490-0dac555f7ea3 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:09.432859 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:09.467720 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3035f28-132e-4d23-a63b-2868f6c26be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:09.468571 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3035f28-132e-4d23-a63b-2868f6c26be1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:09.469137 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3035f28-132e-4d23-a63b-2868f6c26be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:09.469553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3035f28-132e-4d23-a63b-2868f6c26be1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:09.475443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3035f28-132e-4d23-a63b-2868f6c26be1 None admin] RBAC: Adding query filter params (role.id=94ecbd6c86a84b75bdb0c57fc27a9a07, scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7, user.id=b2827b7427414679a01a936c3eaac97e) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:09.475443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3035f28-132e-4d23-a63b-2868f6c26be1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:09.475443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3035f28-132e-4d23-a63b-2868f6c26be1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:09.479382 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 129/264] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:04:09 2022] GET /identity/v3/role_assignments?user.id=b2827b7427414679a01a936c3eaac97e&scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7&role.id=94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 610 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:09.500301 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82769db-c363-42b5-8421-2a707c191bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:09.500979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82769db-c363-42b5-8421-2a707c191bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:09.501265 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82769db-c363-42b5-8421-2a707c191bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:09.501546 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82769db-c363-42b5-8421-2a707c191bd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:09.502277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82769db-c363-42b5-8421-2a707c191bd3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:09.502584 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82769db-c363-42b5-8421-2a707c191bd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:09.504516 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82769db-c363-42b5-8421-2a707c191bd3 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:09.520519 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 136/265] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:09 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 517 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:09.526028 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3035f28-132e-4d23-a63b-2868f6c26be1 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:09.681638 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3035f28-132e-4d23-a63b-2868f6c26be1 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:09.725196 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0dd78-524e-4725-8253-c754491ca3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:09.725862 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0dd78-524e-4725-8253-c754491ca3bd None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:09.726149 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0dd78-524e-4725-8253-c754491ca3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:09.726427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0dd78-524e-4725-8253-c754491ca3bd None admin] PATH_INFO: `/v3/users/b2827b7427414679a01a936c3eaac97e` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:09.727658 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0dd78-524e-4725-8253-c754491ca3bd None admin] RBAC: Authorizing `identity:get_user(user_id=b2827b7427414679a01a936c3eaac97e)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:09.729155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0dd78-524e-4725-8253-c754491ca3bd None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:09.730993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 130/266] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:04:09 2022] GET /identity/v3/users/b2827b7427414679a01a936c3eaac97e => generated 284 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:09.736454 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82769db-c363-42b5-8421-2a707c191bd3 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:09.746400 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:09.864932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82769db-c363-42b5-8421-2a707c191bd3 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:09.901083 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d0b09-f38a-48dd-85b1-c2865c342470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:09.901711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d0b09-f38a-48dd-85b1-c2865c342470 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:09.901993 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d0b09-f38a-48dd-85b1-c2865c342470 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:09.902267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d0b09-f38a-48dd-85b1-c2865c342470 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:09.971588 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d0b09-f38a-48dd-85b1-c2865c342470 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:09.973140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d0b09-f38a-48dd-85b1-c2865c342470 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:09.981330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:10.109157 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 137/267] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:10.115536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0dd78-524e-4725-8253-c754491ca3bd None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:10.205627 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:10.298232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a2996-9538-4d5a-964d-b6ab4a725697 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:10.298695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a2996-9538-4d5a-964d-b6ab4a725697 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:10.299098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a2996-9538-4d5a-964d-b6ab4a725697 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:10.301292 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 138/268] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:04:10.306825 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a68988-ea08-4c5b-adfb-8f24d6008b57 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:10.307371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a68988-ea08-4c5b-adfb-8f24d6008b57 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:10.307722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a68988-ea08-4c5b-adfb-8f24d6008b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:10.316742 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0dd78-524e-4725-8253-c754491ca3bd None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:10.333727 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d2a68988-ea08-4c5b-adfb-8f24d6008b57 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:10.335084 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d2a68988-ea08-4c5b-adfb-8f24d6008b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:10.386476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49d750-4736-439e-8164-40ca909e8d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:10.387175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49d750-4736-439e-8164-40ca909e8d25 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:10.387463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49d750-4736-439e-8164-40ca909e8d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:10.387734 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49d750-4736-439e-8164-40ca909e8d25 None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:10.389029 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49d750-4736-439e-8164-40ca909e8d25 None admin] RBAC: Authorizing `identity:get_project(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:10.390488 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49d750-4736-439e-8164-40ca909e8d25 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:10.396272 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 131/269] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:10 2022] GET /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7 => generated 303 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:10.403283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49d750-4736-439e-8164-40ca909e8d25 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:10.512371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 139/270] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:10.529893 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49d750-4736-439e-8164-40ca909e8d25 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:10.532966 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:10.543106 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748fafa-0f62-4592-8959-ea8dd6112880 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:10.545397 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748fafa-0f62-4592-8959-ea8dd6112880 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:10.545397 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748fafa-0f62-4592-8959-ea8dd6112880 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:10.545851 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 140/271] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:04:10.551797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a0397-1539-4a54-8002-3adfc08c2a2f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:10.552312 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a0397-1539-4a54-8002-3adfc08c2a2f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:10.552826 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a0397-1539-4a54-8002-3adfc08c2a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:10.574949 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-ce3a0397-1539-4a54-8002-3adfc08c2a2f None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:10.576476 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ce3a0397-1539-4a54-8002-3adfc08c2a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:10.583729 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb0e62-4b4b-4fdf-8d47-331d287b33cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:10.584359 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb0e62-4b4b-4fdf-8d47-331d287b33cd None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:10.584642 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb0e62-4b4b-4fdf-8d47-331d287b33cd None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:10.584950 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb0e62-4b4b-4fdf-8d47-331d287b33cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:10.585747 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb0e62-4b4b-4fdf-8d47-331d287b33cd None admin] RBAC: Adding query filter params (role.id=33fa4ece26464ae98122f3279db92307, scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7, user.id=b2827b7427414679a01a936c3eaac97e) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:10.586057 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb0e62-4b4b-4fdf-8d47-331d287b33cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:10.587946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb0e62-4b4b-4fdf-8d47-331d287b33cd None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:10.595878 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 132/272] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:04:10 2022] GET /identity/v3/role_assignments?user.id=b2827b7427414679a01a936c3eaac97e&scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7&role.id=33fa4ece26464ae98122f3279db92307 => generated 610 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:10.603736 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb0e62-4b4b-4fdf-8d47-331d287b33cd None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:10.633056 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:10.744604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 141/273] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:04:10.758500 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb0e62-4b4b-4fdf-8d47-331d287b33cd None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:10.778296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f5c85-2a46-4361-afe2-3ae253ab91b3 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:10.778943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f5c85-2a46-4361-afe2-3ae253ab91b3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:10.779431 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f5c85-2a46-4361-afe2-3ae253ab91b3 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:10.781378 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 142/274] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:10.786088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f5c85-2a46-4361-afe2-3ae253ab91b3 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:10.802271 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a16952-d4c5-4fee-853d-12f2de874f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:10.803391 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a16952-d4c5-4fee-853d-12f2de874f2b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:10.803910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a16952-d4c5-4fee-853d-12f2de874f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:10.804432 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a16952-d4c5-4fee-853d-12f2de874f2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:10.805914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a16952-d4c5-4fee-853d-12f2de874f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:10.807584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a16952-d4c5-4fee-853d-12f2de874f2b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:10.809751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 133/275] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:10 2022] GET /identity/v3/domains/default => generated 200 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:10.811230 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1934517-efa0-4606-9cc4-0cb21ce329a6 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:10.811717 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1934517-efa0-4606-9cc4-0cb21ce329a6 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:10.812199 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1934517-efa0-4606-9cc4-0cb21ce329a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:10.831558 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b1934517-efa0-4606-9cc4-0cb21ce329a6 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:10.833804 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b1934517-efa0-4606-9cc4-0cb21ce329a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:10.860997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:10.921917 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f5c85-2a46-4361-afe2-3ae253ab91b3 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:10.932774 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 134/276] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:10.932774 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1934517-efa0-4606-9cc4-0cb21ce329a6 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:10.973360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea56f9b-f0f8-4761-b3aa-74cbb8a916e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:10.974267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea56f9b-f0f8-4761-b3aa-74cbb8a916e4 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:10.974544 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea56f9b-f0f8-4761-b3aa-74cbb8a916e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:10.974813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea56f9b-f0f8-4761-b3aa-74cbb8a916e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:10.985756 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea56f9b-f0f8-4761-b3aa-74cbb8a916e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:10.990754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-7ea56f9b-f0f8-4761-b3aa-74cbb8a916e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:10.990754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:10.990754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:10.990754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:10.990754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:10.990754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:10.990754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:10.990754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:10.990754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:10.990754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:10.990754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:10.990754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:10.990754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:10.990754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:10.990754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:10.990754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:10.991791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:10.991791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:10.991791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:10.991791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:10.991791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:10.991791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:10.991791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:10.991791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:10.991791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:10.991791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:10.991791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:10.991791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:10.991791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:10.991791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:10.991791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:10.991791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:10.992604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:10.992604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:10.992604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:10.992604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:10.992604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:10.992604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:10.992604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:10.992604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:10.992604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:10.992604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:10.992604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:10.992604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:10.992604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 143/277] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:10.993282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea56f9b-f0f8-4761-b3aa-74cbb8a916e4 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:11.022827 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:11.048443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1934517-efa0-4606-9cc4-0cb21ce329a6 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:11.084600 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c3756-af14-4673-805e-eb4febaf151d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:11.085284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c3756-af14-4673-805e-eb4febaf151d None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:11.085524 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c3756-af14-4673-805e-eb4febaf151d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:11.085798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c3756-af14-4673-805e-eb4febaf151d None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:11.086537 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c3756-af14-4673-805e-eb4febaf151d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:11.087982 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c3756-af14-4673-805e-eb4febaf151d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:11.101603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea56f9b-f0f8-4761-b3aa-74cbb8a916e4 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:11.136427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf69b6a-88fc-4b2f-a534-de847f7085f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:11.137092 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf69b6a-88fc-4b2f-a534-de847f7085f7 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:11.137372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf69b6a-88fc-4b2f-a534-de847f7085f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:11.137664 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf69b6a-88fc-4b2f-a534-de847f7085f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:11.148226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf69b6a-88fc-4b2f-a534-de847f7085f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:11.153189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-0cf69b6a-88fc-4b2f-a534-de847f7085f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 16:04:11.153189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:11.153189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:11.153189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:11.153189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:11.153189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:11.153189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:11.153189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:11.153189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:11.153189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:11.153189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:11.153189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:11.153189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:11.153189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:11.153189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:11.153189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:11.154244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:11.154244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:11.154244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:11.154244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:11.154244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:11.154244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:11.154244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:11.154244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:11.154244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:11.154244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:11.154244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:11.154244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:11.154244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:11.154244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:11.154244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:11.154244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:11.155053 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:11.155053 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:11.155053 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:11.155053 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:11.155053 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:11.155053 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:11.155053 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:11.155053 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:11.155053 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:11.155053 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:11.155053 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 16:04:11.155053 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:11.155053 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 144/278] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:11.155695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf69b6a-88fc-4b2f-a534-de847f7085f7 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:11.203834 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 135/279] 10.222.0.141 () {60 vars in 1137 bytes} [Tue Jul 26 16:04:10 2022] POST /identity/v3/users => generated 294 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:04:11.205116 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c3756-af14-4673-805e-eb4febaf151d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:11.225758 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:11.265493 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:11.287776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf69b6a-88fc-4b2f-a534-de847f7085f7 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:11.336945 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323153c7-1e79-42dd-9a90-01549791fb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:11.338131 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323153c7-1e79-42dd-9a90-01549791fb94 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:11.338619 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323153c7-1e79-42dd-9a90-01549791fb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:11.339469 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323153c7-1e79-42dd-9a90-01549791fb94 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:11.340773 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323153c7-1e79-42dd-9a90-01549791fb94 None admin] RBAC: Adding query filter params (name=member) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:11.341443 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323153c7-1e79-42dd-9a90-01549791fb94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:11.343748 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323153c7-1e79-42dd-9a90-01549791fb94 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:11.348910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c3756-af14-4673-805e-eb4febaf151d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:11.360491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 145/280] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:04:11 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:11.361750 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323153c7-1e79-42dd-9a90-01549791fb94 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:11.395770 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7bfe9-1b32-4c41-9fd1-893755998234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:11.396403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7bfe9-1b32-4c41-9fd1-893755998234 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:11.397598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7bfe9-1b32-4c41-9fd1-893755998234 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:11.397598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7bfe9-1b32-4c41-9fd1-893755998234 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:11.397805 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7bfe9-1b32-4c41-9fd1-893755998234 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:11.397986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7bfe9-1b32-4c41-9fd1-893755998234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:11.399835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7bfe9-1b32-4c41-9fd1-893755998234 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:11.408897 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 136/281] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:04:11 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:11.414818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7bfe9-1b32-4c41-9fd1-893755998234 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:11.494497 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323153c7-1e79-42dd-9a90-01549791fb94 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:11.510070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:11.537185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7bfe9-1b32-4c41-9fd1-893755998234 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:11.538544 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01726f63-028a-4557-92d3-136933cb2687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:11.539315 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01726f63-028a-4557-92d3-136933cb2687 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:11.540419 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01726f63-028a-4557-92d3-136933cb2687 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:11.540736 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01726f63-028a-4557-92d3-136933cb2687 None admin] PATH_INFO: `/v3/users/c1cd636843504c6b8de6e54b88f30cc0` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:11.561093 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01726f63-028a-4557-92d3-136933cb2687 None admin] RBAC: Authorizing `identity:get_user(user_id=c1cd636843504c6b8de6e54b88f30cc0)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:11.563195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01726f63-028a-4557-92d3-136933cb2687 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:11.565035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 146/282] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:04:11 2022] GET /identity/v3/users/c1cd636843504c6b8de6e54b88f30cc0 => generated 294 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:11.565666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f300603-1215-449f-ae55-6d9412e0d019 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:11.565952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f300603-1215-449f-ae55-6d9412e0d019 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:11.566802 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f300603-1215-449f-ae55-6d9412e0d019 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:11.568163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 147/283] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:11.572482 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f300603-1215-449f-ae55-6d9412e0d019 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:11.583734 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa68d6e-9ea6-49f3-8b48-0a00a253201a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:11.584387 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa68d6e-9ea6-49f3-8b48-0a00a253201a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:11.584690 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa68d6e-9ea6-49f3-8b48-0a00a253201a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:11.584977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa68d6e-9ea6-49f3-8b48-0a00a253201a None admin] PATH_INFO: `/v3/users/2dcc690a0ee146c6a19989e81cceb59c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:11.585156 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:11.586235 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa68d6e-9ea6-49f3-8b48-0a00a253201a None admin] RBAC: Authorizing `identity:get_user(user_id=2dcc690a0ee146c6a19989e81cceb59c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:11.595329 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa68d6e-9ea6-49f3-8b48-0a00a253201a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:11.595329 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 137/284] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:04:11 2022] GET /identity/v3/users/2dcc690a0ee146c6a19989e81cceb59c => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:11.595329 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e8346-ad94-42a6-92a3-71d22c9d6c3d None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:11.595329 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e8346-ad94-42a6-92a3-71d22c9d6c3d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:11.595329 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e8346-ad94-42a6-92a3-71d22c9d6c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:11.616405 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c97e8346-ad94-42a6-92a3-71d22c9d6c3d None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:11.618473 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c97e8346-ad94-42a6-92a3-71d22c9d6c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:11.696312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 138/285] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:11.697858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f300603-1215-449f-ae55-6d9412e0d019 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:11.701749 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e8346-ad94-42a6-92a3-71d22c9d6c3d None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:11.737552 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfe4f1-5239-4ed5-b4b0-0a358f91a09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:11.738730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfe4f1-5239-4ed5-b4b0-0a358f91a09e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:11.739162 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfe4f1-5239-4ed5-b4b0-0a358f91a09e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:11.739437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfe4f1-5239-4ed5-b4b0-0a358f91a09e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:11.740454 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfe4f1-5239-4ed5-b4b0-0a358f91a09e None admin] RBAC: Adding query filter params (role.id=61321ad01e84416981d4c7208c55bbe7, user.id=c1cd636843504c6b8de6e54b88f30cc0, scope.system=all) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:11.740690 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfe4f1-5239-4ed5-b4b0-0a358f91a09e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:11.742410 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfe4f1-5239-4ed5-b4b0-0a358f91a09e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:11.749564 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 148/286] 10.222.0.141 () {56 vars in 1313 bytes} [Tue Jul 26 16:04:11 2022] GET /identity/v3/role_assignments?user.id=c1cd636843504c6b8de6e54b88f30cc0&scope.system=all&role.id=61321ad01e84416981d4c7208c55bbe7 => generated 227 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:11.750639 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfe4f1-5239-4ed5-b4b0-0a358f91a09e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:11.807029 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:11.858082 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:11.869752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e8346-ad94-42a6-92a3-71d22c9d6c3d None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:11.939451 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfe4f1-5239-4ed5-b4b0-0a358f91a09e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:11.951888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26be11c-bff7-4be6-b9ea-5832aa493d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:11.952094 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26be11c-bff7-4be6-b9ea-5832aa493d67 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:11.952345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26be11c-bff7-4be6-b9ea-5832aa493d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:11.952704 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26be11c-bff7-4be6-b9ea-5832aa493d67 None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:11.954408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26be11c-bff7-4be6-b9ea-5832aa493d67 None admin] RBAC: Authorizing `identity:get_project(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:11.955878 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26be11c-bff7-4be6-b9ea-5832aa493d67 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:11.957639 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 139/287] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:11 2022] GET /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7 => generated 303 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:11.966664 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26be11c-bff7-4be6-b9ea-5832aa493d67 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:12.002553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e75a9e-871c-4356-9ede-b1b3fade66c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:12.003463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e75a9e-871c-4356-9ede-b1b3fade66c0 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:12.003920 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e75a9e-871c-4356-9ede-b1b3fade66c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:12.004359 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e75a9e-871c-4356-9ede-b1b3fade66c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:12.022869 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e75a9e-871c-4356-9ede-b1b3fade66c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:12.031663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-a6e75a9e-871c-4356-9ede-b1b3fade66c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:12.031663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:12.031663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:12.031663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:12.031663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:12.031663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:12.031663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:12.031663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:12.031663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:12.031663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:12.031663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:12.031663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:12.031663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:12.031663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:12.031663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:12.031663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:12.032730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:12.032730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:12.032730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:12.032730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:12.032730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:12.032730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:12.032730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:12.032730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:12.032730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:12.032730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:12.032730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:12.032730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:12.032730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:12.032730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:12.032730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:12.032730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:12.033760 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:12.033760 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:12.033760 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:12.033760 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:12.033760 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:12.033760 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:12.033760 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:12.033760 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:12.033760 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:12.033760 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:12.033760 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:12.033760 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:12.040170 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 149/288] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:12.046106 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e75a9e-871c-4356-9ede-b1b3fade66c0 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:12.133333 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26be11c-bff7-4be6-b9ea-5832aa493d67 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:12.189350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1c7af-aa61-44e4-ae02-a54b76e209cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:12.192060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1c7af-aa61-44e4-ae02-a54b76e209cb None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:12.194968 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1c7af-aa61-44e4-ae02-a54b76e209cb None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:12.195438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1c7af-aa61-44e4-ae02-a54b76e209cb None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7/users/2dcc690a0ee146c6a19989e81cceb59c/roles/caee5723a1744eba93eee74ec02c8b8f` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:12.197752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1c7af-aa61-44e4-ae02-a54b76e209cb None admin] RBAC: Authorizing `identity:create_grant(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7, user_id=2dcc690a0ee146c6a19989e81cceb59c, role_id=caee5723a1744eba93eee74ec02c8b8f)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:12.201226 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1c7af-aa61-44e4-ae02-a54b76e209cb None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:12.230880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e75a9e-871c-4356-9ede-b1b3fade66c0 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:12.268018 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:12.278170 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:12.280739 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 140/289] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:04:11 2022] PUT /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7/users/2dcc690a0ee146c6a19989e81cceb59c/roles/caee5723a1744eba93eee74ec02c8b8f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:04:12.287773 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a4857-396c-45b2-9f94-e5964b2d07ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:12.288688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a4857-396c-45b2-9f94-e5964b2d07ba None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:12.289111 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a4857-396c-45b2-9f94-e5964b2d07ba None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:12.289573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a4857-396c-45b2-9f94-e5964b2d07ba None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:12.290758 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a4857-396c-45b2-9f94-e5964b2d07ba None admin] RBAC: Adding query filter params (name=member) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:12.291223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a4857-396c-45b2-9f94-e5964b2d07ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:12.293029 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a4857-396c-45b2-9f94-e5964b2d07ba None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:12.304206 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 150/290] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:04:12 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:12.310470 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1c7af-aa61-44e4-ae02-a54b76e209cb None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:12.479967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1c7af-aa61-44e4-ae02-a54b76e209cb None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:12.517129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95245f19-55f6-43cb-860a-a04f0bb58ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:12.518011 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95245f19-55f6-43cb-860a-a04f0bb58ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:12.518434 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95245f19-55f6-43cb-860a-a04f0bb58ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:12.518844 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95245f19-55f6-43cb-860a-a04f0bb58ab3 None admin] PATH_INFO: `/v3/users/b50b030d2cc64a718dcc5e5e91462f24` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:12.520783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95245f19-55f6-43cb-860a-a04f0bb58ab3 None admin] RBAC: Authorizing `identity:get_user(user_id=b50b030d2cc64a718dcc5e5e91462f24)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:12.522378 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95245f19-55f6-43cb-860a-a04f0bb58ab3 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:12.524419 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 141/291] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:04:12 2022] GET /identity/v3/users/b50b030d2cc64a718dcc5e5e91462f24 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:12.530412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a4857-396c-45b2-9f94-e5964b2d07ba None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:12.640497 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a4857-396c-45b2-9f94-e5964b2d07ba None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:12.688455 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1242e59-2a90-4c3f-a8b3-6018f9cfb00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:12.689104 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1242e59-2a90-4c3f-a8b3-6018f9cfb00f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:12.689380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1242e59-2a90-4c3f-a8b3-6018f9cfb00f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:12.689649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1242e59-2a90-4c3f-a8b3-6018f9cfb00f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:12.770737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:12.780147 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1242e59-2a90-4c3f-a8b3-6018f9cfb00f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:12.781620 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1242e59-2a90-4c3f-a8b3-6018f9cfb00f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:12.909880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 151/292] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:12.916222 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95245f19-55f6-43cb-860a-a04f0bb58ab3 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:13.021411 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:13.056499 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95245f19-55f6-43cb-860a-a04f0bb58ab3 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:13.090746 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea238c2-8aaf-4eb8-9269-cc2dfe97d115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:13.091445 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea238c2-8aaf-4eb8-9269-cc2dfe97d115 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:13.091731 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea238c2-8aaf-4eb8-9269-cc2dfe97d115 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:13.092086 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea238c2-8aaf-4eb8-9269-cc2dfe97d115 None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:13.093290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea238c2-8aaf-4eb8-9269-cc2dfe97d115 None admin] RBAC: Authorizing `identity:get_project(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:13.094734 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea238c2-8aaf-4eb8-9269-cc2dfe97d115 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:13.096716 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 142/293] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:12 2022] GET /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7 => generated 303 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:13.102657 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1242e59-2a90-4c3f-a8b3-6018f9cfb00f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:13.221063 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:13.230554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1242e59-2a90-4c3f-a8b3-6018f9cfb00f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:13.280353 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae27fb9-e1b9-4a85-8a8b-1d9bcb9e2553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:13.280929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae27fb9-e1b9-4a85-8a8b-1d9bcb9e2553 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:13.281214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae27fb9-e1b9-4a85-8a8b-1d9bcb9e2553 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:13.281494 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae27fb9-e1b9-4a85-8a8b-1d9bcb9e2553 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:13.282288 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae27fb9-e1b9-4a85-8a8b-1d9bcb9e2553 None admin] RBAC: Adding query filter params (role.id=61321ad01e84416981d4c7208c55bbe7, scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7, user.id=b50b030d2cc64a718dcc5e5e91462f24) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:13.282600 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae27fb9-e1b9-4a85-8a8b-1d9bcb9e2553 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:13.284031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae27fb9-e1b9-4a85-8a8b-1d9bcb9e2553 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:13.290297 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 152/294] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:04:13 2022] GET /identity/v3/role_assignments?user.id=b50b030d2cc64a718dcc5e5e91462f24&scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7&role.id=61321ad01e84416981d4c7208c55bbe7 => generated 610 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:13.659223 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8012a2-3847-42fd-97e6-2df96f04fac7 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:13.659610 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8012a2-3847-42fd-97e6-2df96f04fac7 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:13.659826 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8012a2-3847-42fd-97e6-2df96f04fac7 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:13.661557 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 143/295] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:13.666948 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddc206-dee5-43d2-98ad-a1bcad366ee2 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:13.667400 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddc206-dee5-43d2-98ad-a1bcad366ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:13.667508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddc206-dee5-43d2-98ad-a1bcad366ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:13.688394 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-11ddc206-dee5-43d2-98ad-a1bcad366ee2 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:13.689625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-11ddc206-dee5-43d2-98ad-a1bcad366ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:13.777707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 153/296] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:13.801228 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8012a2-3847-42fd-97e6-2df96f04fac7 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:13.908534 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8012a2-3847-42fd-97e6-2df96f04fac7 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:13.931377 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28717b7-133d-4f75-aae4-cc1d5ec59a60 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:13.931641 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28717b7-133d-4f75-aae4-cc1d5ec59a60 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:13.931860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28717b7-133d-4f75-aae4-cc1d5ec59a60 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:13.933399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 154/297] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:04:13.938337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc6470-bc7e-400a-bf30-e5c35f889a99 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:13.938621 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc6470-bc7e-400a-bf30-e5c35f889a99 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:13.938896 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc6470-bc7e-400a-bf30-e5c35f889a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:13.945443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c3c9a-960f-478a-8ea7-f9cfa16a9ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:13.946092 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c3c9a-960f-478a-8ea7-f9cfa16a9ecb None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:13.946373 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c3c9a-960f-478a-8ea7-f9cfa16a9ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:13.946646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c3c9a-960f-478a-8ea7-f9cfa16a9ecb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:13.949490 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:13.958161 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c3c9a-960f-478a-8ea7-f9cfa16a9ecb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:13.958960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5ebc6470-bc7e-400a-bf30-e5c35f889a99 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:13.966664 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5ebc6470-bc7e-400a-bf30-e5c35f889a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:13.966786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-b73c3c9a-960f-478a-8ea7-f9cfa16a9ecb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 16:04:13.966786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:13.966786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:13.966786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:13.966786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:13.966786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:13.966786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:13.966786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:13.966786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:13.966786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:13.966786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:13.966786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:13.966786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:13.966786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:13.966786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:13.966786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:13.967922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:13.967922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:13.967922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:13.967922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:13.967922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:13.967922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:13.967922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:13.967922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:13.967922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:13.967922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:13.967922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:13.967922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:13.967922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:13.967922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:13.967922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:13.967922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:13.968786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:13.968786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:13.968786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:13.968786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:13.968786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:13.968786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:13.968786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:13.968786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:13.968786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:13.968786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:13.968786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 16:04:13.968786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:13.968786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 144/298] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:13.971712 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c3c9a-960f-478a-8ea7-f9cfa16a9ecb None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:14.031087 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 155/299] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:14.053922 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc6470-bc7e-400a-bf30-e5c35f889a99 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:14.070992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:14.083356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c3c9a-960f-478a-8ea7-f9cfa16a9ecb None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:14.119351 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ccb9a-4e9a-48d3-9b68-2e6dfe791c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:14.119987 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ccb9a-4e9a-48d3-9b68-2e6dfe791c8f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:14.120254 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ccb9a-4e9a-48d3-9b68-2e6dfe791c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:14.120526 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ccb9a-4e9a-48d3-9b68-2e6dfe791c8f None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:14.121399 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ccb9a-4e9a-48d3-9b68-2e6dfe791c8f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:14.121709 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ccb9a-4e9a-48d3-9b68-2e6dfe791c8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:14.123079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ccb9a-4e9a-48d3-9b68-2e6dfe791c8f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:14.131710 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 145/300] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:04:13 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:14.137128 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ccb9a-4e9a-48d3-9b68-2e6dfe791c8f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:14.178333 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc6470-bc7e-400a-bf30-e5c35f889a99 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:14.197255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:14.214243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd7cdb-d22a-4a2d-aec8-75ea01cb95e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:14.215133 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd7cdb-d22a-4a2d-aec8-75ea01cb95e3 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:14.215408 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd7cdb-d22a-4a2d-aec8-75ea01cb95e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:14.215678 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd7cdb-d22a-4a2d-aec8-75ea01cb95e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:14.216832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd7cdb-d22a-4a2d-aec8-75ea01cb95e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:14.218278 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd7cdb-d22a-4a2d-aec8-75ea01cb95e3 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:14.225048 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 156/301] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:14 2022] GET /identity/v3/domains/default => generated 200 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:14.225048 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364da26b-364a-431d-9443-a04e5348bdd2 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:14.225048 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364da26b-364a-431d-9443-a04e5348bdd2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:14.225048 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364da26b-364a-431d-9443-a04e5348bdd2 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:14.225048 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 157/302] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:14.228154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364da26b-364a-431d-9443-a04e5348bdd2 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:14.246272 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ccb9a-4e9a-48d3-9b68-2e6dfe791c8f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:14.281360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef26e9-7b94-49ab-87eb-6255f90e1cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:14.282086 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef26e9-7b94-49ab-87eb-6255f90e1cab None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:14.282348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef26e9-7b94-49ab-87eb-6255f90e1cab None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:14.282552 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef26e9-7b94-49ab-87eb-6255f90e1cab None admin] PATH_INFO: `/v3/users/ec9bd2e359014fb28958f2e79be7ffdd` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:14.295813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef26e9-7b94-49ab-87eb-6255f90e1cab None admin] RBAC: Authorizing `identity:get_user(user_id=ec9bd2e359014fb28958f2e79be7ffdd)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:14.297643 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef26e9-7b94-49ab-87eb-6255f90e1cab None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:14.299780 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 146/303] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:04:14 2022] GET /identity/v3/users/ec9bd2e359014fb28958f2e79be7ffdd => generated 294 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:14.300920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add11e6-182b-4aa7-8388-86c582039134 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:14.301208 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add11e6-182b-4aa7-8388-86c582039134 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:14.301485 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add11e6-182b-4aa7-8388-86c582039134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:14.319989 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-2add11e6-182b-4aa7-8388-86c582039134 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:14.321205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2add11e6-182b-4aa7-8388-86c582039134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:14.329217 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:14.346634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364da26b-364a-431d-9443-a04e5348bdd2 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:14.384248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ac8e6-5978-49cd-8553-ffbe36dd8d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:14.384903 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ac8e6-5978-49cd-8553-ffbe36dd8d0e None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:14.385185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ac8e6-5978-49cd-8553-ffbe36dd8d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:14.385460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ac8e6-5978-49cd-8553-ffbe36dd8d0e None admin] PATH_INFO: `/v3/groups` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:14.386123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ac8e6-5978-49cd-8553-ffbe36dd8d0e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:14.387564 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ac8e6-5978-49cd-8553-ffbe36dd8d0e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:14.393547 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 147/304] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:14.394392 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add11e6-182b-4aa7-8388-86c582039134 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:14.441491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:14.470783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 158/305] 10.222.0.141 () {60 vars in 1139 bytes} [Tue Jul 26 16:04:14 2022] POST /identity/v3/groups => generated 230 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:04:14.471837 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ac8e6-5978-49cd-8553-ffbe36dd8d0e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:14.523002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add11e6-182b-4aa7-8388-86c582039134 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:14.569854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738a0b8-5f8c-48a8-9694-fef58a4d1ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:14.570546 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738a0b8-5f8c-48a8-9694-fef58a4d1ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:14.570831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738a0b8-5f8c-48a8-9694-fef58a4d1ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:14.571701 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738a0b8-5f8c-48a8-9694-fef58a4d1ad9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:14.572526 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738a0b8-5f8c-48a8-9694-fef58a4d1ad9 None admin] RBAC: Adding query filter params (role.id=caee5723a1744eba93eee74ec02c8b8f, user.id=ec9bd2e359014fb28958f2e79be7ffdd, scope.system=all) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:14.572870 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738a0b8-5f8c-48a8-9694-fef58a4d1ad9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:14.574866 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738a0b8-5f8c-48a8-9694-fef58a4d1ad9 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:14.582776 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 148/306] 10.222.0.141 () {56 vars in 1313 bytes} [Tue Jul 26 16:04:14 2022] GET /identity/v3/role_assignments?user.id=ec9bd2e359014fb28958f2e79be7ffdd&scope.system=all&role.id=caee5723a1744eba93eee74ec02c8b8f => generated 227 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:14.603509 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ac8e6-5978-49cd-8553-ffbe36dd8d0e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:14.645850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357ba21-89cb-4f4d-9b56-6f4f142d55aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:14.646528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357ba21-89cb-4f4d-9b56-6f4f142d55aa None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:14.646827 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357ba21-89cb-4f4d-9b56-6f4f142d55aa None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:14.647074 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357ba21-89cb-4f4d-9b56-6f4f142d55aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:14.660961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357ba21-89cb-4f4d-9b56-6f4f142d55aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:14.666776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-4357ba21-89cb-4f4d-9b56-6f4f142d55aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:14.666776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:14.666776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:14.666776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:14.666776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:14.666776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:14.666776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:14.666776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:14.666776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:14.666776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:14.666776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:14.666776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:14.666776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:14.666776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:14.666776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:14.666776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:14.668122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:14.668122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:14.668122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:14.668122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:14.668122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:14.668122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:14.668122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:14.668122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:14.668122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:14.668122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:14.668122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:14.668122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:14.668122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:14.668122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:14.668122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:14.668122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:14.669214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:14.669214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:14.669214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:14.669214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:14.669214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:14.669214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:14.669214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:14.669214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:14.669214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:14.669214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:14.669214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:14.669214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:14.669214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 159/307] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:14.677372 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738a0b8-5f8c-48a8-9694-fef58a4d1ad9 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:14.767045 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9f52e-66a0-4649-9db2-b3ef44ee9ea3 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:14.767423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9f52e-66a0-4649-9db2-b3ef44ee9ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:14.767835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9f52e-66a0-4649-9db2-b3ef44ee9ea3 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:14.770458 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 160/308] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:14 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:04:14.775831 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5590f6-fbe9-4344-996e-1af55dcc5488 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:14.776123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5590f6-fbe9-4344-996e-1af55dcc5488 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:14.776399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5590f6-fbe9-4344-996e-1af55dcc5488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:14.784029 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:14.791572 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738a0b8-5f8c-48a8-9694-fef58a4d1ad9 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:14.795563 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2b5590f6-fbe9-4344-996e-1af55dcc5488 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:14.796903 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2b5590f6-fbe9-4344-996e-1af55dcc5488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:14.808996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:14.838102 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7312e8-703d-4304-b79b-07acf2d6c3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:14.838946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7312e8-703d-4304-b79b-07acf2d6c3ae None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:14.839227 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7312e8-703d-4304-b79b-07acf2d6c3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:14.840331 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7312e8-703d-4304-b79b-07acf2d6c3ae None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:14.841088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7312e8-703d-4304-b79b-07acf2d6c3ae None admin] RBAC: Adding query filter params (name=member) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:14.841396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7312e8-703d-4304-b79b-07acf2d6c3ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:14.842787 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7312e8-703d-4304-b79b-07acf2d6c3ae None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:14.854063 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 149/309] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:04:14 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:14.859792 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7312e8-703d-4304-b79b-07acf2d6c3ae None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:14.874808 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 161/310] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:04:14.899348 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5590f6-fbe9-4344-996e-1af55dcc5488 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:14.979726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7312e8-703d-4304-b79b-07acf2d6c3ae None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:15.023625 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2d288-faa8-43b1-b865-8939c27ba245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:15.024614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2d288-faa8-43b1-b865-8939c27ba245 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:15.024811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5590f6-fbe9-4344-996e-1af55dcc5488 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:15.025252 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2d288-faa8-43b1-b865-8939c27ba245 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:15.025695 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2d288-faa8-43b1-b865-8939c27ba245 None admin] PATH_INFO: `/v3/users/c1cd636843504c6b8de6e54b88f30cc0` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:15.027258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2d288-faa8-43b1-b865-8939c27ba245 None admin] RBAC: Authorizing `identity:get_user(user_id=c1cd636843504c6b8de6e54b88f30cc0)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:15.028951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2d288-faa8-43b1-b865-8939c27ba245 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:15.031350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 150/311] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:04:14 2022] GET /identity/v3/users/c1cd636843504c6b8de6e54b88f30cc0 => generated 294 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:15.037658 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2d288-faa8-43b1-b865-8939c27ba245 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:15.061817 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb94fe-dd2f-4c9e-b017-858021cf8738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:15.062586 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb94fe-dd2f-4c9e-b017-858021cf8738 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:15.062866 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb94fe-dd2f-4c9e-b017-858021cf8738 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:15.063137 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb94fe-dd2f-4c9e-b017-858021cf8738 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:15.065067 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:15.073815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb94fe-dd2f-4c9e-b017-858021cf8738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:15.079296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-c9eb94fe-dd2f-4c9e-b017-858021cf8738 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 16:04:15.079296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:15.079296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:15.079296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:15.079296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:15.079296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:15.079296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:15.079296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:15.079296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:15.079296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:15.079296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:15.079296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:15.079296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:15.079296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:15.079296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:15.079296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:15.080182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:15.080182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:15.080182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:15.080182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:15.080182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:15.080182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:15.080182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:15.080182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:15.080182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:15.080182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:15.080182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:15.080182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:15.080182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:15.080182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:15.080182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:15.080182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:15.082123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:15.082123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:15.082123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:15.082123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:15.082123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:15.082123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:15.082123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:15.082123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:15.082123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:15.082123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:15.082123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 16:04:15.082123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:15.082123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 162/312] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:15.089406 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:15.094737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb94fe-dd2f-4c9e-b017-858021cf8738 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:15.164906 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2d288-faa8-43b1-b865-8939c27ba245 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:15.200361 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c8258-8380-45cb-a19a-91ef1f0aa866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:15.201077 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c8258-8380-45cb-a19a-91ef1f0aa866 None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:15.201363 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c8258-8380-45cb-a19a-91ef1f0aa866 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:15.201642 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c8258-8380-45cb-a19a-91ef1f0aa866 None admin] PATH_INFO: `/v3/system/users/c1cd636843504c6b8de6e54b88f30cc0/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:15.203335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c8258-8380-45cb-a19a-91ef1f0aa866 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c1cd636843504c6b8de6e54b88f30cc0, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:15.204546 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c8258-8380-45cb-a19a-91ef1f0aa866 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:15.229311 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb94fe-dd2f-4c9e-b017-858021cf8738 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:15.268653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456b586-c4d9-4609-85d1-3d61edb0119a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:15.269931 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456b586-c4d9-4609-85d1-3d61edb0119a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:15.270213 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456b586-c4d9-4609-85d1-3d61edb0119a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:15.270486 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456b586-c4d9-4609-85d1-3d61edb0119a None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:15.271203 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456b586-c4d9-4609-85d1-3d61edb0119a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:15.271506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456b586-c4d9-4609-85d1-3d61edb0119a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:15.272923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456b586-c4d9-4609-85d1-3d61edb0119a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:15.286914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 163/313] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:04:15 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:15.288020 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456b586-c4d9-4609-85d1-3d61edb0119a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:15.329717 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 151/314] 10.222.0.141 () {58 vars in 1339 bytes} [Tue Jul 26 16:04:15 2022] PUT /identity/v3/system/users/c1cd636843504c6b8de6e54b88f30cc0/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:04:15.352688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:15.400309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456b586-c4d9-4609-85d1-3d61edb0119a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:15.437199 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd5ef4-fe47-453e-9a3e-ddfaf20d909d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:15.437853 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd5ef4-fe47-453e-9a3e-ddfaf20d909d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:15.438133 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd5ef4-fe47-453e-9a3e-ddfaf20d909d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:15.438405 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd5ef4-fe47-453e-9a3e-ddfaf20d909d None admin] PATH_INFO: `/v3/users/2dcc690a0ee146c6a19989e81cceb59c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:15.439595 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd5ef4-fe47-453e-9a3e-ddfaf20d909d None admin] RBAC: Authorizing `identity:get_user(user_id=2dcc690a0ee146c6a19989e81cceb59c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:15.441704 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd5ef4-fe47-453e-9a3e-ddfaf20d909d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:15.443378 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 164/315] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:04:15 2022] GET /identity/v3/users/2dcc690a0ee146c6a19989e81cceb59c => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:15.449187 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c8258-8380-45cb-a19a-91ef1f0aa866 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:15.555055 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c8258-8380-45cb-a19a-91ef1f0aa866 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:15.557313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:15.589951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c447eab-0f8d-420a-92dd-7fe4dfd3935c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:15.590569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c447eab-0f8d-420a-92dd-7fe4dfd3935c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:15.590847 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c447eab-0f8d-420a-92dd-7fe4dfd3935c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:15.591115 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c447eab-0f8d-420a-92dd-7fe4dfd3935c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:15.670058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c447eab-0f8d-420a-92dd-7fe4dfd3935c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:15.671540 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c447eab-0f8d-420a-92dd-7fe4dfd3935c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:15.784189 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 152/316] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:15 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:15.790066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd5ef4-fe47-453e-9a3e-ddfaf20d909d None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:15.897159 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd5ef4-fe47-453e-9a3e-ddfaf20d909d None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:15.923366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:15.938713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62998b29-8693-4415-b035-68d888794e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:15.939373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62998b29-8693-4415-b035-68d888794e15 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:15.941794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62998b29-8693-4415-b035-68d888794e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:15.941794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62998b29-8693-4415-b035-68d888794e15 None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:15.941794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62998b29-8693-4415-b035-68d888794e15 None admin] RBAC: Authorizing `identity:get_project(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:15.943268 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62998b29-8693-4415-b035-68d888794e15 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:15.948789 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 165/317] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:15 2022] GET /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7 => generated 303 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:15.951308 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c447eab-0f8d-420a-92dd-7fe4dfd3935c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:15.960443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:16.061605 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c447eab-0f8d-420a-92dd-7fe4dfd3935c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:16.099683 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a863872-f751-4fca-8b66-672535833ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:16.100696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a863872-f751-4fca-8b66-672535833ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:16.101196 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a863872-f751-4fca-8b66-672535833ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:16.101679 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a863872-f751-4fca-8b66-672535833ed0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:16.102746 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a863872-f751-4fca-8b66-672535833ed0 None admin] RBAC: Adding query filter params (role.id=caee5723a1744eba93eee74ec02c8b8f, scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7, user.id=2dcc690a0ee146c6a19989e81cceb59c) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:16.103254 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a863872-f751-4fca-8b66-672535833ed0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:16.104913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a863872-f751-4fca-8b66-672535833ed0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:16.111821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 153/318] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:04:15 2022] GET /identity/v3/role_assignments?user.id=2dcc690a0ee146c6a19989e81cceb59c&scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7&role.id=caee5723a1744eba93eee74ec02c8b8f => generated 610 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:16.611835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a04c8a-833c-4261-a829-e4b9f0f0afa4 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:16.612207 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a04c8a-833c-4261-a829-e4b9f0f0afa4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:16.612384 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a04c8a-833c-4261-a829-e4b9f0f0afa4 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:16.613946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 166/319] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:16.618818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea780641-064b-4f2b-b775-3ec0e29f6e09 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:16.619110 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea780641-064b-4f2b-b775-3ec0e29f6e09 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:16.619385 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea780641-064b-4f2b-b775-3ec0e29f6e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:16.638397 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ea780641-064b-4f2b-b775-3ec0e29f6e09 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:16.639630 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ea780641-064b-4f2b-b775-3ec0e29f6e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:16.669830 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb0019-e679-4a81-9c03-1ce8f74d58ce None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:16.670255 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb0019-e679-4a81-9c03-1ce8f74d58ce None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:16.670615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb0019-e679-4a81-9c03-1ce8f74d58ce None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:16.672012 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 167/320] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:04:16.677190 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146337aa-296a-413a-b82e-3efd5edd5b37 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:16.677545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146337aa-296a-413a-b82e-3efd5edd5b37 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:16.677834 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146337aa-296a-413a-b82e-3efd5edd5b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:16.695483 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-146337aa-296a-413a-b82e-3efd5edd5b37 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:16.696702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-146337aa-296a-413a-b82e-3efd5edd5b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:16.705298 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:16.712451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 154/321] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:16.733968 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea780641-064b-4f2b-b775-3ec0e29f6e09 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:16.773023 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 168/322] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:04:16.795349 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146337aa-296a-413a-b82e-3efd5edd5b37 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:16.840143 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea780641-064b-4f2b-b775-3ec0e29f6e09 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:16.874476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bed79-f4af-4795-b9e7-d8536d7ea67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:16.875116 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bed79-f4af-4795-b9e7-d8536d7ea67a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:16.875400 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bed79-f4af-4795-b9e7-d8536d7ea67a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:16.875672 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bed79-f4af-4795-b9e7-d8536d7ea67a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:16.889044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bed79-f4af-4795-b9e7-d8536d7ea67a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:16.894002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-528bed79-f4af-4795-b9e7-d8536d7ea67a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 16:04:16.894002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:16.894002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:16.894002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:16.894002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:16.894002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:16.894002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:16.894002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:16.894002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:16.894002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:16.894002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:16.894002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:16.894002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:16.894002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:16.894002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:16.894002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:16.894880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:16.894880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:16.894880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:16.894880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:16.894880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:16.894880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:16.894880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:16.894880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:16.894880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:16.894880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:16.894880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:16.894880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:16.894880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:16.894880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:16.894880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:16.894880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:16.895799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:16.895799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:16.895799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:16.895799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:16.895799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:16.895799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:16.895799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:16.895799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:16.895799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:16.895799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:16.895799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 16:04:16.895799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:16.895799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 155/323] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:04:16.900862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146337aa-296a-413a-b82e-3efd5edd5b37 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:16.901558 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bed79-f4af-4795-b9e7-d8536d7ea67a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:16.933864 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:16.947053 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa831963-486e-461e-8c9b-baeaa1fb8b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:16.948176 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa831963-486e-461e-8c9b-baeaa1fb8b5b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:16.948458 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa831963-486e-461e-8c9b-baeaa1fb8b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:16.949155 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa831963-486e-461e-8c9b-baeaa1fb8b5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:16.951364 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa831963-486e-461e-8c9b-baeaa1fb8b5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:16.952812 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa831963-486e-461e-8c9b-baeaa1fb8b5b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:16.959158 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 169/324] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:16 2022] GET /identity/v3/domains/default => generated 200 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:16.960079 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa831963-486e-461e-8c9b-baeaa1fb8b5b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:16.965936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:17.016500 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bed79-f4af-4795-b9e7-d8536d7ea67a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:17.058435 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ea1d5-b0f7-4125-8ef9-9ee9f75db354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:17.059404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ea1d5-b0f7-4125-8ef9-9ee9f75db354 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:17.059830 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ea1d5-b0f7-4125-8ef9-9ee9f75db354 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:17.060356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ea1d5-b0f7-4125-8ef9-9ee9f75db354 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:17.061366 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ea1d5-b0f7-4125-8ef9-9ee9f75db354 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:17.061839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ea1d5-b0f7-4125-8ef9-9ee9f75db354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:17.064012 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ea1d5-b0f7-4125-8ef9-9ee9f75db354 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:17.066493 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa831963-486e-461e-8c9b-baeaa1fb8b5b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:17.072845 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 156/325] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:04:16 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:17.078244 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ea1d5-b0f7-4125-8ef9-9ee9f75db354 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:17.106892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5198a-9740-4eb5-943e-25f8051a8b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:17.108143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5198a-9740-4eb5-943e-25f8051a8b84 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:17.108656 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5198a-9740-4eb5-943e-25f8051a8b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:17.109233 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5198a-9740-4eb5-943e-25f8051a8b84 None admin] PATH_INFO: `/v3/groups` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:17.109902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5198a-9740-4eb5-943e-25f8051a8b84 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:17.111441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5198a-9740-4eb5-943e-25f8051a8b84 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:17.177031 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ea1d5-b0f7-4125-8ef9-9ee9f75db354 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:17.195942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:17.209139 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b103791-45a1-4242-b133-39b65387d75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:17.209788 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b103791-45a1-4242-b133-39b65387d75f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:17.210124 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b103791-45a1-4242-b133-39b65387d75f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:17.210403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b103791-45a1-4242-b133-39b65387d75f None admin] PATH_INFO: `/v3/users/ec9bd2e359014fb28958f2e79be7ffdd` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:17.211564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b103791-45a1-4242-b133-39b65387d75f None admin] RBAC: Authorizing `identity:get_user(user_id=ec9bd2e359014fb28958f2e79be7ffdd)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:17.213043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b103791-45a1-4242-b133-39b65387d75f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:17.214632 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 157/326] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:04:17 2022] GET /identity/v3/users/ec9bd2e359014fb28958f2e79be7ffdd => generated 294 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:17.220133 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b103791-45a1-4242-b133-39b65387d75f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:17.244832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 170/327] 10.222.0.141 () {60 vars in 1139 bytes} [Tue Jul 26 16:04:16 2022] POST /identity/v3/groups => generated 227 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:04:17.334487 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b103791-45a1-4242-b133-39b65387d75f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:17.370514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bd7da-fa60-4545-ae8f-c3e4e4bc7d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:17.371246 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bd7da-fa60-4545-ae8f-c3e4e4bc7d03 None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:17.371536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bd7da-fa60-4545-ae8f-c3e4e4bc7d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:17.371817 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bd7da-fa60-4545-ae8f-c3e4e4bc7d03 None admin] PATH_INFO: `/v3/system/users/ec9bd2e359014fb28958f2e79be7ffdd/roles/caee5723a1744eba93eee74ec02c8b8f` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:17.373345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bd7da-fa60-4545-ae8f-c3e4e4bc7d03 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ec9bd2e359014fb28958f2e79be7ffdd, role_id=caee5723a1744eba93eee74ec02c8b8f)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:17.374761 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bd7da-fa60-4545-ae8f-c3e4e4bc7d03 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:17.434920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 158/328] 10.222.0.141 () {58 vars in 1339 bytes} [Tue Jul 26 16:04:17 2022] PUT /identity/v3/system/users/ec9bd2e359014fb28958f2e79be7ffdd/roles/caee5723a1744eba93eee74ec02c8b8f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:04:17.556509 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25dff8-dc28-4e2a-b86f-e36ae4856d23 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:17.556864 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25dff8-dc28-4e2a-b86f-e36ae4856d23 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:17.557101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25dff8-dc28-4e2a-b86f-e36ae4856d23 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:17.558695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 171/329] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:17.564600 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1dbcf-c729-4a62-8964-9b7a133efdbb None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:17.565263 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1dbcf-c729-4a62-8964-9b7a133efdbb None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:17.565775 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1dbcf-c729-4a62-8964-9b7a133efdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:17.586515 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-31f1dbcf-c729-4a62-8964-9b7a133efdbb None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:17.588087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-31f1dbcf-c729-4a62-8964-9b7a133efdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:17.638783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:17.662137 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 159/330] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:17.688641 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25dff8-dc28-4e2a-b86f-e36ae4856d23 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:17.750719 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:17.807818 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25dff8-dc28-4e2a-b86f-e36ae4856d23 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:17.845044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dddfe6-c30a-4963-bba1-16541e34caf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:17.845765 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dddfe6-c30a-4963-bba1-16541e34caf4 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:17.846049 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dddfe6-c30a-4963-bba1-16541e34caf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:17.846379 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dddfe6-c30a-4963-bba1-16541e34caf4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:17.858322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dddfe6-c30a-4963-bba1-16541e34caf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:17.864542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-18dddfe6-c30a-4963-bba1-16541e34caf4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:17.864542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:17.864542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:17.864542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:17.864542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:17.864542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:17.864542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:17.864542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:17.864542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:17.864542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:17.864542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:17.864542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:17.864542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:17.864542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:17.864542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:17.864542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:17.865467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:17.865467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:17.865467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:17.865467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:17.865467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:17.865467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:17.865467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:17.865467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:17.865467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:17.865467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:17.865467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:17.865467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:17.865467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:17.865467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:17.865467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:17.865467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:17.866246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:17.866246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:17.866246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:17.866246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:17.866246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:17.866246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:17.866246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:17.866246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:17.866246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:17.866246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:17.866246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:17.866246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:17.866246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 172/331] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:17.872004 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1dbcf-c729-4a62-8964-9b7a133efdbb None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:17.997763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1dbcf-c729-4a62-8964-9b7a133efdbb None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:18.037938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b854691-503b-49bc-8a6c-34faf2538e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:18.038568 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b854691-503b-49bc-8a6c-34faf2538e61 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:18.038847 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b854691-503b-49bc-8a6c-34faf2538e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:18.039119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b854691-503b-49bc-8a6c-34faf2538e61 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:18.039833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b854691-503b-49bc-8a6c-34faf2538e61 None admin] RBAC: Adding query filter params (name=member) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:18.040132 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b854691-503b-49bc-8a6c-34faf2538e61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:18.041535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b854691-503b-49bc-8a6c-34faf2538e61 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:18.054912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 160/332] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:04:17 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:18.060875 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dddfe6-c30a-4963-bba1-16541e34caf4 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:18.179612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dddfe6-c30a-4963-bba1-16541e34caf4 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:18.190679 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:18.221659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679c526-d941-4eee-9fc5-6661d8dfde62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:18.223305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679c526-d941-4eee-9fc5-6661d8dfde62 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:18.224690 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679c526-d941-4eee-9fc5-6661d8dfde62 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:18.225200 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679c526-d941-4eee-9fc5-6661d8dfde62 None admin] PATH_INFO: `/v3/users/c1cd636843504c6b8de6e54b88f30cc0` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:18.229382 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679c526-d941-4eee-9fc5-6661d8dfde62 None admin] RBAC: Authorizing `identity:get_user(user_id=c1cd636843504c6b8de6e54b88f30cc0)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:18.231138 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679c526-d941-4eee-9fc5-6661d8dfde62 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:18.233401 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 173/333] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:04:18 2022] GET /identity/v3/users/c1cd636843504c6b8de6e54b88f30cc0 => generated 294 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:18.239590 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b854691-503b-49bc-8a6c-34faf2538e61 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:18.304640 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:18.366697 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b854691-503b-49bc-8a6c-34faf2538e61 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:18.403690 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c640053-0745-45c7-a097-3c7818b0d5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:18.404355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c640053-0745-45c7-a097-3c7818b0d5aa None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:18.404644 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c640053-0745-45c7-a097-3c7818b0d5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:18.404959 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c640053-0745-45c7-a097-3c7818b0d5aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:18.405799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c640053-0745-45c7-a097-3c7818b0d5aa None admin] RBAC: Adding query filter params (role.id=61321ad01e84416981d4c7208c55bbe7, user.id=c1cd636843504c6b8de6e54b88f30cc0, scope.system=all) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:18.406113 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c640053-0745-45c7-a097-3c7818b0d5aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:18.407543 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c640053-0745-45c7-a097-3c7818b0d5aa None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:18.420445 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 161/334] 10.222.0.141 () {56 vars in 1313 bytes} [Tue Jul 26 16:04:18 2022] GET /identity/v3/role_assignments?user.id=c1cd636843504c6b8de6e54b88f30cc0&scope.system=all&role.id=61321ad01e84416981d4c7208c55bbe7 => generated 512 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:19.598903 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c129b-e3a3-491c-8063-3efef872e1aa None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:19.599931 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c129b-e3a3-491c-8063-3efef872e1aa None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:19.600433 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c129b-e3a3-491c-8063-3efef872e1aa None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:19.602278 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 174/335] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:19 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:19.607258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45fd3d-56e2-49aa-9bca-2db4f40a8dbe None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:19.607670 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45fd3d-56e2-49aa-9bca-2db4f40a8dbe None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:19.607855 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45fd3d-56e2-49aa-9bca-2db4f40a8dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:19.636056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-6b45fd3d-56e2-49aa-9bca-2db4f40a8dbe None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:19.637303 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6b45fd3d-56e2-49aa-9bca-2db4f40a8dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:19.733988 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 162/336] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:19.769592 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c129b-e3a3-491c-8063-3efef872e1aa None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:19.896808 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c129b-e3a3-491c-8063-3efef872e1aa None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:19.954200 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3681bc-72a5-4fe9-a1d9-7dc730ebfefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:19.954860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3681bc-72a5-4fe9-a1d9-7dc730ebfefc None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:19.955143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3681bc-72a5-4fe9-a1d9-7dc730ebfefc None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:19.955421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3681bc-72a5-4fe9-a1d9-7dc730ebfefc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:19.969830 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3681bc-72a5-4fe9-a1d9-7dc730ebfefc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:19.975876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-1a3681bc-72a5-4fe9-a1d9-7dc730ebfefc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:19.975876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:19.975876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:19.975876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:19.975876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:19.975876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:19.975876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:19.975876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:19.975876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:19.975876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:19.975876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:19.975876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:19.975876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:19.975876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:19.975876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:19.975876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:19.976762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:19.976762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:19.976762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:19.976762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:19.976762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:19.976762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:19.976762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:19.976762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:19.976762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:19.976762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:19.976762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:19.976762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:19.976762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:19.976762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:19.976762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:19.976762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:19.977540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:19.977540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:19.977540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:19.977540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:19.977540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:19.977540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:19.977540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:19.977540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:19.977540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:19.977540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:19.977540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:19.977540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:19.977540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 175/337] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:19.983138 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45fd3d-56e2-49aa-9bca-2db4f40a8dbe None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:20.026794 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:20.067438 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f9e60-87b1-4cfb-9197-68e1d64b191a None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:20.067741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f9e60-87b1-4cfb-9197-68e1d64b191a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:20.067988 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f9e60-87b1-4cfb-9197-68e1d64b191a None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:20.069374 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 176/338] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:04:20.075271 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8283e9-c255-4e31-9f13-24c96f6a708b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:20.075567 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8283e9-c255-4e31-9f13-24c96f6a708b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:20.076182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8283e9-c255-4e31-9f13-24c96f6a708b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:20.109050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-1a8283e9-c255-4e31-9f13-24c96f6a708b None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:20.110987 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1a8283e9-c255-4e31-9f13-24c96f6a708b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:20.151137 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45fd3d-56e2-49aa-9bca-2db4f40a8dbe None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:20.172198 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:20.224769 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bef48-4345-4ef0-a9dc-6e095c9d9bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:20.225762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bef48-4345-4ef0-a9dc-6e095c9d9bba None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:20.226241 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bef48-4345-4ef0-a9dc-6e095c9d9bba None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:20.226709 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bef48-4345-4ef0-a9dc-6e095c9d9bba None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:20.227621 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bef48-4345-4ef0-a9dc-6e095c9d9bba None admin] RBAC: Adding query filter params (name=member) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:20.228144 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bef48-4345-4ef0-a9dc-6e095c9d9bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:20.229742 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bef48-4345-4ef0-a9dc-6e095c9d9bba None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:20.250978 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 163/339] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:04:19 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:20.254981 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 177/340] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:20.260508 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bef48-4345-4ef0-a9dc-6e095c9d9bba None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:20.319627 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad46a69-4c75-4e2a-a0bd-67d56562c7c4 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:20.320252 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad46a69-4c75-4e2a-a0bd-67d56562c7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:20.320868 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad46a69-4c75-4e2a-a0bd-67d56562c7c4 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:20.322687 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 178/341] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:04:20.327820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336ed40-58c0-4994-a723-a25cd7dd665f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:20.328368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336ed40-58c0-4994-a723-a25cd7dd665f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:20.328947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336ed40-58c0-4994-a723-a25cd7dd665f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:20.349214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6336ed40-58c0-4994-a723-a25cd7dd665f None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:20.350738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6336ed40-58c0-4994-a723-a25cd7dd665f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:20.431121 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 179/342] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:04:20.432393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336ed40-58c0-4994-a723-a25cd7dd665f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:20.456712 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:20.476793 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bef48-4345-4ef0-a9dc-6e095c9d9bba None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:20.541835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d613d5-fad3-4f4b-af3e-d0d530359da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:20.542468 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d613d5-fad3-4f4b-af3e-d0d530359da2 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:20.542755 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d613d5-fad3-4f4b-af3e-d0d530359da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:20.543029 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d613d5-fad3-4f4b-af3e-d0d530359da2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:20.594745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:20.606573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336ed40-58c0-4994-a723-a25cd7dd665f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:20.655632 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d613d5-fad3-4f4b-af3e-d0d530359da2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:20.657133 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d613d5-fad3-4f4b-af3e-d0d530359da2 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:20.685995 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7eeb8-0d9b-4fcc-a036-e0d44254c895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:20.686582 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7eeb8-0d9b-4fcc-a036-e0d44254c895 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:20.686868 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7eeb8-0d9b-4fcc-a036-e0d44254c895 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:20.687147 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7eeb8-0d9b-4fcc-a036-e0d44254c895 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:20.705760 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7eeb8-0d9b-4fcc-a036-e0d44254c895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:20.710791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-68a7eeb8-0d9b-4fcc-a036-e0d44254c895 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 16:04:20.710791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:20.710791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:20.710791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:20.710791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:20.710791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:20.710791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:20.710791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:20.710791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:20.710791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:20.710791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:20.710791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:20.710791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:20.710791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:20.710791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:20.710791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:20.711638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:20.711638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:20.711638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:20.711638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:20.711638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:20.711638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:20.711638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:20.711638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:20.711638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:20.711638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:20.711638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:20.711638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:20.711638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:20.711638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:20.711638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:20.711638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:20.712404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:20.712404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:20.712404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:20.712404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:20.712404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:20.712404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:20.712404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:20.712404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:20.712404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:20.712404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:20.712404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 16:04:20.712404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:20.716725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 180/343] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:20.717538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7eeb8-0d9b-4fcc-a036-e0d44254c895 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:20.772306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:20.780803 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 164/344] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:20 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:20.781482 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d613d5-fad3-4f4b-af3e-d0d530359da2 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:20.891386 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d613d5-fad3-4f4b-af3e-d0d530359da2 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:20.900446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7eeb8-0d9b-4fcc-a036-e0d44254c895 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:20.947083 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a31a05-c05d-49b4-9729-349d3d25a15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:20.947967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a31a05-c05d-49b4-9729-349d3d25a15e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:20.948391 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a31a05-c05d-49b4-9729-349d3d25a15e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:20.948828 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a31a05-c05d-49b4-9729-349d3d25a15e None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:20.949751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a31a05-c05d-49b4-9729-349d3d25a15e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:20.950200 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a31a05-c05d-49b4-9729-349d3d25a15e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:20.951794 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a31a05-c05d-49b4-9729-349d3d25a15e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:20.968748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 165/345] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:04:20 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:20.969799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a31a05-c05d-49b4-9729-349d3d25a15e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:20.982795 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf1090-b249-41e6-9d4e-95373d835c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:20.983789 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf1090-b249-41e6-9d4e-95373d835c6f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:20.984283 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf1090-b249-41e6-9d4e-95373d835c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:20.984788 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf1090-b249-41e6-9d4e-95373d835c6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:21.000731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf1090-b249-41e6-9d4e-95373d835c6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:21.006099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-b0cf1090-b249-41e6-9d4e-95373d835c6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:04:21.006099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:21.006099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:21.006099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:21.006099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:21.006099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:21.006099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:21.006099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:21.006099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:21.006099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:21.006099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:21.006099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:21.006099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:21.006099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:21.006099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:21.006099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:21.007038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:21.007038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:21.007038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:21.007038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:21.007038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:21.007038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:21.007038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:21.007038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:21.007038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:21.007038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:21.007038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:21.007038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:21.007038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:21.007038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:21.007038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:21.007038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:21.007809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:21.007809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:21.007809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:21.007809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:21.007809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:21.007809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:21.007809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:21.007809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:21.007809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:21.007809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:21.007809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:04:21.007809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:21.010398 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 181/346] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:04:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:21.011427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf1090-b249-41e6-9d4e-95373d835c6f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:21.033377 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:21.036630 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:21.090778 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a31a05-c05d-49b4-9729-349d3d25a15e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:21.131008 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5757a26-d96a-45b2-9151-acb93e4952f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:21.132089 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5757a26-d96a-45b2-9151-acb93e4952f8 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:21.132589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5757a26-d96a-45b2-9151-acb93e4952f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:21.133062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5757a26-d96a-45b2-9151-acb93e4952f8 None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:21.136980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5757a26-d96a-45b2-9151-acb93e4952f8 None admin] RBAC: Authorizing `identity:get_project(project_id=844e7dec0aec49598b6b69437d09d460)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:21.138340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf1090-b249-41e6-9d4e-95373d835c6f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:21.138813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5757a26-d96a-45b2-9151-acb93e4952f8 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:21.141042 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 166/347] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:20 2022] GET /identity/v3/projects/844e7dec0aec49598b6b69437d09d460 => generated 299 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:21.143462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f23248-d551-454e-a68e-f7a8633a422b None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:21.143462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f23248-d551-454e-a68e-f7a8633a422b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:21.143462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f23248-d551-454e-a68e-f7a8633a422b None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:21.145228 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 167/348] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:21.146125 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f23248-d551-454e-a68e-f7a8633a422b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:21.185223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c9951-2bbe-4282-9a86-3fda99d347bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:21.185873 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c9951-2bbe-4282-9a86-3fda99d347bd None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:21.186153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c9951-2bbe-4282-9a86-3fda99d347bd None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:21.186420 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c9951-2bbe-4282-9a86-3fda99d347bd None admin] PATH_INFO: `/v3/users/ec9bd2e359014fb28958f2e79be7ffdd` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:21.188272 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c9951-2bbe-4282-9a86-3fda99d347bd None admin] RBAC: Authorizing `identity:get_user(user_id=ec9bd2e359014fb28958f2e79be7ffdd)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:21.190030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c9951-2bbe-4282-9a86-3fda99d347bd None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:21.191915 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 182/349] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:04:21 2022] GET /identity/v3/users/ec9bd2e359014fb28958f2e79be7ffdd => generated 294 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:21.192689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c9951-2bbe-4282-9a86-3fda99d347bd None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:21.275577 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f23248-d551-454e-a68e-f7a8633a422b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:21.303098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:21.308405 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:21.321479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0dc69b-b8e1-4f66-acf6-739b24dbb30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:21.322291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c9951-2bbe-4282-9a86-3fda99d347bd None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:21.322676 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dc69b-b8e1-4f66-acf6-739b24dbb30d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:21.323203 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dc69b-b8e1-4f66-acf6-739b24dbb30d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:21.323668 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dc69b-b8e1-4f66-acf6-739b24dbb30d None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:21.324586 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0dc69b-b8e1-4f66-acf6-739b24dbb30d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:21.325114 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0dc69b-b8e1-4f66-acf6-739b24dbb30d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:21.326728 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0dc69b-b8e1-4f66-acf6-739b24dbb30d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:21.336766 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 168/350] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:21 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:21.338258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff103dbd-9679-4cff-bcb2-e64c0a6f0997 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:21.338740 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff103dbd-9679-4cff-bcb2-e64c0a6f0997 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:21.339233 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff103dbd-9679-4cff-bcb2-e64c0a6f0997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:21.358345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bed9d7-ca61-48f2-a509-aa0a443c6fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:21.359360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bed9d7-ca61-48f2-a509-aa0a443c6fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:21.359825 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bed9d7-ca61-48f2-a509-aa0a443c6fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:21.360298 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ff103dbd-9679-4cff-bcb2-e64c0a6f0997 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:21.360470 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bed9d7-ca61-48f2-a509-aa0a443c6fb7 None admin] PATH_INFO: `/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:21.361981 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ff103dbd-9679-4cff-bcb2-e64c0a6f0997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:21.366958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bed9d7-ca61-48f2-a509-aa0a443c6fb7 None admin] RBAC: Authorizing `identity:get_group(group_id=f1fe8d72a50b49169c0bdcc6f9e74fb1)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:21.368396 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bed9d7-ca61-48f2-a509-aa0a443c6fb7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:21.370106 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 183/351] 10.222.0.141 () {56 vars in 1185 bytes} [Tue Jul 26 16:04:21 2022] GET /identity/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1 => generated 227 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:21.370857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bed9d7-ca61-48f2-a509-aa0a443c6fb7 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:21.437366 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 169/352] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:21.438539 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff103dbd-9679-4cff-bcb2-e64c0a6f0997 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:21.495267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bed9d7-ca61-48f2-a509-aa0a443c6fb7 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:21.542871 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff103dbd-9679-4cff-bcb2-e64c0a6f0997 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:21.543304 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6287d-0bc8-4c2b-88b4-f590b8cce1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:21.543928 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6287d-0bc8-4c2b-88b4-f590b8cce1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:21.544203 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6287d-0bc8-4c2b-88b4-f590b8cce1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:21.544472 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6287d-0bc8-4c2b-88b4-f590b8cce1c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:21.545307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6287d-0bc8-4c2b-88b4-f590b8cce1c2 None admin] RBAC: Adding query filter params (role.id=caee5723a1744eba93eee74ec02c8b8f, user.id=ec9bd2e359014fb28958f2e79be7ffdd, scope.system=all) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:21.545670 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6287d-0bc8-4c2b-88b4-f590b8cce1c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:21.548485 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6287d-0bc8-4c2b-88b4-f590b8cce1c2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:21.563054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:21.565106 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 184/353] 10.222.0.141 () {56 vars in 1313 bytes} [Tue Jul 26 16:04:21 2022] GET /identity/v3/role_assignments?user.id=ec9bd2e359014fb28958f2e79be7ffdd&scope.system=all&role.id=caee5723a1744eba93eee74ec02c8b8f => generated 512 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:21.566473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6287d-0bc8-4c2b-88b4-f590b8cce1c2 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:21.583235 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:21.586087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d7cd1-e39d-473a-af16-22174ae777ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:21.587059 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d7cd1-e39d-473a-af16-22174ae777ce None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:21.587540 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d7cd1-e39d-473a-af16-22174ae777ce None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:21.588007 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d7cd1-e39d-473a-af16-22174ae777ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:21.677327 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d7cd1-e39d-473a-af16-22174ae777ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:21.679638 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d7cd1-e39d-473a-af16-22174ae777ce None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:21.705921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6287d-0bc8-4c2b-88b4-f590b8cce1c2 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:21.755378 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6750bf3-c2e8-4f61-a4fa-7d6b495182ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:21.756512 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6750bf3-c2e8-4f61-a4fa-7d6b495182ef None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:21.756826 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6750bf3-c2e8-4f61-a4fa-7d6b495182ef None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:21.757099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6750bf3-c2e8-4f61-a4fa-7d6b495182ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:21.758171 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6750bf3-c2e8-4f61-a4fa-7d6b495182ef None admin] RBAC: Adding query filter params (group.id=f1fe8d72a50b49169c0bdcc6f9e74fb1, role.id=61321ad01e84416981d4c7208c55bbe7, scope.project.id=844e7dec0aec49598b6b69437d09d460) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:21.758487 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6750bf3-c2e8-4f61-a4fa-7d6b495182ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:21.760724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6750bf3-c2e8-4f61-a4fa-7d6b495182ef None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:21.768285 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 185/354] 10.222.0.141 () {56 vars in 1381 bytes} [Tue Jul 26 16:04:21 2022] GET /identity/v3/role_assignments?group.id=f1fe8d72a50b49169c0bdcc6f9e74fb1&scope.project.id=844e7dec0aec49598b6b69437d09d460&role.id=61321ad01e84416981d4c7208c55bbe7 => generated 261 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:21.769339 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6750bf3-c2e8-4f61-a4fa-7d6b495182ef None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:21.815290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 170/355] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:21 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:21.817677 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffc1ac-2dd0-45a0-b48b-2880c839c949 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:21.818216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffc1ac-2dd0-45a0-b48b-2880c839c949 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:21.818715 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffc1ac-2dd0-45a0-b48b-2880c839c949 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:21.820348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 171/356] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:21.821377 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffc1ac-2dd0-45a0-b48b-2880c839c949 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:21.846508 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:21.878217 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:21.918979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6750bf3-c2e8-4f61-a4fa-7d6b495182ef None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:21.958273 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec8049-40d6-41cb-8e4e-4122703109e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:21.958837 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec8049-40d6-41cb-8e4e-4122703109e3 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:21.959122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec8049-40d6-41cb-8e4e-4122703109e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:21.959398 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec8049-40d6-41cb-8e4e-4122703109e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:21.967463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffc1ac-2dd0-45a0-b48b-2880c839c949 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:21.977853 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec8049-40d6-41cb-8e4e-4122703109e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:21.985368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-a9ec8049-40d6-41cb-8e4e-4122703109e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:21.985368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:21.985368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:21.985368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:21.985368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:21.985368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:21.985368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:21.985368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:21.985368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:21.985368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:21.985368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:21.985368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:21.985368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:21.985368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:21.985368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:21.985368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:21.986291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:21.986291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:21.986291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:21.986291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:21.986291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:21.986291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:21.986291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:21.986291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:21.986291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:21.986291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:21.986291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:21.986291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:21.986291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:21.986291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:21.986291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:21.986291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:21.987073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:21.987073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:21.987073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:21.987073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:21.987073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:21.987073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:21.987073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:21.987073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:21.987073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:21.987073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:21.987073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:21.987073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:21.988154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 186/357] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:21.989311 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7522b-3f79-4d7c-a1a6-12987a7cf979 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:21.989805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7522b-3f79-4d7c-a1a6-12987a7cf979 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:21.990084 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7522b-3f79-4d7c-a1a6-12987a7cf979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:22.013982 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a225c33-5b0a-447b-8024-92add8b8bd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:22.014191 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-72a7522b-3f79-4d7c-a1a6-12987a7cf979 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:22.015044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a225c33-5b0a-447b-8024-92add8b8bd86 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:22.015252 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-72a7522b-3f79-4d7c-a1a6-12987a7cf979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:22.015477 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a225c33-5b0a-447b-8024-92add8b8bd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:22.015755 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a225c33-5b0a-447b-8024-92add8b8bd86 None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:22.017919 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a225c33-5b0a-447b-8024-92add8b8bd86 None admin] RBAC: Authorizing `identity:get_project(project_id=844e7dec0aec49598b6b69437d09d460)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:22.020067 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a225c33-5b0a-447b-8024-92add8b8bd86 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:22.021957 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 172/358] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:21 2022] GET /identity/v3/projects/844e7dec0aec49598b6b69437d09d460 => generated 299 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:22.023238 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cda51-4afe-4f6e-8e75-a3aaecdc228a None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:22.023806 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cda51-4afe-4f6e-8e75-a3aaecdc228a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:22.024226 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cda51-4afe-4f6e-8e75-a3aaecdc228a None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:22.025722 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 173/359] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:22.026587 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463cda51-4afe-4f6e-8e75-a3aaecdc228a None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:22.104292 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 187/360] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:22.105100 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7522b-3f79-4d7c-a1a6-12987a7cf979 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:22.141128 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:22.167669 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463cda51-4afe-4f6e-8e75-a3aaecdc228a None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:22.187195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:22.218991 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa3da7-0690-4bb8-950b-f8896ec1a9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:22.219618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa3da7-0690-4bb8-950b-f8896ec1a9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:22.219901 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa3da7-0690-4bb8-950b-f8896ec1a9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:22.220602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa3da7-0690-4bb8-950b-f8896ec1a9a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:22.221423 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa3da7-0690-4bb8-950b-f8896ec1a9a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:22.222016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa3da7-0690-4bb8-950b-f8896ec1a9a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:22.223582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa3da7-0690-4bb8-950b-f8896ec1a9a1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:22.235151 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7522b-3f79-4d7c-a1a6-12987a7cf979 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:22.236300 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 174/361] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:04:22 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:22.238122 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71975cf2-2b0c-445a-9cf9-2c549ea41597 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:22.239178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71975cf2-2b0c-445a-9cf9-2c549ea41597 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:22.239178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71975cf2-2b0c-445a-9cf9-2c549ea41597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:22.266699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-71975cf2-2b0c-445a-9cf9-2c549ea41597 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:22.267971 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-71975cf2-2b0c-445a-9cf9-2c549ea41597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:22.283766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb641c5c-fd72-49e3-9e36-700f5ffe1297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:22.284765 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb641c5c-fd72-49e3-9e36-700f5ffe1297 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:22.285051 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb641c5c-fd72-49e3-9e36-700f5ffe1297 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:22.285329 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb641c5c-fd72-49e3-9e36-700f5ffe1297 None admin] PATH_INFO: `/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:22.287037 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb641c5c-fd72-49e3-9e36-700f5ffe1297 None admin] RBAC: Authorizing `identity:get_group(group_id=f1fe8d72a50b49169c0bdcc6f9e74fb1)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:22.288531 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb641c5c-fd72-49e3-9e36-700f5ffe1297 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:22.290631 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 188/362] 10.222.0.141 () {56 vars in 1185 bytes} [Tue Jul 26 16:04:22 2022] GET /identity/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1 => generated 227 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:22.291651 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb641c5c-fd72-49e3-9e36-700f5ffe1297 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:22.349594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 175/363] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:22.350745 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71975cf2-2b0c-445a-9cf9-2c549ea41597 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:22.405905 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb641c5c-fd72-49e3-9e36-700f5ffe1297 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:22.445930 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:22.447433 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:22.451428 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd975eff-9487-41e8-9bb4-316e3d9b8276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:22.451428 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd975eff-9487-41e8-9bb4-316e3d9b8276 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:22.451428 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd975eff-9487-41e8-9bb4-316e3d9b8276 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:22.451428 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd975eff-9487-41e8-9bb4-316e3d9b8276 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:22.464495 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd975eff-9487-41e8-9bb4-316e3d9b8276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:22.470534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-cd975eff-9487-41e8-9bb4-316e3d9b8276 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:04:22.470534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:22.470534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:22.470534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:22.470534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:22.470534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:22.470534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:22.470534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:22.470534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:22.470534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:22.470534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:22.470534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:22.470534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:22.470534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:22.470534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:22.470534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:22.471422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:22.471422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:22.471422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:22.471422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:22.471422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:22.471422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:22.471422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:22.471422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:22.471422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:22.471422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:22.471422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:22.471422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:22.471422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:22.471422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:22.471422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:22.471422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:22.472248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:22.472248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:22.472248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:22.472248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:22.472248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:22.472248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:22.472248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:22.472248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:22.472248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:22.472248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:22.472248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:04:22.472248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:22.472248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 189/364] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:04:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:22.477948 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd975eff-9487-41e8-9bb4-316e3d9b8276 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:22.490684 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71975cf2-2b0c-445a-9cf9-2c549ea41597 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:22.530061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc0c81-3ca5-4a03-8dee-089dae46b478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:22.530805 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc0c81-3ca5-4a03-8dee-089dae46b478 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:22.531090 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc0c81-3ca5-4a03-8dee-089dae46b478 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:22.532282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc0c81-3ca5-4a03-8dee-089dae46b478 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:22.610285 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd975eff-9487-41e8-9bb4-316e3d9b8276 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:22.616880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc0c81-3ca5-4a03-8dee-089dae46b478 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:22.618807 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc0c81-3ca5-4a03-8dee-089dae46b478 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:22.652704 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae0f6a-2c0e-44fd-aae6-2d3858edd8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:22.653595 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae0f6a-2c0e-44fd-aae6-2d3858edd8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:22.654087 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae0f6a-2c0e-44fd-aae6-2d3858edd8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:22.654505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae0f6a-2c0e-44fd-aae6-2d3858edd8c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:22.655450 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae0f6a-2c0e-44fd-aae6-2d3858edd8c4 None admin] RBAC: Adding query filter params (group.id=f1fe8d72a50b49169c0bdcc6f9e74fb1, role.id=33fa4ece26464ae98122f3279db92307, scope.project.id=844e7dec0aec49598b6b69437d09d460) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:22.655960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae0f6a-2c0e-44fd-aae6-2d3858edd8c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:22.657676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae0f6a-2c0e-44fd-aae6-2d3858edd8c4 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:22.663873 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 190/365] 10.222.0.141 () {56 vars in 1381 bytes} [Tue Jul 26 16:04:22 2022] GET /identity/v3/role_assignments?group.id=f1fe8d72a50b49169c0bdcc6f9e74fb1&scope.project.id=844e7dec0aec49598b6b69437d09d460&role.id=33fa4ece26464ae98122f3279db92307 => generated 261 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:22.665101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae0f6a-2c0e-44fd-aae6-2d3858edd8c4 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:22.717834 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:22.747273 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 176/366] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:22 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:22.748238 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc0c81-3ca5-4a03-8dee-089dae46b478 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:22.756103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:22.824166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae0f6a-2c0e-44fd-aae6-2d3858edd8c4 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:22.877299 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b6134-7542-4f7c-ab68-e7eb9858ae2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:22.877958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b6134-7542-4f7c-ab68-e7eb9858ae2d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:22.878997 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b6134-7542-4f7c-ab68-e7eb9858ae2d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:22.879278 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b6134-7542-4f7c-ab68-e7eb9858ae2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:22.879639 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc0c81-3ca5-4a03-8dee-089dae46b478 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:22.892873 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b6134-7542-4f7c-ab68-e7eb9858ae2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:22.898404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-3e5b6134-7542-4f7c-ab68-e7eb9858ae2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:04:22.898404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:22.898404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:22.898404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:22.898404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:22.898404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:22.898404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:22.898404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:22.898404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:22.898404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:22.898404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:22.898404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:22.898404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:22.898404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:22.898404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:22.898404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:22.899280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:22.899280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:22.899280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:22.899280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:22.899280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:22.899280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:22.899280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:22.899280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:22.899280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:22.899280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:22.899280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:22.899280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:22.899280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:22.899280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:22.899280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:22.899280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:22.900062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:22.900062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:22.900062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:22.900062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:22.900062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:22.900062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:22.900062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:22.900062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:22.900062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:22.900062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:22.900062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:04:22.900062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:22.900062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 191/367] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:04:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:22.900735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b6134-7542-4f7c-ab68-e7eb9858ae2d None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:22.927656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43421f9-14ce-427c-a44e-bedebafd7a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:22.928433 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43421f9-14ce-427c-a44e-bedebafd7a6e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:22.931326 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43421f9-14ce-427c-a44e-bedebafd7a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:22.931703 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43421f9-14ce-427c-a44e-bedebafd7a6e None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:22.932455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43421f9-14ce-427c-a44e-bedebafd7a6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:22.932815 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43421f9-14ce-427c-a44e-bedebafd7a6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:22.941177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43421f9-14ce-427c-a44e-bedebafd7a6e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:22.944399 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 177/368] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:22 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:22.945330 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43421f9-14ce-427c-a44e-bedebafd7a6e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:22.993504 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:23.045017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b6134-7542-4f7c-ab68-e7eb9858ae2d None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:23.065109 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:23.067532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43421f9-14ce-427c-a44e-bedebafd7a6e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:23.095649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b97185-a1f6-45a9-98f8-5151df4edd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:23.096597 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97185-a1f6-45a9-98f8-5151df4edd6d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:23.097622 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97185-a1f6-45a9-98f8-5151df4edd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:23.098076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97185-a1f6-45a9-98f8-5151df4edd6d None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:23.100160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b97185-a1f6-45a9-98f8-5151df4edd6d None admin] RBAC: Authorizing `identity:get_project(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:23.102742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b97185-a1f6-45a9-98f8-5151df4edd6d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:23.105922 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 192/369] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:22 2022] GET /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7 => generated 303 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:23.107631 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b97185-a1f6-45a9-98f8-5151df4edd6d None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:23.113336 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480254c-6d36-4e95-937e-bf56bd978149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:23.114019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480254c-6d36-4e95-937e-bf56bd978149 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:23.114303 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480254c-6d36-4e95-937e-bf56bd978149 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:23.114582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480254c-6d36-4e95-937e-bf56bd978149 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:23.115366 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480254c-6d36-4e95-937e-bf56bd978149 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:23.115676 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480254c-6d36-4e95-937e-bf56bd978149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:23.117167 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480254c-6d36-4e95-937e-bf56bd978149 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:23.127110 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 178/370] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:22 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:23.127928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480254c-6d36-4e95-937e-bf56bd978149 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:23.241642 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b97185-a1f6-45a9-98f8-5151df4edd6d None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:23.263964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:23.267477 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480254c-6d36-4e95-937e-bf56bd978149 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:23.289248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68273156-cc2a-4b67-b902-0dda3777801f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:23.289942 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68273156-cc2a-4b67-b902-0dda3777801f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:23.290232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68273156-cc2a-4b67-b902-0dda3777801f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:23.290507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68273156-cc2a-4b67-b902-0dda3777801f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:23.310916 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527f5a3-7807-4ec1-a2ac-35bf59847810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:23.312310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527f5a3-7807-4ec1-a2ac-35bf59847810 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:23.312864 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527f5a3-7807-4ec1-a2ac-35bf59847810 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:23.313338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527f5a3-7807-4ec1-a2ac-35bf59847810 None admin] PATH_INFO: `/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:23.314895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527f5a3-7807-4ec1-a2ac-35bf59847810 None admin] RBAC: Authorizing `identity:get_group(group_id=f1fe8d72a50b49169c0bdcc6f9e74fb1)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:23.317234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527f5a3-7807-4ec1-a2ac-35bf59847810 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:23.319298 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 179/371] 10.222.0.141 () {56 vars in 1185 bytes} [Tue Jul 26 16:04:23 2022] GET /identity/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1 => generated 227 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:23.320266 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527f5a3-7807-4ec1-a2ac-35bf59847810 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:23.354008 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:23.380438 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68273156-cc2a-4b67-b902-0dda3777801f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:23.382317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68273156-cc2a-4b67-b902-0dda3777801f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:23.449569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527f5a3-7807-4ec1-a2ac-35bf59847810 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:23.490858 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c385dbf-1c1c-4177-8eda-5d223f30c206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:23.491622 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c385dbf-1c1c-4177-8eda-5d223f30c206 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:23.491845 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c385dbf-1c1c-4177-8eda-5d223f30c206 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:23.492024 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c385dbf-1c1c-4177-8eda-5d223f30c206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:23.495649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 193/372] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:23 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:23.497735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68273156-cc2a-4b67-b902-0dda3777801f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:23.529609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:23.567131 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c385dbf-1c1c-4177-8eda-5d223f30c206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:23.568613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c385dbf-1c1c-4177-8eda-5d223f30c206 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:23.588097 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:23.607440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68273156-cc2a-4b67-b902-0dda3777801f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:23.645355 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b4901-3368-469e-9cb1-9f0df2dc69cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:23.646324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b4901-3368-469e-9cb1-9f0df2dc69cc None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:23.646828 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b4901-3368-469e-9cb1-9f0df2dc69cc None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:23.647296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b4901-3368-469e-9cb1-9f0df2dc69cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:23.648334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b4901-3368-469e-9cb1-9f0df2dc69cc None admin] RBAC: Adding query filter params (group.id=f1fe8d72a50b49169c0bdcc6f9e74fb1, role.id=61321ad01e84416981d4c7208c55bbe7, scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:23.648918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b4901-3368-469e-9cb1-9f0df2dc69cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:23.650600 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b4901-3368-469e-9cb1-9f0df2dc69cc None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:23.656843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 194/373] 10.222.0.141 () {56 vars in 1381 bytes} [Tue Jul 26 16:04:23 2022] GET /identity/v3/role_assignments?group.id=f1fe8d72a50b49169c0bdcc6f9e74fb1&scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7&role.id=61321ad01e84416981d4c7208c55bbe7 => generated 261 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:23.657868 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b4901-3368-469e-9cb1-9f0df2dc69cc None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:23.673852 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 180/374] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:23 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:23.679819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c385dbf-1c1c-4177-8eda-5d223f30c206 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:23.757030 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:23.768954 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b4901-3368-469e-9cb1-9f0df2dc69cc None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:23.795075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c385dbf-1c1c-4177-8eda-5d223f30c206 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:23.808266 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5a59c-fa13-49a2-951b-d7355465f163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:23.809441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5a59c-fa13-49a2-951b-d7355465f163 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:23.809929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5a59c-fa13-49a2-951b-d7355465f163 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:23.810490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5a59c-fa13-49a2-951b-d7355465f163 None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:23.811999 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5a59c-fa13-49a2-951b-d7355465f163 None admin] RBAC: Authorizing `identity:get_project(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:23.813720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5a59c-fa13-49a2-951b-d7355465f163 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:23.816066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 195/375] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:23 2022] GET /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7 => generated 303 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:23.821232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5a59c-fa13-49a2-951b-d7355465f163 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:23.838786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7ce60-9318-452e-bdbe-d4cbe39ff463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:23.839802 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7ce60-9318-452e-bdbe-d4cbe39ff463 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:23.840466 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7ce60-9318-452e-bdbe-d4cbe39ff463 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:23.840959 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7ce60-9318-452e-bdbe-d4cbe39ff463 None admin] PATH_INFO: `/v3/projects/a7fee3c27a264e38accf0b43d34d249e` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:23.841213 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:23.843511 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7ce60-9318-452e-bdbe-d4cbe39ff463 None admin] RBAC: Authorizing `identity:get_project(project_id=a7fee3c27a264e38accf0b43d34d249e)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:23.845650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7ce60-9318-452e-bdbe-d4cbe39ff463 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:23.848462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 181/376] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:23 2022] GET /identity/v3/projects/a7fee3c27a264e38accf0b43d34d249e => generated 345 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:23.857987 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7ce60-9318-452e-bdbe-d4cbe39ff463 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:23.956691 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5a59c-fa13-49a2-951b-d7355465f163 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:24.000598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b61f7-18ce-461d-b3cd-7a79715750bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:24.001287 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b61f7-18ce-461d-b3cd-7a79715750bb None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:24.001568 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b61f7-18ce-461d-b3cd-7a79715750bb None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:24.001847 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b61f7-18ce-461d-b3cd-7a79715750bb None admin] PATH_INFO: `/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:24.003214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b61f7-18ce-461d-b3cd-7a79715750bb None admin] RBAC: Authorizing `identity:get_group(group_id=f1fe8d72a50b49169c0bdcc6f9e74fb1)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:24.004686 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b61f7-18ce-461d-b3cd-7a79715750bb None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:24.006477 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 196/377] 10.222.0.141 () {56 vars in 1185 bytes} [Tue Jul 26 16:04:23 2022] GET /identity/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1 => generated 227 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:24.012263 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b61f7-18ce-461d-b3cd-7a79715750bb None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:24.034995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7ce60-9318-452e-bdbe-d4cbe39ff463 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:24.099357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634dbf2-b0d6-49bb-aa3f-e3bdc9ae20b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:24.100363 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634dbf2-b0d6-49bb-aa3f-e3bdc9ae20b8 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:24.100643 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634dbf2-b0d6-49bb-aa3f-e3bdc9ae20b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:24.100932 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634dbf2-b0d6-49bb-aa3f-e3bdc9ae20b8 None admin] PATH_INFO: `/v3/groups/3d5544a6e86f431eaf16e63688212aec` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:24.109850 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:24.113368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634dbf2-b0d6-49bb-aa3f-e3bdc9ae20b8 None admin] RBAC: Authorizing `identity:get_group(group_id=3d5544a6e86f431eaf16e63688212aec)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:24.114834 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634dbf2-b0d6-49bb-aa3f-e3bdc9ae20b8 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:24.119666 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 182/378] 10.222.0.141 () {56 vars in 1185 bytes} [Tue Jul 26 16:04:23 2022] GET /identity/v3/groups/3d5544a6e86f431eaf16e63688212aec => generated 230 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:24.125524 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634dbf2-b0d6-49bb-aa3f-e3bdc9ae20b8 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:24.165954 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:24.194498 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b61f7-18ce-461d-b3cd-7a79715750bb None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:24.242338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634dbf2-b0d6-49bb-aa3f-e3bdc9ae20b8 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:24.249959 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872fa1a-e5fe-4cd0-adc5-9211cf6b30ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:24.250599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872fa1a-e5fe-4cd0-adc5-9211cf6b30ea None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:24.250885 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872fa1a-e5fe-4cd0-adc5-9211cf6b30ea None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:24.251161 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872fa1a-e5fe-4cd0-adc5-9211cf6b30ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:24.251961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872fa1a-e5fe-4cd0-adc5-9211cf6b30ea None admin] RBAC: Adding query filter params (group.id=f1fe8d72a50b49169c0bdcc6f9e74fb1, role.id=33fa4ece26464ae98122f3279db92307, scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:24.252282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872fa1a-e5fe-4cd0-adc5-9211cf6b30ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:24.254303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872fa1a-e5fe-4cd0-adc5-9211cf6b30ea None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:24.268384 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 197/379] 10.222.0.141 () {56 vars in 1381 bytes} [Tue Jul 26 16:04:24 2022] GET /identity/v3/role_assignments?group.id=f1fe8d72a50b49169c0bdcc6f9e74fb1&scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7&role.id=33fa4ece26464ae98122f3279db92307 => generated 261 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:24.290781 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd20e8-d063-4a76-abed-23e767a66688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:24.291686 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd20e8-d063-4a76-abed-23e767a66688 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:24.292107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd20e8-d063-4a76-abed-23e767a66688 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:24.292543 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd20e8-d063-4a76-abed-23e767a66688 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:24.293548 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd20e8-d063-4a76-abed-23e767a66688 None admin] RBAC: Adding query filter params (group.id=3d5544a6e86f431eaf16e63688212aec, role.id=94ecbd6c86a84b75bdb0c57fc27a9a07, scope.project.id=a7fee3c27a264e38accf0b43d34d249e) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:24.293997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd20e8-d063-4a76-abed-23e767a66688 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:24.295637 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd20e8-d063-4a76-abed-23e767a66688 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:24.304521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 183/380] 10.222.0.141 () {56 vars in 1381 bytes} [Tue Jul 26 16:04:24 2022] GET /identity/v3/role_assignments?group.id=3d5544a6e86f431eaf16e63688212aec&scope.project.id=a7fee3c27a264e38accf0b43d34d249e&role.id=94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 261 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:24.333987 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecd46d-eeec-4eb1-9d18-0cd8c4b88a8c None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:24.334313 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecd46d-eeec-4eb1-9d18-0cd8c4b88a8c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:24.334561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecd46d-eeec-4eb1-9d18-0cd8c4b88a8c None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:24.336302 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 198/381] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:24.341922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8745e-66cc-447f-9adc-4822fd654e16 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:24.342517 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8745e-66cc-447f-9adc-4822fd654e16 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:24.342961 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8745e-66cc-447f-9adc-4822fd654e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:24.367500 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-47c8745e-66cc-447f-9adc-4822fd654e16 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:24.369037 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-47c8745e-66cc-447f-9adc-4822fd654e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:24.459885 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:24.469532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 184/382] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:24.506704 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecd46d-eeec-4eb1-9d18-0cd8c4b88a8c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:24.646533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecd46d-eeec-4eb1-9d18-0cd8c4b88a8c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:24.684649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3979b9b-0dec-4352-95a7-1fd63f1eb922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:24.685316 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3979b9b-0dec-4352-95a7-1fd63f1eb922 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:24.685597 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3979b9b-0dec-4352-95a7-1fd63f1eb922 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:24.685871 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3979b9b-0dec-4352-95a7-1fd63f1eb922 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:24.698125 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3979b9b-0dec-4352-95a7-1fd63f1eb922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:24.703626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-b3979b9b-0dec-4352-95a7-1fd63f1eb922 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:24.703626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:24.703626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:24.703626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:24.703626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:24.703626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:24.703626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:24.703626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:24.703626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:24.703626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:24.703626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:24.703626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:24.703626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:24.703626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:24.703626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:24.703626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:24.705429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:24.705429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:24.705429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:24.705429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:24.705429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:24.705429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:24.705429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:24.705429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:24.705429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:24.705429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:24.705429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:24.705429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:24.705429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:24.705429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:24.705429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:24.705429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:24.706223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:24.706223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:24.706223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:24.706223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:24.706223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:24.706223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:24.706223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:24.706223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:24.706223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:24.706223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:24.706223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:24.706223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:24.706223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 199/383] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:24.710985 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8745e-66cc-447f-9adc-4822fd654e16 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:24.862996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8745e-66cc-447f-9adc-4822fd654e16 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:24.907786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b11157-e91b-4178-a30f-3e1c495389ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:24.908794 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b11157-e91b-4178-a30f-3e1c495389ae None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:24.909904 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b11157-e91b-4178-a30f-3e1c495389ae None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:24.910374 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b11157-e91b-4178-a30f-3e1c495389ae None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:24.911277 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b11157-e91b-4178-a30f-3e1c495389ae None admin] RBAC: Adding query filter params (name=member) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:24.911785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b11157-e91b-4178-a30f-3e1c495389ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:24.913422 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b11157-e91b-4178-a30f-3e1c495389ae None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:24.925200 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 185/384] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:04:24 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:24.931168 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3979b9b-0dec-4352-95a7-1fd63f1eb922 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:24.944538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:25.019530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65364f36-4c3f-444f-baf4-493111e50e2a None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:25.019863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65364f36-4c3f-444f-baf4-493111e50e2a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:25.020091 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65364f36-4c3f-444f-baf4-493111e50e2a None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:25.021801 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 186/385] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:25 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:25.058269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6739b38-6748-4697-8314-ed61089e1997 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:25.058679 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6739b38-6748-4697-8314-ed61089e1997 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:25.058948 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6739b38-6748-4697-8314-ed61089e1997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:25.082379 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3979b9b-0dec-4352-95a7-1fd63f1eb922 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:25.103495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a6739b38-6748-4697-8314-ed61089e1997 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:25.104833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a6739b38-6748-4697-8314-ed61089e1997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:25.120814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e7310-07c6-4ca3-8a51-821cb9debad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:25.121818 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e7310-07c6-4ca3-8a51-821cb9debad6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:25.122318 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e7310-07c6-4ca3-8a51-821cb9debad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:25.122801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e7310-07c6-4ca3-8a51-821cb9debad6 None admin] PATH_INFO: `/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:25.124229 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e7310-07c6-4ca3-8a51-821cb9debad6 None admin] RBAC: Authorizing `identity:get_group(group_id=f1fe8d72a50b49169c0bdcc6f9e74fb1)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:25.125937 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e7310-07c6-4ca3-8a51-821cb9debad6 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:25.128218 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 200/386] 10.222.0.141 () {56 vars in 1185 bytes} [Tue Jul 26 16:04:24 2022] GET /identity/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1 => generated 227 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:25.133633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e7310-07c6-4ca3-8a51-821cb9debad6 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:25.192766 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:25.213507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:25.224687 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 187/387] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:25.247088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e7310-07c6-4ca3-8a51-821cb9debad6 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:25.288888 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa72e39-15c8-4b67-8cc0-bf570b242f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:25.289915 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa72e39-15c8-4b67-8cc0-bf570b242f67 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:25.290403 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa72e39-15c8-4b67-8cc0-bf570b242f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:25.290953 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa72e39-15c8-4b67-8cc0-bf570b242f67 None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:25.292355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6739b38-6748-4697-8314-ed61089e1997 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:25.292717 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa72e39-15c8-4b67-8cc0-bf570b242f67 None admin] RBAC: Authorizing `identity:get_project(project_id=844e7dec0aec49598b6b69437d09d460)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:25.294368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa72e39-15c8-4b67-8cc0-bf570b242f67 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:25.296245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 201/388] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:25 2022] GET /identity/v3/projects/844e7dec0aec49598b6b69437d09d460 => generated 299 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:25.302945 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa72e39-15c8-4b67-8cc0-bf570b242f67 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:25.437513 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6739b38-6748-4697-8314-ed61089e1997 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:25.481604 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c133d-763a-46cc-9a31-dead1bb90c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:25.482176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c133d-763a-46cc-9a31-dead1bb90c4a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:25.482464 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c133d-763a-46cc-9a31-dead1bb90c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:25.482740 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c133d-763a-46cc-9a31-dead1bb90c4a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:25.500175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c133d-763a-46cc-9a31-dead1bb90c4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:25.510799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-901c133d-763a-46cc-9a31-dead1bb90c4a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:04:25.510799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:25.510799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:25.510799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:25.510799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:25.510799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:25.510799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:25.510799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:25.510799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:25.510799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:25.510799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:25.510799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:25.510799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:25.510799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:25.510799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:25.510799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:25.511753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:25.511753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:25.511753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:25.511753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:25.511753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:25.511753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:25.511753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:25.511753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:25.511753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:25.511753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:25.511753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:25.511753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:25.511753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:25.511753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:25.511753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:25.511753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:25.513022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:25.513022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:25.513022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:25.513022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:25.513022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:25.513022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:25.513022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:25.513022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:25.513022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:25.513022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:25.513022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:04:25.513022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:25.513022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 188/389] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:04:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:25.527523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa72e39-15c8-4b67-8cc0-bf570b242f67 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:25.535812 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c133d-763a-46cc-9a31-dead1bb90c4a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:25.604564 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af84b2-7267-4693-8acd-6f8d2cd17b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:25.605353 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af84b2-7267-4693-8acd-6f8d2cd17b0f None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:25.605607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af84b2-7267-4693-8acd-6f8d2cd17b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:25.605881 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af84b2-7267-4693-8acd-6f8d2cd17b0f None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:25.609964 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af84b2-7267-4693-8acd-6f8d2cd17b0f None admin] RBAC: Authorizing `identity:create_grant(project_id=844e7dec0aec49598b6b69437d09d460, group_id=f1fe8d72a50b49169c0bdcc6f9e74fb1, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:25.611404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af84b2-7267-4693-8acd-6f8d2cd17b0f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:25.618023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:25.674525 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c133d-763a-46cc-9a31-dead1bb90c4a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:25.712944 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db94ce-41df-41ff-b4b0-4159983dc234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:25.713570 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db94ce-41df-41ff-b4b0-4159983dc234 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:25.713852 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db94ce-41df-41ff-b4b0-4159983dc234 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:25.714131 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db94ce-41df-41ff-b4b0-4159983dc234 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:25.714847 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db94ce-41df-41ff-b4b0-4159983dc234 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:25.715156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db94ce-41df-41ff-b4b0-4159983dc234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:25.716529 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db94ce-41df-41ff-b4b0-4159983dc234 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:25.727580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 202/390] 10.222.0.141 () {58 vars in 1447 bytes} [Tue Jul 26 16:04:25 2022] PUT /identity/v3/projects/844e7dec0aec49598b6b69437d09d460/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:04:25.734055 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 189/391] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:25 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:25.740597 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af84b2-7267-4693-8acd-6f8d2cd17b0f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:25.743656 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:25.866009 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af84b2-7267-4693-8acd-6f8d2cd17b0f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:25.911386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b974d87-b1de-4cfd-9d7d-982ffc0121d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:25.917499 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b974d87-b1de-4cfd-9d7d-982ffc0121d5 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:25.917803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b974d87-b1de-4cfd-9d7d-982ffc0121d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:25.918063 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b974d87-b1de-4cfd-9d7d-982ffc0121d5 None admin] PATH_INFO: `/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:25.926301 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b974d87-b1de-4cfd-9d7d-982ffc0121d5 None admin] RBAC: Authorizing `identity:get_group(group_id=f1fe8d72a50b49169c0bdcc6f9e74fb1)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:25.932961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b974d87-b1de-4cfd-9d7d-982ffc0121d5 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:25.935229 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 203/392] 10.222.0.141 () {56 vars in 1185 bytes} [Tue Jul 26 16:04:25 2022] GET /identity/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1 => generated 227 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:25.941371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db94ce-41df-41ff-b4b0-4159983dc234 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:26.079140 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db94ce-41df-41ff-b4b0-4159983dc234 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:26.089816 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:26.117216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81401aa5-eb2a-4da0-9f12-b3714ae93a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:26.117885 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81401aa5-eb2a-4da0-9f12-b3714ae93a8f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:26.118169 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81401aa5-eb2a-4da0-9f12-b3714ae93a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:26.118446 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81401aa5-eb2a-4da0-9f12-b3714ae93a8f None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:26.119660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81401aa5-eb2a-4da0-9f12-b3714ae93a8f None admin] RBAC: Authorizing `identity:get_project(project_id=844e7dec0aec49598b6b69437d09d460)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:26.121264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81401aa5-eb2a-4da0-9f12-b3714ae93a8f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:26.142016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 190/393] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:25 2022] GET /identity/v3/projects/844e7dec0aec49598b6b69437d09d460 => generated 299 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:26.142164 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b974d87-b1de-4cfd-9d7d-982ffc0121d5 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:26.155834 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f096ae-8960-4a61-a91c-3b2a5e992154 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:26.156123 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f096ae-8960-4a61-a91c-3b2a5e992154 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:26.156407 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f096ae-8960-4a61-a91c-3b2a5e992154 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:26.158154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 191/394] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:26.163713 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71fe3e-ced0-4c77-b045-f60e98c7d993 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:26.164001 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71fe3e-ced0-4c77-b045-f60e98c7d993 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:26.164280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71fe3e-ced0-4c77-b045-f60e98c7d993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:26.186042 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-9f71fe3e-ced0-4c77-b045-f60e98c7d993 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:26.187570 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9f71fe3e-ced0-4c77-b045-f60e98c7d993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:26.329090 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 192/395] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:04:26.348404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:26.352738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71fe3e-ced0-4c77-b045-f60e98c7d993 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:26.409584 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b974d87-b1de-4cfd-9d7d-982ffc0121d5 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:26.472655 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb55c6b-a532-47c5-83d9-6170c1c57098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:26.473369 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb55c6b-a532-47c5-83d9-6170c1c57098 None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:26.473653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb55c6b-a532-47c5-83d9-6170c1c57098 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:26.473927 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb55c6b-a532-47c5-83d9-6170c1c57098 None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1/roles/33fa4ece26464ae98122f3279db92307` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:26.476760 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb55c6b-a532-47c5-83d9-6170c1c57098 None admin] RBAC: Authorizing `identity:create_grant(project_id=844e7dec0aec49598b6b69437d09d460, group_id=f1fe8d72a50b49169c0bdcc6f9e74fb1, role_id=33fa4ece26464ae98122f3279db92307)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:26.478322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb55c6b-a532-47c5-83d9-6170c1c57098 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:26.484896 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71fe3e-ced0-4c77-b045-f60e98c7d993 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:26.500014 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:26.523665 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536c960-728e-4f3a-8a5f-e2f3e46bd863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:26.524321 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536c960-728e-4f3a-8a5f-e2f3e46bd863 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:26.524608 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536c960-728e-4f3a-8a5f-e2f3e46bd863 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:26.524911 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536c960-728e-4f3a-8a5f-e2f3e46bd863 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:26.535835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536c960-728e-4f3a-8a5f-e2f3e46bd863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:26.540839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-4536c960-728e-4f3a-8a5f-e2f3e46bd863 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:26.540839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:26.540839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:26.540839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:26.540839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:26.540839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:26.540839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:26.540839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:26.540839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:26.540839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:26.540839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:26.540839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:26.540839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:26.540839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:26.540839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:26.540839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:26.541707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:26.541707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:26.541707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:26.541707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:26.541707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:26.541707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:26.541707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:26.541707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:26.541707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:26.541707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:26.541707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:26.541707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:26.541707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:26.541707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:26.541707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:26.541707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:26.542613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:26.542613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:26.542613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:26.542613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:26.542613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:26.542613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:26.542613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:26.542613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:26.542613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:26.542613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:26.542613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:26.542613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:26.542613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 193/396] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:04:26.550376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536c960-728e-4f3a-8a5f-e2f3e46bd863 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:26.555751 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 204/397] 10.222.0.141 () {58 vars in 1447 bytes} [Tue Jul 26 16:04:26 2022] PUT /identity/v3/projects/844e7dec0aec49598b6b69437d09d460/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1/roles/33fa4ece26464ae98122f3279db92307 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:04:26.698896 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536c960-728e-4f3a-8a5f-e2f3e46bd863 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:26.736956 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3292491-2c85-4597-b209-228eebd7273c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:26.737637 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3292491-2c85-4597-b209-228eebd7273c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:26.737923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3292491-2c85-4597-b209-228eebd7273c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:26.738206 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3292491-2c85-4597-b209-228eebd7273c None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:26.738946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3292491-2c85-4597-b209-228eebd7273c None admin] RBAC: Adding query filter params (name=member) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:26.739256 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3292491-2c85-4597-b209-228eebd7273c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:26.740779 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3292491-2c85-4597-b209-228eebd7273c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:26.750899 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 194/398] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:04:26 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:26.756874 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb55c6b-a532-47c5-83d9-6170c1c57098 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:26.901964 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb55c6b-a532-47c5-83d9-6170c1c57098 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:26.944482 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:26.950855 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef80a26-4978-40d6-8631-691d35679364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:26.951446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef80a26-4978-40d6-8631-691d35679364 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:26.951727 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef80a26-4978-40d6-8631-691d35679364 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:26.952052 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef80a26-4978-40d6-8631-691d35679364 None admin] PATH_INFO: `/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:26.953229 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef80a26-4978-40d6-8631-691d35679364 None admin] RBAC: Authorizing `identity:get_group(group_id=f1fe8d72a50b49169c0bdcc6f9e74fb1)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:26.958891 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef80a26-4978-40d6-8631-691d35679364 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:26.958891 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 205/399] 10.222.0.141 () {56 vars in 1185 bytes} [Tue Jul 26 16:04:26 2022] GET /identity/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1 => generated 227 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:26.962776 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3292491-2c85-4597-b209-228eebd7273c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:26.996785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:27.030538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b0371-0265-4c68-aa66-7d8e5473f0b5 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:27.030887 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b0371-0265-4c68-aa66-7d8e5473f0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:27.031089 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b0371-0265-4c68-aa66-7d8e5473f0b5 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:27.032439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 206/400] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:04:27.038404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb458dd-a1b2-4309-96de-6de4ad8fe4fc None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:27.038700 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb458dd-a1b2-4309-96de-6de4ad8fe4fc None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:27.038978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb458dd-a1b2-4309-96de-6de4ad8fe4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:27.068588 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-dcb458dd-a1b2-4309-96de-6de4ad8fe4fc None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:27.074600 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dcb458dd-a1b2-4309-96de-6de4ad8fe4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:27.124189 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3292491-2c85-4597-b209-228eebd7273c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:27.195763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e07a0-1564-4b43-aa98-c608f42ba05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:27.196470 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e07a0-1564-4b43-aa98-c608f42ba05e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:27.196781 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e07a0-1564-4b43-aa98-c608f42ba05e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:27.197057 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e07a0-1564-4b43-aa98-c608f42ba05e None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:27.198402 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e07a0-1564-4b43-aa98-c608f42ba05e None admin] RBAC: Authorizing `identity:get_project(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:27.199863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e07a0-1564-4b43-aa98-c608f42ba05e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:27.201622 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 195/401] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:26 2022] GET /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7 => generated 303 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:27.207846 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e07a0-1564-4b43-aa98-c608f42ba05e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:27.218299 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 207/402] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:04:27.252730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb458dd-a1b2-4309-96de-6de4ad8fe4fc None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:27.327011 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:27.330546 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e07a0-1564-4b43-aa98-c608f42ba05e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:27.378454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fbfc2-82a3-4919-ad15-19445e57d15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:27.379147 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fbfc2-82a3-4919-ad15-19445e57d15e None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:27.379483 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fbfc2-82a3-4919-ad15-19445e57d15e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:27.380011 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fbfc2-82a3-4919-ad15-19445e57d15e None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:27.383217 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fbfc2-82a3-4919-ad15-19445e57d15e None admin] RBAC: Authorizing `identity:create_grant(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7, group_id=f1fe8d72a50b49169c0bdcc6f9e74fb1, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:27.385432 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fbfc2-82a3-4919-ad15-19445e57d15e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:27.416223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb458dd-a1b2-4309-96de-6de4ad8fe4fc None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:27.446081 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:27.453970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdff97-382e-4541-95a6-381ff61e032b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:27.454556 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdff97-382e-4541-95a6-381ff61e032b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:27.454840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdff97-382e-4541-95a6-381ff61e032b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:27.455117 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdff97-382e-4541-95a6-381ff61e032b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:27.466201 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdff97-382e-4541-95a6-381ff61e032b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:27.469766 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 196/403] 10.222.0.141 () {58 vars in 1447 bytes} [Tue Jul 26 16:04:27 2022] PUT /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:04:27.471291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-2dfdff97-382e-4541-95a6-381ff61e032b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:04:27.471291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:27.471291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:27.471291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:27.471291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:27.471291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:27.471291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:27.471291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:27.471291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:27.471291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:27.471291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:27.471291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:27.471291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:27.471291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:27.471291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:27.471291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:27.472163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:27.472163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:27.472163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:27.472163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:27.472163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:27.472163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:27.472163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:27.472163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:27.472163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:27.472163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:27.472163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:27.472163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:27.472163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:27.472163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:27.472163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:27.472163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:27.473044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:27.473044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:27.473044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:27.473044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:27.473044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:27.473044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:27.473044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:27.473044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:27.473044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:27.473044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:27.473044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:04:27.473044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:27.473044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 208/404] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:04:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:04:27.476934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826fa7d-f758-4be7-8858-e7adf6978116 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:27.477223 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826fa7d-f758-4be7-8858-e7adf6978116 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:27.477552 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826fa7d-f758-4be7-8858-e7adf6978116 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:27.479414 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 197/405] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:27 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:27.484410 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdff97-382e-4541-95a6-381ff61e032b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:27.490565 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e879d6e-0142-4a5d-ad1e-f9bf62c5e05c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:27.490565 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e879d6e-0142-4a5d-ad1e-f9bf62c5e05c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:27.490565 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e879d6e-0142-4a5d-ad1e-f9bf62c5e05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:27.507609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-9e879d6e-0142-4a5d-ad1e-f9bf62c5e05c None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:27.509494 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9e879d6e-0142-4a5d-ad1e-f9bf62c5e05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:27.594833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 198/406] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:27.626182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e879d6e-0142-4a5d-ad1e-f9bf62c5e05c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:27.715179 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdff97-382e-4541-95a6-381ff61e032b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:27.754999 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8eae2b-71be-4d5e-a80d-4dd9df8d1745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:27.755645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8eae2b-71be-4d5e-a80d-4dd9df8d1745 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:27.755996 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8eae2b-71be-4d5e-a80d-4dd9df8d1745 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:27.756273 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8eae2b-71be-4d5e-a80d-4dd9df8d1745 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:27.757122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8eae2b-71be-4d5e-a80d-4dd9df8d1745 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:27.757430 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8eae2b-71be-4d5e-a80d-4dd9df8d1745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:27.758809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8eae2b-71be-4d5e-a80d-4dd9df8d1745 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:27.760092 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:27.770498 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 209/407] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:27 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:27.778276 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8eae2b-71be-4d5e-a80d-4dd9df8d1745 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:27.781471 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e879d6e-0142-4a5d-ad1e-f9bf62c5e05c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:27.838289 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467397db-8477-4a70-9aa7-2deea631d2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:27.839181 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467397db-8477-4a70-9aa7-2deea631d2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:27.839630 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467397db-8477-4a70-9aa7-2deea631d2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:27.840058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467397db-8477-4a70-9aa7-2deea631d2a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:27.850365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:27.862488 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467397db-8477-4a70-9aa7-2deea631d2a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:27.871934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-467397db-8477-4a70-9aa7-2deea631d2a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:04:27.871934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:27.871934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:27.871934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:27.871934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:27.871934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:27.871934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:27.871934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:27.871934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:27.871934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:27.871934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:27.871934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:27.871934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:27.871934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:27.871934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:27.871934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:27.873175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:27.873175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:27.873175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:27.873175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:27.873175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:27.873175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:27.873175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:27.873175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:27.873175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:27.873175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:27.873175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:27.873175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:27.873175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:27.873175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:27.873175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:27.873175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:27.874156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:27.874156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:27.874156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:27.874156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:27.874156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:27.874156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:27.874156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:27.874156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:27.874156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:27.874156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:27.874156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:04:27.874156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:27.880548 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 199/408] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:04:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:27.884446 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467397db-8477-4a70-9aa7-2deea631d2a9 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:27.956563 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8eae2b-71be-4d5e-a80d-4dd9df8d1745 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:28.016405 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c7ee4-6b46-4537-9fb0-088884be23a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:28.017009 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c7ee4-6b46-4537-9fb0-088884be23a2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:28.017297 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c7ee4-6b46-4537-9fb0-088884be23a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:28.017577 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c7ee4-6b46-4537-9fb0-088884be23a2 None admin] PATH_INFO: `/v3/groups/3d5544a6e86f431eaf16e63688212aec` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:28.025485 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c7ee4-6b46-4537-9fb0-088884be23a2 None admin] RBAC: Authorizing `identity:get_group(group_id=3d5544a6e86f431eaf16e63688212aec)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:28.025738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467397db-8477-4a70-9aa7-2deea631d2a9 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:28.027537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c7ee4-6b46-4537-9fb0-088884be23a2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:28.029239 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 210/409] 10.222.0.141 () {56 vars in 1185 bytes} [Tue Jul 26 16:04:27 2022] GET /identity/v3/groups/3d5544a6e86f431eaf16e63688212aec => generated 230 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:28.044240 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c7ee4-6b46-4537-9fb0-088884be23a2 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:28.074461 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c2ed7-2906-4494-afac-fbcb628c1ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:28.075137 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c2ed7-2906-4494-afac-fbcb628c1ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:28.075422 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c2ed7-2906-4494-afac-fbcb628c1ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:28.075694 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c2ed7-2906-4494-afac-fbcb628c1ce0 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:28.076415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c2ed7-2906-4494-afac-fbcb628c1ce0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:28.077277 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c2ed7-2906-4494-afac-fbcb628c1ce0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:28.079473 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c2ed7-2906-4494-afac-fbcb628c1ce0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:28.089087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 200/410] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:27 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:28.101688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c2ed7-2906-4494-afac-fbcb628c1ce0 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:28.120113 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:28.203697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c7ee4-6b46-4537-9fb0-088884be23a2 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:28.225083 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:28.247487 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c2ed7-2906-4494-afac-fbcb628c1ce0 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:28.251419 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc6291-8062-4156-96c9-0063350d67af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:28.252158 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc6291-8062-4156-96c9-0063350d67af None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:28.252444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc6291-8062-4156-96c9-0063350d67af None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:28.252743 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc6291-8062-4156-96c9-0063350d67af None admin] PATH_INFO: `/v3/projects/a7fee3c27a264e38accf0b43d34d249e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:28.255208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc6291-8062-4156-96c9-0063350d67af None admin] RBAC: Authorizing `identity:get_project(project_id=a7fee3c27a264e38accf0b43d34d249e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:28.256654 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc6291-8062-4156-96c9-0063350d67af None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:28.262996 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 211/411] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:28 2022] GET /identity/v3/projects/a7fee3c27a264e38accf0b43d34d249e => generated 345 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:28.266049 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc6291-8062-4156-96c9-0063350d67af None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:28.316706 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728455c3-ac65-4157-8fea-38e9d85d8f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:28.319300 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728455c3-ac65-4157-8fea-38e9d85d8f71 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:28.319585 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728455c3-ac65-4157-8fea-38e9d85d8f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:28.319861 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728455c3-ac65-4157-8fea-38e9d85d8f71 None admin] PATH_INFO: `/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:28.321706 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728455c3-ac65-4157-8fea-38e9d85d8f71 None admin] RBAC: Authorizing `identity:get_group(group_id=f1fe8d72a50b49169c0bdcc6f9e74fb1)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:28.323147 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728455c3-ac65-4157-8fea-38e9d85d8f71 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:28.324886 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 201/412] 10.222.0.141 () {56 vars in 1185 bytes} [Tue Jul 26 16:04:28 2022] GET /identity/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1 => generated 227 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:28.326045 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89785c-7113-48e9-9ff5-f27247e041f8 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:28.326336 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89785c-7113-48e9-9ff5-f27247e041f8 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:28.326609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89785c-7113-48e9-9ff5-f27247e041f8 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:28.327937 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 202/413] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:28.332463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89785c-7113-48e9-9ff5-f27247e041f8 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:28.418985 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc6291-8062-4156-96c9-0063350d67af None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:28.425552 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:28.441506 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89785c-7113-48e9-9ff5-f27247e041f8 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:28.460577 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f11ff-0184-4377-a275-7b7aea2d5858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:28.461297 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f11ff-0184-4377-a275-7b7aea2d5858 None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:28.461635 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f11ff-0184-4377-a275-7b7aea2d5858 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:28.461916 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f11ff-0184-4377-a275-7b7aea2d5858 None admin] PATH_INFO: `/v3/projects/a7fee3c27a264e38accf0b43d34d249e/groups/3d5544a6e86f431eaf16e63688212aec/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:28.463949 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f11ff-0184-4377-a275-7b7aea2d5858 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7fee3c27a264e38accf0b43d34d249e, group_id=3d5544a6e86f431eaf16e63688212aec, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:28.465522 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f11ff-0184-4377-a275-7b7aea2d5858 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:28.479924 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285c5cc-e3b9-4e99-9375-42990a697b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:28.480760 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285c5cc-e3b9-4e99-9375-42990a697b6a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:28.481423 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285c5cc-e3b9-4e99-9375-42990a697b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:28.485831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285c5cc-e3b9-4e99-9375-42990a697b6a None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:28.485831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285c5cc-e3b9-4e99-9375-42990a697b6a None admin] RBAC: Authorizing `identity:get_project(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:28.485831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285c5cc-e3b9-4e99-9375-42990a697b6a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:28.492216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 203/414] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:28 2022] GET /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7 => generated 303 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:28.492216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6431f-735f-4aa8-a43c-1295d4a5705c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:28.492216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6431f-735f-4aa8-a43c-1295d4a5705c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:28.492216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6431f-735f-4aa8-a43c-1295d4a5705c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:28.509009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-cbe6431f-735f-4aa8-a43c-1295d4a5705c None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:28.510292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-cbe6431f-735f-4aa8-a43c-1295d4a5705c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:28.553563 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 212/415] 10.222.0.141 () {58 vars in 1447 bytes} [Tue Jul 26 16:04:28 2022] PUT /identity/v3/projects/a7fee3c27a264e38accf0b43d34d249e/groups/3d5544a6e86f431eaf16e63688212aec/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:04:28.554822 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f11ff-0184-4377-a275-7b7aea2d5858 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:28.607350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 204/416] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:28.620209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:28.688920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6431f-735f-4aa8-a43c-1295d4a5705c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:28.700028 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f11ff-0184-4377-a275-7b7aea2d5858 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:28.740514 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a978cf-1762-4ecf-8d5c-b14b73ab1dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:28.741389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a978cf-1762-4ecf-8d5c-b14b73ab1dc2 None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:28.741678 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a978cf-1762-4ecf-8d5c-b14b73ab1dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:28.741954 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a978cf-1762-4ecf-8d5c-b14b73ab1dc2 None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1/roles/33fa4ece26464ae98122f3279db92307` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:28.744824 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a978cf-1762-4ecf-8d5c-b14b73ab1dc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7, group_id=f1fe8d72a50b49169c0bdcc6f9e74fb1, role_id=33fa4ece26464ae98122f3279db92307)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:28.746788 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a978cf-1762-4ecf-8d5c-b14b73ab1dc2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:28.820693 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:28.821132 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 213/417] 10.222.0.141 () {58 vars in 1447 bytes} [Tue Jul 26 16:04:28 2022] PUT /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1/roles/33fa4ece26464ae98122f3279db92307 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:04:28.849901 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6431f-735f-4aa8-a43c-1295d4a5705c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:28.888313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbbaf0-fa6f-41c1-a926-fc42ca829775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:28.889104 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbbaf0-fa6f-41c1-a926-fc42ca829775 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:28.889436 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbbaf0-fa6f-41c1-a926-fc42ca829775 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:28.889762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbbaf0-fa6f-41c1-a926-fc42ca829775 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:28.913905 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbbaf0-fa6f-41c1-a926-fc42ca829775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:28.919312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-cbcbbaf0-fa6f-41c1-a926-fc42ca829775 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:28.919312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:28.919312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:28.919312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:28.919312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:28.919312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:28.919312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:28.919312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:28.919312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:28.919312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:28.919312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:28.919312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:28.919312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:28.919312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:28.919312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:28.919312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:28.920164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:28.920164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:28.920164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:28.920164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:28.920164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:28.920164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:28.920164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:28.920164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:28.920164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:28.920164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:28.920164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:28.920164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:28.920164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:28.920164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:28.920164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:28.920164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:28.920960 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:28.920960 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:28.920960 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:28.920960 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:28.920960 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:28.920960 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:28.920960 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:28.920960 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:28.920960 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:28.920960 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:28.920960 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:28.920960 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:28.928617 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 205/418] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:04:28.930360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a978cf-1762-4ecf-8d5c-b14b73ab1dc2 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:29.049019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a978cf-1762-4ecf-8d5c-b14b73ab1dc2 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:29.060994 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:29.091879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a2263-157b-47f8-b8e4-5bb17f4cd755 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:29.092403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a2263-157b-47f8-b8e4-5bb17f4cd755 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:29.092477 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a2263-157b-47f8-b8e4-5bb17f4cd755 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:29.093977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 206/419] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:04:29.097546 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b03010-ca7c-46fb-8def-2a04426e745a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:29.098421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b03010-ca7c-46fb-8def-2a04426e745a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:29.098905 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b03010-ca7c-46fb-8def-2a04426e745a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:29.099340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b03010-ca7c-46fb-8def-2a04426e745a None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:29.099990 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3024a8b-9fce-483b-814a-1a50e5aca16c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:29.100281 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3024a8b-9fce-483b-814a-1a50e5aca16c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:29.100559 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3024a8b-9fce-483b-814a-1a50e5aca16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:29.100759 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b03010-ca7c-46fb-8def-2a04426e745a None admin] RBAC: Adding query filter params (name=member) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:29.101220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b03010-ca7c-46fb-8def-2a04426e745a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:29.102741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b03010-ca7c-46fb-8def-2a04426e745a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:29.116765 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 214/420] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:04:28 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:29.119293 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b03010-ca7c-46fb-8def-2a04426e745a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:29.120599 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b3024a8b-9fce-483b-814a-1a50e5aca16c None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:29.121836 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b3024a8b-9fce-483b-814a-1a50e5aca16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:29.204171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 207/421] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:29.237205 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b03010-ca7c-46fb-8def-2a04426e745a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:29.261751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3024a8b-9fce-483b-814a-1a50e5aca16c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:29.273956 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03ba9e-b70d-45cc-bf3e-3bbdf3b0737a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:29.274595 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03ba9e-b70d-45cc-bf3e-3bbdf3b0737a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:29.274871 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03ba9e-b70d-45cc-bf3e-3bbdf3b0737a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:29.275766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03ba9e-b70d-45cc-bf3e-3bbdf3b0737a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:29.321295 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:29.347557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03ba9e-b70d-45cc-bf3e-3bbdf3b0737a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:29.356795 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03ba9e-b70d-45cc-bf3e-3bbdf3b0737a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:29.395329 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:29.457274 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 215/422] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:29 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 16:04:29.463047 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03ba9e-b70d-45cc-bf3e-3bbdf3b0737a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:29.482542 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3024a8b-9fce-483b-814a-1a50e5aca16c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:29.548237 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae3462-c020-42da-9d66-9003ea77036a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:29.548925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae3462-c020-42da-9d66-9003ea77036a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:29.549209 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae3462-c020-42da-9d66-9003ea77036a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:29.549487 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae3462-c020-42da-9d66-9003ea77036a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:29.570951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae3462-c020-42da-9d66-9003ea77036a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:29.576457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-5cae3462-c020-42da-9d66-9003ea77036a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:04:29.576457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:29.576457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:29.576457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:29.576457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:29.576457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:29.576457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:29.576457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:29.576457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:29.576457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:29.576457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:29.576457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:29.576457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:29.576457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:29.576457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:29.576457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:29.577353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:29.577353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:29.577353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:29.577353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:29.577353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:29.577353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:29.577353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:29.577353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:29.577353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:29.577353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:29.577353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:29.577353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:29.577353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:29.577353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:29.577353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:29.577353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:29.578589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:29.578589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:29.578589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:29.578589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:29.578589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:29.578589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:29.578589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:29.578589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:29.578589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:29.578589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:29.578589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:04:29.578589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:29.578589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 208/423] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:04:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:29.585312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae3462-c020-42da-9d66-9003ea77036a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:29.589030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:29.647357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03ba9e-b70d-45cc-bf3e-3bbdf3b0737a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:29.716768 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912b541-672e-4179-b939-dc806db2b219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:29.716768 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912b541-672e-4179-b939-dc806db2b219 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:29.716768 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912b541-672e-4179-b939-dc806db2b219 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:29.716768 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912b541-672e-4179-b939-dc806db2b219 None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:29.717140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912b541-672e-4179-b939-dc806db2b219 None admin] RBAC: Authorizing `identity:get_project(project_id=844e7dec0aec49598b6b69437d09d460)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:29.718981 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912b541-672e-4179-b939-dc806db2b219 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:29.722392 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 216/424] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:29 2022] GET /identity/v3/projects/844e7dec0aec49598b6b69437d09d460 => generated 299 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:29.733559 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912b541-672e-4179-b939-dc806db2b219 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:29.755089 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae3462-c020-42da-9d66-9003ea77036a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:29.801025 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:29.815884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88932ab-b550-451e-84b8-78696c792479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:29.816851 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88932ab-b550-451e-84b8-78696c792479 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:29.817767 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88932ab-b550-451e-84b8-78696c792479 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:29.817767 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88932ab-b550-451e-84b8-78696c792479 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:29.818573 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88932ab-b550-451e-84b8-78696c792479 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:29.820372 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88932ab-b550-451e-84b8-78696c792479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:29.821967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88932ab-b550-451e-84b8-78696c792479 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:29.840471 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 209/425] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:29 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:29.843796 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88932ab-b550-451e-84b8-78696c792479 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:29.919752 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912b541-672e-4179-b939-dc806db2b219 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:29.977785 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a481571-4f89-4de4-a42f-8cec458c14a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:29.978456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a481571-4f89-4de4-a42f-8cec458c14a9 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:29.978796 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a481571-4f89-4de4-a42f-8cec458c14a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:29.979133 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a481571-4f89-4de4-a42f-8cec458c14a9 None admin] PATH_INFO: `/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:29.980469 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a481571-4f89-4de4-a42f-8cec458c14a9 None admin] RBAC: Authorizing `identity:get_group(group_id=f1fe8d72a50b49169c0bdcc6f9e74fb1)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:29.982137 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a481571-4f89-4de4-a42f-8cec458c14a9 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:29.983797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 217/426] 10.222.0.141 () {56 vars in 1185 bytes} [Tue Jul 26 16:04:29 2022] GET /identity/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1 => generated 227 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:29.988599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74d685-8523-4bbf-b924-9de6d47295e0 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:29.988599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74d685-8523-4bbf-b924-9de6d47295e0 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:29.988599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74d685-8523-4bbf-b924-9de6d47295e0 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:29.991607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 218/427] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:29.993019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b272e-9565-4f75-852c-02bac644edde None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:29.993264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b272e-9565-4f75-852c-02bac644edde None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:29.993541 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b272e-9565-4f75-852c-02bac644edde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:30.002266 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:30.015019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a54b272e-9565-4f75-852c-02bac644edde None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:30.017952 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88932ab-b550-451e-84b8-78696c792479 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:30.018055 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a54b272e-9565-4f75-852c-02bac644edde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:30.056250 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd7f5c-696d-4c81-917f-7dde16e1d1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:30.058015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd7f5c-696d-4c81-917f-7dde16e1d1de None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:30.058507 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd7f5c-696d-4c81-917f-7dde16e1d1de None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:30.058953 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd7f5c-696d-4c81-917f-7dde16e1d1de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:30.097125 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 219/428] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:30.098088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b272e-9565-4f75-852c-02bac644edde None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:30.123887 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:30.141317 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd7f5c-696d-4c81-917f-7dde16e1d1de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:30.142808 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd7f5c-696d-4c81-917f-7dde16e1d1de None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:30.241902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b272e-9565-4f75-852c-02bac644edde None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:30.249901 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 210/429] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:29 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:30.250735 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd7f5c-696d-4c81-917f-7dde16e1d1de None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:30.287231 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d68a47-4b69-4b43-9d3c-5f3a83e63725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:30.288824 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d68a47-4b69-4b43-9d3c-5f3a83e63725 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:30.289133 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d68a47-4b69-4b43-9d3c-5f3a83e63725 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:30.289410 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d68a47-4b69-4b43-9d3c-5f3a83e63725 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:30.290234 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d68a47-4b69-4b43-9d3c-5f3a83e63725 None admin] RBAC: Adding query filter params (group.id=f1fe8d72a50b49169c0bdcc6f9e74fb1, role.id=61321ad01e84416981d4c7208c55bbe7, scope.project.id=844e7dec0aec49598b6b69437d09d460) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:30.290547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d68a47-4b69-4b43-9d3c-5f3a83e63725 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:30.293149 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d68a47-4b69-4b43-9d3c-5f3a83e63725 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:30.295485 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:30.306444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 220/430] 10.222.0.141 () {56 vars in 1381 bytes} [Tue Jul 26 16:04:30 2022] GET /identity/v3/role_assignments?group.id=f1fe8d72a50b49169c0bdcc6f9e74fb1&scope.project.id=844e7dec0aec49598b6b69437d09d460&role.id=61321ad01e84416981d4c7208c55bbe7 => generated 613 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:30.306444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d68a47-4b69-4b43-9d3c-5f3a83e63725 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:30.420130 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:30.447665 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd7f5c-696d-4c81-917f-7dde16e1d1de None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:30.508115 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d68a47-4b69-4b43-9d3c-5f3a83e63725 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:30.512214 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a9bf9-82bc-4021-a3f1-9e8b9697e458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:30.513177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a9bf9-82bc-4021-a3f1-9e8b9697e458 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:30.513657 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a9bf9-82bc-4021-a3f1-9e8b9697e458 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:30.514140 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a9bf9-82bc-4021-a3f1-9e8b9697e458 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:30.530762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a9bf9-82bc-4021-a3f1-9e8b9697e458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:30.537972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-c64a9bf9-82bc-4021-a3f1-9e8b9697e458 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:30.537972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:30.537972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:30.537972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:30.537972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:30.537972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:30.537972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:30.537972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:30.537972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:30.537972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:30.537972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:30.537972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:30.537972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:30.537972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:30.537972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:30.537972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:30.538831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:30.538831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:30.538831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:30.538831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:30.538831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:30.538831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:30.538831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:30.538831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:30.538831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:30.538831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:30.538831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:30.538831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:30.538831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:30.538831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:30.538831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:30.538831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:30.539594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:30.539594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:30.539594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:30.539594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:30.539594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:30.539594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:30.539594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:30.539594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:30.539594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:30.539594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:30.539594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 16:04:30.539594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:30.542230 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 211/431] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:30.550983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a9bf9-82bc-4021-a3f1-9e8b9697e458 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:30.556947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfe70e-ab4a-4ff7-8113-1907ee719037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:30.557605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfe70e-ab4a-4ff7-8113-1907ee719037 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:30.557890 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfe70e-ab4a-4ff7-8113-1907ee719037 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:30.558168 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfe70e-ab4a-4ff7-8113-1907ee719037 None admin] PATH_INFO: `/v3/projects/844e7dec0aec49598b6b69437d09d460` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:30.560258 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfe70e-ab4a-4ff7-8113-1907ee719037 None admin] RBAC: Authorizing `identity:get_project(project_id=844e7dec0aec49598b6b69437d09d460)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:30.561728 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfe70e-ab4a-4ff7-8113-1907ee719037 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:30.563699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 221/432] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:30 2022] GET /identity/v3/projects/844e7dec0aec49598b6b69437d09d460 => generated 299 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:30.571190 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfe70e-ab4a-4ff7-8113-1907ee719037 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:30.645707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:30.668589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a9bf9-82bc-4021-a3f1-9e8b9697e458 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:30.682064 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfe70e-ab4a-4ff7-8113-1907ee719037 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:30.708544 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8514c-28ec-40a9-afbb-c899c2767c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:30.709459 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8514c-28ec-40a9-afbb-c899c2767c1e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:30.709841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8514c-28ec-40a9-afbb-c899c2767c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:30.710217 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8514c-28ec-40a9-afbb-c899c2767c1e None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:30.711138 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8514c-28ec-40a9-afbb-c899c2767c1e None admin] RBAC: Adding query filter params (name=member) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:30.711541 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8514c-28ec-40a9-afbb-c899c2767c1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:30.713133 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8514c-28ec-40a9-afbb-c899c2767c1e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:30.719813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2e963-7b15-438a-9d92-57efb5a81945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:30.720464 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2e963-7b15-438a-9d92-57efb5a81945 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:30.720777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2e963-7b15-438a-9d92-57efb5a81945 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:30.721057 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2e963-7b15-438a-9d92-57efb5a81945 None admin] PATH_INFO: `/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:30.722268 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2e963-7b15-438a-9d92-57efb5a81945 None admin] RBAC: Authorizing `identity:get_group(group_id=f1fe8d72a50b49169c0bdcc6f9e74fb1)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:30.722964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 212/433] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:04:30 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:30.723732 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2e963-7b15-438a-9d92-57efb5a81945 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:30.729789 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 222/434] 10.222.0.141 () {56 vars in 1185 bytes} [Tue Jul 26 16:04:30 2022] GET /identity/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1 => generated 227 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:30.733744 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8514c-28ec-40a9-afbb-c899c2767c1e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:30.736099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2e963-7b15-438a-9d92-57efb5a81945 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:30.748105 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:30.860224 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8514c-28ec-40a9-afbb-c899c2767c1e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:30.870527 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2e963-7b15-438a-9d92-57efb5a81945 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:30.906320 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ef505-bb63-4340-9a4d-158777e7c7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:30.906950 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ef505-bb63-4340-9a4d-158777e7c7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:30.907237 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ef505-bb63-4340-9a4d-158777e7c7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:30.907515 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ef505-bb63-4340-9a4d-158777e7c7c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:30.909954 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec57ef7-1839-4c0f-8c21-b72aa298b502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:30.910862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec57ef7-1839-4c0f-8c21-b72aa298b502 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:30.913368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec57ef7-1839-4c0f-8c21-b72aa298b502 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:30.913879 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec57ef7-1839-4c0f-8c21-b72aa298b502 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:30.914888 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec57ef7-1839-4c0f-8c21-b72aa298b502 None admin] RBAC: Adding query filter params (group.id=f1fe8d72a50b49169c0bdcc6f9e74fb1, role.id=33fa4ece26464ae98122f3279db92307, scope.project.id=844e7dec0aec49598b6b69437d09d460) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:30.915384 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec57ef7-1839-4c0f-8c21-b72aa298b502 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:30.917865 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec57ef7-1839-4c0f-8c21-b72aa298b502 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:30.920353 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:30.926724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 223/435] 10.222.0.141 () {56 vars in 1381 bytes} [Tue Jul 26 16:04:30 2022] GET /identity/v3/role_assignments?group.id=f1fe8d72a50b49169c0bdcc6f9e74fb1&scope.project.id=844e7dec0aec49598b6b69437d09d460&role.id=33fa4ece26464ae98122f3279db92307 => generated 613 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:30.992633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ef505-bb63-4340-9a4d-158777e7c7c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:30.994439 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ef505-bb63-4340-9a4d-158777e7c7c0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:31.001901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8dd3c-9fa1-4b8f-8814-901a6b7d867e None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:31.002189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8dd3c-9fa1-4b8f-8814-901a6b7d867e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:31.002473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8dd3c-9fa1-4b8f-8814-901a6b7d867e None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:31.008347 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 224/436] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:04:31.009956 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:31.010079 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d531c-1fc4-4500-afba-58295c796c49 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:31.010248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d531c-1fc4-4500-afba-58295c796c49 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:31.010530 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d531c-1fc4-4500-afba-58295c796c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:31.033361 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c09d531c-1fc4-4500-afba-58295c796c49 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:31.035222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c09d531c-1fc4-4500-afba-58295c796c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:31.124045 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 225/437] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:04:31.132685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 213/438] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:30 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:31.136330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d531c-1fc4-4500-afba-58295c796c49 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:31.144869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ef505-bb63-4340-9a4d-158777e7c7c0 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:31.265696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d531c-1fc4-4500-afba-58295c796c49 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:31.280156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ef505-bb63-4340-9a4d-158777e7c7c0 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:31.293543 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:31.297843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:31.307646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50acf11-60c0-42be-a6bb-af78c6cc2882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:31.308295 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50acf11-60c0-42be-a6bb-af78c6cc2882 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:31.310318 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50acf11-60c0-42be-a6bb-af78c6cc2882 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:31.310318 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50acf11-60c0-42be-a6bb-af78c6cc2882 None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:31.310471 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50acf11-60c0-42be-a6bb-af78c6cc2882 None admin] RBAC: Authorizing `identity:get_project(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:31.311790 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50acf11-60c0-42be-a6bb-af78c6cc2882 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:31.313981 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 226/439] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:31 2022] GET /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7 => generated 303 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:31.316696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a3b2a-2ba6-45b4-a123-6c86fbeb1f32 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:31.316696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a3b2a-2ba6-45b4-a123-6c86fbeb1f32 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:31.316696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a3b2a-2ba6-45b4-a123-6c86fbeb1f32 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:31.321458 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 227/440] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:31 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:31.322788 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a3b2a-2ba6-45b4-a123-6c86fbeb1f32 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:31.324507 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2a5f7-9894-423c-863b-7d061c468827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:31.325359 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2a5f7-9894-423c-863b-7d061c468827 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:31.325750 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2a5f7-9894-423c-863b-7d061c468827 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:31.326028 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2a5f7-9894-423c-863b-7d061c468827 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:31.340895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2a5f7-9894-423c-863b-7d061c468827 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:31.346340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-e4c2a5f7-9894-423c-863b-7d061c468827 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:04:31.346340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:31.346340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:31.346340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:31.346340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:31.346340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:31.346340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:31.346340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:31.346340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:31.346340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:31.346340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:31.346340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:31.346340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:31.346340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:31.346340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:31.346340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:31.347177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:31.347177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:31.347177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:31.347177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:31.347177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:31.347177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:31.347177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:31.347177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:31.347177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:31.347177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:31.347177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:31.347177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:31.347177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:31.347177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:31.347177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:31.347177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:31.348039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:31.348039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:31.348039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:31.348039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:31.348039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:31.348039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:31.348039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:31.348039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:31.348039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:31.348039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:31.348039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:04:31.348039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:31.348039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 214/441] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:04:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:31.348791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd5856-c641-46f9-9be6-fa7ef6897ce3 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:31.349011 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd5856-c641-46f9-9be6-fa7ef6897ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:31.349288 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd5856-c641-46f9-9be6-fa7ef6897ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:31.369387 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c1dd5856-c641-46f9-9be6-fa7ef6897ce3 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:31.371420 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c1dd5856-c641-46f9-9be6-fa7ef6897ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:31.449287 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a3b2a-2ba6-45b4-a123-6c86fbeb1f32 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:31.450634 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 215/442] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:31.451497 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd5856-c641-46f9-9be6-fa7ef6897ce3 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:31.486764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a09c51-8dd9-4d44-9049-a27a69befaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:31.487441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a09c51-8dd9-4d44-9049-a27a69befaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:31.487719 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a09c51-8dd9-4d44-9049-a27a69befaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:31.487991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a09c51-8dd9-4d44-9049-a27a69befaf2 None admin] PATH_INFO: `/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:31.489145 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a09c51-8dd9-4d44-9049-a27a69befaf2 None admin] RBAC: Authorizing `identity:get_group(group_id=f1fe8d72a50b49169c0bdcc6f9e74fb1)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:31.490755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a09c51-8dd9-4d44-9049-a27a69befaf2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:31.492352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 228/443] 10.222.0.141 () {56 vars in 1185 bytes} [Tue Jul 26 16:04:31 2022] GET /identity/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1 => generated 227 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:31.493218 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a09c51-8dd9-4d44-9049-a27a69befaf2 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:31.554671 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:31.555754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:31.558418 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd5856-c641-46f9-9be6-fa7ef6897ce3 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:31.591305 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e0a53-59f9-4dde-94d8-ef960c4504fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:31.591925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e0a53-59f9-4dde-94d8-ef960c4504fb None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:31.592156 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a09c51-8dd9-4d44-9049-a27a69befaf2 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:31.592276 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e0a53-59f9-4dde-94d8-ef960c4504fb None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:31.592473 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e0a53-59f9-4dde-94d8-ef960c4504fb None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:31.593250 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e0a53-59f9-4dde-94d8-ef960c4504fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:31.593557 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e0a53-59f9-4dde-94d8-ef960c4504fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:31.594929 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e0a53-59f9-4dde-94d8-ef960c4504fb None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:31.602951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 216/444] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:31 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:31.603733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e0a53-59f9-4dde-94d8-ef960c4504fb None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:31.625273 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01601a8-9b6b-4291-84ad-539c21def49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:31.625908 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01601a8-9b6b-4291-84ad-539c21def49a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:31.626190 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01601a8-9b6b-4291-84ad-539c21def49a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:31.626465 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01601a8-9b6b-4291-84ad-539c21def49a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:31.637607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01601a8-9b6b-4291-84ad-539c21def49a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:31.643040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-b01601a8-9b6b-4291-84ad-539c21def49a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:04:31.643040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:31.643040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:31.643040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:31.643040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:31.643040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:31.643040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:31.643040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:31.643040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:31.643040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:31.643040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:31.643040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:31.643040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:31.643040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:31.643040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:31.643040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:31.643952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:31.643952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:31.643952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:31.643952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:31.643952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:31.643952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:31.643952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:31.643952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:31.643952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:31.643952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:31.643952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:31.643952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:31.643952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:31.643952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:31.643952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:31.643952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:31.644771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:31.644771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:31.644771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:31.644771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:31.644771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:31.644771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:31.644771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:31.644771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:31.644771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:31.644771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:31.644771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:04:31.644771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:31.644771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 229/445] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:04:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:31.645415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01601a8-9b6b-4291-84ad-539c21def49a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:31.707492 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e0a53-59f9-4dde-94d8-ef960c4504fb None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:31.740080 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c265955-87c7-4958-bb63-77f28d849c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:31.740712 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c265955-87c7-4958-bb63-77f28d849c8e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:31.740997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c265955-87c7-4958-bb63-77f28d849c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:31.741098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01601a8-9b6b-4291-84ad-539c21def49a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:31.741272 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c265955-87c7-4958-bb63-77f28d849c8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:31.742102 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c265955-87c7-4958-bb63-77f28d849c8e None admin] RBAC: Adding query filter params (group.id=f1fe8d72a50b49169c0bdcc6f9e74fb1, role.id=61321ad01e84416981d4c7208c55bbe7, scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:31.742419 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c265955-87c7-4958-bb63-77f28d849c8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:31.743846 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c265955-87c7-4958-bb63-77f28d849c8e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:31.749491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 217/446] 10.222.0.141 () {56 vars in 1381 bytes} [Tue Jul 26 16:04:31 2022] GET /identity/v3/role_assignments?group.id=f1fe8d72a50b49169c0bdcc6f9e74fb1&scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7&role.id=61321ad01e84416981d4c7208c55bbe7 => generated 613 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:31.750255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c265955-87c7-4958-bb63-77f28d849c8e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:31.765728 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:31.778720 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:31.779074 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8cc531-1d0c-4c1c-a319-58a50ef1d5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:31.779704 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cc531-1d0c-4c1c-a319-58a50ef1d5ad None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:31.779984 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cc531-1d0c-4c1c-a319-58a50ef1d5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:31.780255 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cc531-1d0c-4c1c-a319-58a50ef1d5ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:31.859817 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c265955-87c7-4958-bb63-77f28d849c8e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:31.860478 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8cc531-1d0c-4c1c-a319-58a50ef1d5ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:31.862512 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8cc531-1d0c-4c1c-a319-58a50ef1d5ad None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:31.902766 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f05d1-74e4-4a33-bfa2-6bca568fb326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:31.902766 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f05d1-74e4-4a33-bfa2-6bca568fb326 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:31.902766 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f05d1-74e4-4a33-bfa2-6bca568fb326 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:31.903079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f05d1-74e4-4a33-bfa2-6bca568fb326 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:31.903655 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f05d1-74e4-4a33-bfa2-6bca568fb326 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:31.904596 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f05d1-74e4-4a33-bfa2-6bca568fb326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:31.905390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f05d1-74e4-4a33-bfa2-6bca568fb326 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:31.916537 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 218/447] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:31 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:31.922240 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f05d1-74e4-4a33-bfa2-6bca568fb326 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:31.989566 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 230/448] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:31 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:31.995984 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8cc531-1d0c-4c1c-a319-58a50ef1d5ad None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:32.020924 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:32.025980 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:32.037295 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f05d1-74e4-4a33-bfa2-6bca568fb326 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:32.077351 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3ccc1-b883-4145-a245-229afed94e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:32.077974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3ccc1-b883-4145-a245-229afed94e33 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:32.078260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3ccc1-b883-4145-a245-229afed94e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:32.078540 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3ccc1-b883-4145-a245-229afed94e33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:32.118454 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8cc531-1d0c-4c1c-a319-58a50ef1d5ad None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:32.152681 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4f590-80c2-41c3-846c-764d3732de0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:32.153324 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3ccc1-b883-4145-a245-229afed94e33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:32.153678 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4f590-80c2-41c3-846c-764d3732de0a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:32.153678 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4f590-80c2-41c3-846c-764d3732de0a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:32.153857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4f590-80c2-41c3-846c-764d3732de0a None admin] PATH_INFO: `/v3/projects/a7fee3c27a264e38accf0b43d34d249e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:32.154234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3ccc1-b883-4145-a245-229afed94e33 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:32.155092 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4f590-80c2-41c3-846c-764d3732de0a None admin] RBAC: Authorizing `identity:get_project(project_id=a7fee3c27a264e38accf0b43d34d249e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:32.156508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4f590-80c2-41c3-846c-764d3732de0a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:32.158191 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 231/449] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:31 2022] GET /identity/v3/projects/a7fee3c27a264e38accf0b43d34d249e => generated 345 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:32.163589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4f590-80c2-41c3-846c-764d3732de0a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:32.235712 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:32.251033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 219/450] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:31 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 16:04:32.252467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:32.256838 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3ccc1-b883-4145-a245-229afed94e33 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:32.263198 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4f590-80c2-41c3-846c-764d3732de0a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:32.296066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a60072-c200-4b78-8a1d-d455b1605a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:32.296733 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a60072-c200-4b78-8a1d-d455b1605a7a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:32.297015 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a60072-c200-4b78-8a1d-d455b1605a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:32.297300 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a60072-c200-4b78-8a1d-d455b1605a7a None admin] PATH_INFO: `/v3/groups/3d5544a6e86f431eaf16e63688212aec` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:32.298685 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a60072-c200-4b78-8a1d-d455b1605a7a None admin] RBAC: Authorizing `identity:get_group(group_id=3d5544a6e86f431eaf16e63688212aec)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:32.300137 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a60072-c200-4b78-8a1d-d455b1605a7a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:32.301751 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 232/451] 10.222.0.141 () {56 vars in 1185 bytes} [Tue Jul 26 16:04:32 2022] GET /identity/v3/groups/3d5544a6e86f431eaf16e63688212aec => generated 230 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:32.307440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a60072-c200-4b78-8a1d-d455b1605a7a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:32.354807 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3ccc1-b883-4145-a245-229afed94e33 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:32.390413 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105788e5-4589-4eea-8462-98724f46a674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:32.391058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105788e5-4589-4eea-8462-98724f46a674 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:32.391343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105788e5-4589-4eea-8462-98724f46a674 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:32.391622 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105788e5-4589-4eea-8462-98724f46a674 None admin] PATH_INFO: `/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:32.392808 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105788e5-4589-4eea-8462-98724f46a674 None admin] RBAC: Authorizing `identity:get_project(project_id=6346eda2635c45f9bf2e6ed6fa0c9ad7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:32.394272 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105788e5-4589-4eea-8462-98724f46a674 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:32.395916 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 220/452] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:04:32 2022] GET /identity/v3/projects/6346eda2635c45f9bf2e6ed6fa0c9ad7 => generated 303 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:32.401224 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105788e5-4589-4eea-8462-98724f46a674 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:32.405390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a60072-c200-4b78-8a1d-d455b1605a7a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:32.439454 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ac2ce-b395-40d8-8f79-df3f3d8f3914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:32.440058 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ac2ce-b395-40d8-8f79-df3f3d8f3914 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:32.440969 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ac2ce-b395-40d8-8f79-df3f3d8f3914 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:32.441357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ac2ce-b395-40d8-8f79-df3f3d8f3914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:32.442135 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ac2ce-b395-40d8-8f79-df3f3d8f3914 None admin] RBAC: Adding query filter params (group.id=3d5544a6e86f431eaf16e63688212aec, role.id=94ecbd6c86a84b75bdb0c57fc27a9a07, scope.project.id=a7fee3c27a264e38accf0b43d34d249e) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:32.442438 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ac2ce-b395-40d8-8f79-df3f3d8f3914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:32.443851 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ac2ce-b395-40d8-8f79-df3f3d8f3914 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:32.449680 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 233/453] 10.222.0.141 () {56 vars in 1381 bytes} [Tue Jul 26 16:04:32 2022] GET /identity/v3/role_assignments?group.id=3d5544a6e86f431eaf16e63688212aec&scope.project.id=a7fee3c27a264e38accf0b43d34d249e&role.id=94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 613 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:32.457066 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:32.505006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105788e5-4589-4eea-8462-98724f46a674 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:32.539913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e804edd-46ce-433f-b418-f189c2720f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:32.540598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e804edd-46ce-433f-b418-f189c2720f7b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:32.540899 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e804edd-46ce-433f-b418-f189c2720f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:32.541171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e804edd-46ce-433f-b418-f189c2720f7b None admin] PATH_INFO: `/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:32.542374 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e804edd-46ce-433f-b418-f189c2720f7b None admin] RBAC: Authorizing `identity:get_group(group_id=f1fe8d72a50b49169c0bdcc6f9e74fb1)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:32.543860 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e804edd-46ce-433f-b418-f189c2720f7b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:32.545516 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 221/454] 10.222.0.141 () {56 vars in 1185 bytes} [Tue Jul 26 16:04:32 2022] GET /identity/v3/groups/f1fe8d72a50b49169c0bdcc6f9e74fb1 => generated 227 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:32.552218 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ac2ce-b395-40d8-8f79-df3f3d8f3914 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:32.579066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:32.654624 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ac2ce-b395-40d8-8f79-df3f3d8f3914 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:32.686966 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf70ec-1274-4059-8ad6-35716f500a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:32.687573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf70ec-1274-4059-8ad6-35716f500a8b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:32.687854 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf70ec-1274-4059-8ad6-35716f500a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:32.688129 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf70ec-1274-4059-8ad6-35716f500a8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:32.688930 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf70ec-1274-4059-8ad6-35716f500a8b None admin] RBAC: Adding query filter params (group.id=f1fe8d72a50b49169c0bdcc6f9e74fb1, role.id=33fa4ece26464ae98122f3279db92307, scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:32.689241 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf70ec-1274-4059-8ad6-35716f500a8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:32.691243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf70ec-1274-4059-8ad6-35716f500a8b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:32.696786 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 234/455] 10.222.0.141 () {56 vars in 1381 bytes} [Tue Jul 26 16:04:32 2022] GET /identity/v3/role_assignments?group.id=f1fe8d72a50b49169c0bdcc6f9e74fb1&scope.project.id=6346eda2635c45f9bf2e6ed6fa0c9ad7&role.id=33fa4ece26464ae98122f3279db92307 => generated 613 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:35.177402 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a7cc9-557a-4891-a64f-a17aabc73b5b None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:35.177925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a7cc9-557a-4891-a64f-a17aabc73b5b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:35.177925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a7cc9-557a-4891-a64f-a17aabc73b5b None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:35.179576 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 222/456] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:35.190022 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868c017-24b4-4797-bbea-33386ca13b59 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:35.190817 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868c017-24b4-4797-bbea-33386ca13b59 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:35.191239 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868c017-24b4-4797-bbea-33386ca13b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:35.217669 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-1868c017-24b4-4797-bbea-33386ca13b59 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:35.219095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1868c017-24b4-4797-bbea-33386ca13b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:35.302986 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 235/457] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:35.339082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a7cc9-557a-4891-a64f-a17aabc73b5b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:35.480394 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a7cc9-557a-4891-a64f-a17aabc73b5b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:35.500393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42011478-0b76-46d7-b2e2-9472023fca71 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:35.501070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42011478-0b76-46d7-b2e2-9472023fca71 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:35.501568 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42011478-0b76-46d7-b2e2-9472023fca71 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:35.504032 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 236/458] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:35.509226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86260a44-fe1b-4b67-8dbd-559c610a3e5e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:35.509766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86260a44-fe1b-4b67-8dbd-559c610a3e5e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:35.510241 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86260a44-fe1b-4b67-8dbd-559c610a3e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:35.516529 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:35.539344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015cfb4-fcbf-4f7f-bd63-d49c30892166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:35.540311 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015cfb4-fcbf-4f7f-bd63-d49c30892166 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:35.540780 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015cfb4-fcbf-4f7f-bd63-d49c30892166 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:35.541198 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015cfb4-fcbf-4f7f-bd63-d49c30892166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:35.547352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-86260a44-fe1b-4b67-8dbd-559c610a3e5e None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:35.553811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-86260a44-fe1b-4b67-8dbd-559c610a3e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:35.559590 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015cfb4-fcbf-4f7f-bd63-d49c30892166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:35.561299 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015cfb4-fcbf-4f7f-bd63-d49c30892166 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:35.572998 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:35.583833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-9015cfb4-fcbf-4f7f-bd63-d49c30892166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:35.583833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:35.583833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:35.583833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:35.583833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:35.583833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:35.583833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:35.583833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:35.583833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:35.583833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:35.583833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:35.583833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:35.583833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:35.583833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:35.583833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:35.590428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:35.590428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:35.590428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:35.590428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:35.590428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:35.590428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:35.590428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:35.590428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:35.590428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:35.590428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:35.590428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:35.590428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:35.590428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:35.590428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:35.590428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:35.590428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:35.590428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:35.591273 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:35.591273 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:35.591273 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:35.591273 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:35.591273 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 223/459] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:35.591273 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015cfb4-fcbf-4f7f-bd63-d49c30892166 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:35.655550 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 237/460] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:35.657352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b17a27-aa37-4c91-9ad0-db19b61ba65e None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:35.657803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b17a27-aa37-4c91-9ad0-db19b61ba65e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:35.658218 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b17a27-aa37-4c91-9ad0-db19b61ba65e None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:35.659952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 238/461] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:35.665033 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce5814-ab67-4d0b-b8ce-bd15b9cb7274 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:35.665611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce5814-ab67-4d0b-b8ce-bd15b9cb7274 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:35.665891 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce5814-ab67-4d0b-b8ce-bd15b9cb7274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:35.686889 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-25ce5814-ab67-4d0b-b8ce-bd15b9cb7274 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:35.688350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-25ce5814-ab67-4d0b-b8ce-bd15b9cb7274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:35.741366 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015cfb4-fcbf-4f7f-bd63-d49c30892166 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:35.760292 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 239/462] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:35.761465 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce5814-ab67-4d0b-b8ce-bd15b9cb7274 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:35.804039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d07dd7-8f7c-456c-92e1-0431dbc9fd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:35.805779 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d07dd7-8f7c-456c-92e1-0431dbc9fd1e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:35.806406 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d07dd7-8f7c-456c-92e1-0431dbc9fd1e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:35.806942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d07dd7-8f7c-456c-92e1-0431dbc9fd1e None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:35.807776 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d07dd7-8f7c-456c-92e1-0431dbc9fd1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:35.808224 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d07dd7-8f7c-456c-92e1-0431dbc9fd1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:35.810926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d07dd7-8f7c-456c-92e1-0431dbc9fd1e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:35.834416 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 224/463] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:35.835632 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d07dd7-8f7c-456c-92e1-0431dbc9fd1e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:35.857906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:35.881139 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce5814-ab67-4d0b-b8ce-bd15b9cb7274 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:35.881670 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:35.935472 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e19180-c921-45d6-8db0-38722f3eaf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:35.936638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e19180-c921-45d6-8db0-38722f3eaf71 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:35.937681 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e19180-c921-45d6-8db0-38722f3eaf71 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:35.938429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e19180-c921-45d6-8db0-38722f3eaf71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:35.952807 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e19180-c921-45d6-8db0-38722f3eaf71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:35.955123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e19180-c921-45d6-8db0-38722f3eaf71 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:35.956264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d07dd7-8f7c-456c-92e1-0431dbc9fd1e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:35.975862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-90e19180-c921-45d6-8db0-38722f3eaf71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:35.975862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:35.975862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:35.975862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:35.975862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:35.975862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:35.975862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:35.975862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:35.975862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:35.975862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:35.975862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:35.975862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:35.975862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:35.975862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:35.975862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:35.976764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:35.976764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:35.976764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:35.976764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:35.976764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:35.976764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:35.976764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:35.976764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:35.976764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:35.976764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:35.976764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:35.976764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:35.976764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:35.976764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:35.976764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:35.976764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:35.976764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:35.977589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:35.977589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:35.977589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:35.977589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:35.985010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 240/464] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:35.985592 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e19180-c921-45d6-8db0-38722f3eaf71 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:36.002849 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7130753-1e90-4a57-866c-7d8ac1c72e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:36.004384 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7130753-1e90-4a57-866c-7d8ac1c72e04 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:36.005229 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7130753-1e90-4a57-866c-7d8ac1c72e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:36.005710 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7130753-1e90-4a57-866c-7d8ac1c72e04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:36.020872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7130753-1e90-4a57-866c-7d8ac1c72e04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:36.022865 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7130753-1e90-4a57-866c-7d8ac1c72e04 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:36.048010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-c7130753-1e90-4a57-866c-7d8ac1c72e04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:36.048010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:36.048010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:36.048010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:36.048010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:36.048010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:36.048010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:36.048010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:36.048010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:36.048010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:36.048010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:36.048010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:36.048010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:36.048010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:36.048010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:36.048934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:36.048934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:36.048934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:36.048934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:36.048934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:36.048934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:36.048934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:36.048934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:36.048934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:36.048934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:36.048934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:36.048934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:36.048934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:36.048934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:36.048934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:36.048934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:36.048934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:36.050333 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:36.050333 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:36.050333 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:36.050333 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:36.050333 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 225/465] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:36.055265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7130753-1e90-4a57-866c-7d8ac1c72e04 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:36.106932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e19180-c921-45d6-8db0-38722f3eaf71 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:36.142152 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:36.149359 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4fa8e-f45a-4edb-a3e0-16609bb5f65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:36.149977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4fa8e-f45a-4edb-a3e0-16609bb5f65b None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:36.150260 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4fa8e-f45a-4edb-a3e0-16609bb5f65b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:36.150567 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4fa8e-f45a-4edb-a3e0-16609bb5f65b None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:36.151227 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4fa8e-f45a-4edb-a3e0-16609bb5f65b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:36.152691 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4fa8e-f45a-4edb-a3e0-16609bb5f65b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:36.156690 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:36.173151 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7130753-1e90-4a57-866c-7d8ac1c72e04 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:36.212829 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef1ef6-4cc5-4107-92c4-8b97f5b7745b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:36.220685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef1ef6-4cc5-4107-92c4-8b97f5b7745b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:36.220685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef1ef6-4cc5-4107-92c4-8b97f5b7745b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:36.220685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef1ef6-4cc5-4107-92c4-8b97f5b7745b None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:36.220685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef1ef6-4cc5-4107-92c4-8b97f5b7745b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:36.220685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef1ef6-4cc5-4107-92c4-8b97f5b7745b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:36.220685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef1ef6-4cc5-4107-92c4-8b97f5b7745b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:36.229468 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 226/466] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:36.230287 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef1ef6-4cc5-4107-92c4-8b97f5b7745b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:36.246700 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 241/467] 10.222.0.141 () {60 vars in 1137 bytes} [Tue Jul 26 16:04:35 2022] POST /identity/v3/users => generated 247 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:04:36.252143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fbbd9-523f-451b-97a9-72e763d82ec1 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:36.252143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fbbd9-523f-451b-97a9-72e763d82ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:36.252143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fbbd9-523f-451b-97a9-72e763d82ec1 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:36.253758 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 242/468] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:36 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:36.253758 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fbbd9-523f-451b-97a9-72e763d82ec1 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:36.436801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fbbd9-523f-451b-97a9-72e763d82ec1 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:36.468264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef1ef6-4cc5-4107-92c4-8b97f5b7745b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:36.481900 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4e260-1e0a-47f4-a9f0-78278cd9a3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:36.482529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4e260-1e0a-47f4-a9f0-78278cd9a3bb None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:36.482806 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4e260-1e0a-47f4-a9f0-78278cd9a3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:36.483076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4e260-1e0a-47f4-a9f0-78278cd9a3bb None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:36.483872 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4e260-1e0a-47f4-a9f0-78278cd9a3bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:36.485343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4e260-1e0a-47f4-a9f0-78278cd9a3bb None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:36.521312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a35565-c86b-4dcd-bf1a-6c3c20ae5429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:36.521312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a35565-c86b-4dcd-bf1a-6c3c20ae5429 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:36.521312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a35565-c86b-4dcd-bf1a-6c3c20ae5429 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:36.521312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a35565-c86b-4dcd-bf1a-6c3c20ae5429 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:36.521693 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a35565-c86b-4dcd-bf1a-6c3c20ae5429 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:36.521693 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a35565-c86b-4dcd-bf1a-6c3c20ae5429 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:36.521693 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a35565-c86b-4dcd-bf1a-6c3c20ae5429 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:36.532588 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 227/469] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:36.534162 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080c2d7-3b16-4ef1-a586-d5a89bc7f508 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:36.534746 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080c2d7-3b16-4ef1-a586-d5a89bc7f508 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:36.535204 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080c2d7-3b16-4ef1-a586-d5a89bc7f508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:36.548383 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:36.560026 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-7080c2d7-3b16-4ef1-a586-d5a89bc7f508 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:36.560692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7080c2d7-3b16-4ef1-a586-d5a89bc7f508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:36.579529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 243/470] 10.222.0.141 () {60 vars in 1137 bytes} [Tue Jul 26 16:04:36 2022] POST /identity/v3/users => generated 249 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:04:36.584073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4e260-1e0a-47f4-a9f0-78278cd9a3bb None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:36.669023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 228/471] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:36.670378 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c2086-a969-4cf8-8611-6f5fb9dcd573 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:36.670668 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c2086-a969-4cf8-8611-6f5fb9dcd573 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:36.671009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c2086-a969-4cf8-8611-6f5fb9dcd573 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:36.672483 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 229/472] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:36.678177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e7ccd-009a-4f26-a962-4ea9e4294b2b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:36.678465 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e7ccd-009a-4f26-a962-4ea9e4294b2b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:36.678749 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e7ccd-009a-4f26-a962-4ea9e4294b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:36.691474 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:36.698407 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-838e7ccd-009a-4f26-a962-4ea9e4294b2b None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:36.699765 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-838e7ccd-009a-4f26-a962-4ea9e4294b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:36.774484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 230/473] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:04:36.781079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e7ccd-009a-4f26-a962-4ea9e4294b2b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:36.790157 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4e260-1e0a-47f4-a9f0-78278cd9a3bb None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:36.832125 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68536a-eb39-4b43-b73d-c7af4920b001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:36.832788 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68536a-eb39-4b43-b73d-c7af4920b001 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:36.833073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68536a-eb39-4b43-b73d-c7af4920b001 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:36.833351 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68536a-eb39-4b43-b73d-c7af4920b001 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:36.834030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68536a-eb39-4b43-b73d-c7af4920b001 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:36.836459 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68536a-eb39-4b43-b73d-c7af4920b001 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:36.871844 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:36.907788 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e7ccd-009a-4f26-a962-4ea9e4294b2b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:36.944009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954e4ae-ba14-4427-b432-5ef53c7ceb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:36.944570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 244/474] 10.222.0.141 () {60 vars in 1137 bytes} [Tue Jul 26 16:04:36 2022] POST /identity/v3/users => generated 249 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:04:36.944698 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954e4ae-ba14-4427-b432-5ef53c7ceb4f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:36.944898 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954e4ae-ba14-4427-b432-5ef53c7ceb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:36.945173 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954e4ae-ba14-4427-b432-5ef53c7ceb4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:36.946282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68536a-eb39-4b43-b73d-c7af4920b001 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:36.956818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954e4ae-ba14-4427-b432-5ef53c7ceb4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:36.958295 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954e4ae-ba14-4427-b432-5ef53c7ceb4f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:36.974857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-c954e4ae-ba14-4427-b432-5ef53c7ceb4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:36.974857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:36.974857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:36.974857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:36.974857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:36.974857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:36.974857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:36.974857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:36.974857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:36.974857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:36.974857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:36.974857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:36.974857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:36.974857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:36.974857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:36.977872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:36.977872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:36.977872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:36.977872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:36.977872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:36.977872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:36.977872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:36.977872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:36.977872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:36.977872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:36.977872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:36.977872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:36.977872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:36.977872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:36.977872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:36.977872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:36.977872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:36.978821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:36.978821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:36.978821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:36.978821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:36.978821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 231/475] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:36.982908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954e4ae-ba14-4427-b432-5ef53c7ceb4f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:37.136198 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954e4ae-ba14-4427-b432-5ef53c7ceb4f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:37.163012 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:37.171200 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:37.176690 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68536a-eb39-4b43-b73d-c7af4920b001 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:37.191763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bff449-f01f-46a1-8bdd-be13d27cf444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:37.192398 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bff449-f01f-46a1-8bdd-be13d27cf444 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:37.192699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bff449-f01f-46a1-8bdd-be13d27cf444 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:37.193000 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bff449-f01f-46a1-8bdd-be13d27cf444 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:37.193699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bff449-f01f-46a1-8bdd-be13d27cf444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:37.194005 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bff449-f01f-46a1-8bdd-be13d27cf444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:37.195678 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bff449-f01f-46a1-8bdd-be13d27cf444 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:37.216960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d8cec-8acf-4baa-8077-638062a94765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:37.217822 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d8cec-8acf-4baa-8077-638062a94765 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:37.218232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d8cec-8acf-4baa-8077-638062a94765 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:37.218603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d8cec-8acf-4baa-8077-638062a94765 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:37.219419 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d8cec-8acf-4baa-8077-638062a94765 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:37.219984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 232/476] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:37.221059 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d8cec-8acf-4baa-8077-638062a94765 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:37.225513 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bff449-f01f-46a1-8bdd-be13d27cf444 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:37.258329 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.sql.core [None req-542d8cec-8acf-4baa-8077-638062a94765 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 16:04:37.258329 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 26 16:04:37.258329 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [parameters: {'id': '7f4d6937012043c88afc091e8891cf34', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 26 16:04:37.258329 dv-cinder-851042-1-smb devstack@keystone.service[80601]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80601) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 16:04:37.280457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-542d8cec-8acf-4baa-8077-638062a94765 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 26 16:04:37.280457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:37.280457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 16:04:37.280457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 16:04:37.280457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 16:04:37.280457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 16:04:37.280457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 16:04:37.280457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 16:04:37.280457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 16:04:37.280457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application conn.query(q) Jul 26 16:04:37.280457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 16:04:37.280457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 16:04:37.280457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 16:04:37.280457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application result.read() Jul 26 16:04:37.280457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 16:04:37.281689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 16:04:37.281689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 16:04:37.281689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 16:04:37.281689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 16:04:37.281689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 16:04:37.281689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 16:04:37.281689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 16:04:37.281689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 16:04:37.281689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:37.281689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 16:04:37.281689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:37.281689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:37.281689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 16:04:37.281689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 16:04:37.281689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 26 16:04:37.281689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return ref.to_dict() Jul 26 16:04:37.281689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 16:04:37.281689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application next(self.gen) Jul 26 16:04:37.282712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 16:04:37.282712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application yield resource Jul 26 16:04:37.282712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 16:04:37.282712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application next(self.gen) Jul 26 16:04:37.282712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 16:04:37.282712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 16:04:37.282712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 16:04:37.282712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 16:04:37.282712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 16:04:37.282712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise self.value Jul 26 16:04:37.282712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 16:04:37.282712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 16:04:37.282712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 16:04:37.282712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application session.commit() Jul 26 16:04:37.282712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 16:04:37.282712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 16:04:37.282712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 16:04:37.284257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 16:04:37.284257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 16:04:37.284257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self.session.flush() Jul 26 16:04:37.284257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 16:04:37.284257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 16:04:37.284257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 16:04:37.284257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 16:04:37.284257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 16:04:37.284257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application compat.raise_( Jul 26 16:04:37.284257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 16:04:37.284257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception Jul 26 16:04:37.284257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 16:04:37.284257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 16:04:37.284257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 16:04:37.284257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 16:04:37.284257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 16:04:37.284257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 16:04:37.285341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 16:04:37.285341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 16:04:37.285341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 16:04:37.285341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 16:04:37.285341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 16:04:37.285341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 16:04:37.285341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 16:04:37.285341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 16:04:37.285341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 16:04:37.285341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 16:04:37.285341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 16:04:37.285341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 16:04:37.285341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 16:04:37.285341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 16:04:37.285341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 16:04:37.285341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception Jul 26 16:04:37.286208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 16:04:37.286208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 16:04:37.286208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 16:04:37.286208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 16:04:37.286208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 16:04:37.286208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 16:04:37.286208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 16:04:37.286208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application conn.query(q) Jul 26 16:04:37.286208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 16:04:37.286208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 16:04:37.286208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 16:04:37.286208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application result.read() Jul 26 16:04:37.286208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 16:04:37.286208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 16:04:37.286208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 16:04:37.286208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 16:04:37.287224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 16:04:37.287224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 16:04:37.287224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 16:04:37.287224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 16:04:37.287224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 16:04:37.287224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 26 16:04:37.287224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [parameters: {'id': '7f4d6937012043c88afc091e8891cf34', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 26 16:04:37.287224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 16:04:37.287224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:37.287224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:04:37.287224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:37.287224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:37.287224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:37.287224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:37.287224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:37.287224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:37.288222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:37.288222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:37.288222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:37.288222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:37.288222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:37.288222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:37.288222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 26 16:04:37.288222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 26 16:04:37.288222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:37.288222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:37.288222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 26 16:04:37.288222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 26 16:04:37.288222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 16:04:37.288222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 16:04:37.288222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 26 16:04:37.288222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:37.297422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 245/477] 10.222.0.141 () {60 vars in 1136 bytes} [Tue Jul 26 16:04:36 2022] POST /identity/v3/roles => generated 144 bytes in 337 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:37.297422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d8cec-8acf-4baa-8077-638062a94765 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:37.371703 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bff449-f01f-46a1-8bdd-be13d27cf444 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:37.420275 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fdcbc-ec41-4c14-8b96-9e6d572dcee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:37.420861 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fdcbc-ec41-4c14-8b96-9e6d572dcee3 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:37.421143 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fdcbc-ec41-4c14-8b96-9e6d572dcee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:37.421414 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fdcbc-ec41-4c14-8b96-9e6d572dcee3 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:37.422208 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16fdcbc-ec41-4c14-8b96-9e6d572dcee3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:37.424038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16fdcbc-ec41-4c14-8b96-9e6d572dcee3 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:37.426324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d8cec-8acf-4baa-8077-638062a94765 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:37.463897 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b32f5e-3b03-48e9-8f0c-9220fdb84af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:37.464676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b32f5e-3b03-48e9-8f0c-9220fdb84af6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:37.464963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b32f5e-3b03-48e9-8f0c-9220fdb84af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:37.465242 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b32f5e-3b03-48e9-8f0c-9220fdb84af6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:37.476746 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b32f5e-3b03-48e9-8f0c-9220fdb84af6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:37.482565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-24b32f5e-3b03-48e9-8f0c-9220fdb84af6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:04:37.482565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:37.482565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:37.482565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:37.482565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:37.482565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:37.482565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:37.482565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:37.482565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:37.482565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:37.482565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:37.482565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:37.482565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:37.482565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:37.482565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:37.482565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:37.484518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:37.484518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:37.484518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:37.484518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:37.484518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:37.484518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:37.484518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:37.484518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:37.484518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:37.484518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:37.484518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:37.484518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:37.484518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:37.484518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:37.484518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:37.484518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:37.492794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:37.492794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:37.492794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:37.492794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:37.492794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:37.492794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:37.492794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:37.492794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:37.492794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:37.492794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:37.492794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 16:04:37.492794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:37.492794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 246/478] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:04:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:37.493642 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b32f5e-3b03-48e9-8f0c-9220fdb84af6 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:37.519277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:37.588351 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 233/479] 10.222.0.141 () {60 vars in 1137 bytes} [Tue Jul 26 16:04:37 2022] POST /identity/v3/users => generated 250 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:04:37.614706 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b32f5e-3b03-48e9-8f0c-9220fdb84af6 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:37.661997 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082369e-9808-4cf1-8fd2-910e7203691c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:37.662638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082369e-9808-4cf1-8fd2-910e7203691c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:37.662921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082369e-9808-4cf1-8fd2-910e7203691c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:37.663199 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082369e-9808-4cf1-8fd2-910e7203691c None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:37.664032 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082369e-9808-4cf1-8fd2-910e7203691c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:37.664341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082369e-9808-4cf1-8fd2-910e7203691c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:37.665795 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082369e-9808-4cf1-8fd2-910e7203691c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:37.675463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 247/480] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:37 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:38.689089 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b10d4-4dd0-4882-80d3-6d741afa8803 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:38.689603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b10d4-4dd0-4882-80d3-6d741afa8803 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:38.689676 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b10d4-4dd0-4882-80d3-6d741afa8803 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:38.691746 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 234/481] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:38.697069 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8451a9b-edd2-4c6c-bbc3-db35b8aa9bd0 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:38.697457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8451a9b-edd2-4c6c-bbc3-db35b8aa9bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:38.697618 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8451a9b-edd2-4c6c-bbc3-db35b8aa9bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:38.721644 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a8451a9b-edd2-4c6c-bbc3-db35b8aa9bd0 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:38.722834 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a8451a9b-edd2-4c6c-bbc3-db35b8aa9bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:38.803389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 248/482] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:38.842245 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b10d4-4dd0-4882-80d3-6d741afa8803 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:38.885502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:38.988466 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b10d4-4dd0-4882-80d3-6d741afa8803 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:39.041482 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19430e-a5ce-4fa1-85b7-8df1ca8803b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:39.042123 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19430e-a5ce-4fa1-85b7-8df1ca8803b9 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:39.042403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19430e-a5ce-4fa1-85b7-8df1ca8803b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:39.042677 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19430e-a5ce-4fa1-85b7-8df1ca8803b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:39.049584 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cd5cc-a7ff-4e8c-8834-b817f7eedd63 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:39.050267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cd5cc-a7ff-4e8c-8834-b817f7eedd63 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:39.050770 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cd5cc-a7ff-4e8c-8834-b817f7eedd63 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:39.053246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 249/483] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:39 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:39.059726 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98909f8d-eb2c-4fd3-97a0-ad3d04cc827e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:39.060702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98909f8d-eb2c-4fd3-97a0-ad3d04cc827e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:39.061189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98909f8d-eb2c-4fd3-97a0-ad3d04cc827e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:39.066504 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19430e-a5ce-4fa1-85b7-8df1ca8803b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:39.072479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-cd19430e-a5ce-4fa1-85b7-8df1ca8803b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:39.072479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:39.072479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:39.072479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:39.072479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:39.072479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:39.072479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:39.072479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:39.072479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:39.072479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:39.072479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:39.072479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:39.072479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:39.072479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:39.072479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:39.072479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:39.073409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:39.073409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:39.073409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:39.073409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:39.073409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:39.073409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:39.073409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:39.073409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:39.073409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:39.073409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:39.073409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:39.073409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:39.073409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:39.073409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:39.073409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:39.073409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:39.074221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:39.074221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:39.074221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:39.074221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:39.074221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:39.074221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:39.074221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:39.074221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:39.074221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:39.074221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:39.074221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:39.074221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:39.086763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 235/484] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:04:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:39.092369 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19430e-a5ce-4fa1-85b7-8df1ca8803b9 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:39.106348 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-98909f8d-eb2c-4fd3-97a0-ad3d04cc827e None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:39.107828 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-98909f8d-eb2c-4fd3-97a0-ad3d04cc827e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:39.134619 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:39.207818 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 250/485] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:04:39.233820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98909f8d-eb2c-4fd3-97a0-ad3d04cc827e None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:39.322553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:39.338280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19430e-a5ce-4fa1-85b7-8df1ca8803b9 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:39.351641 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98909f8d-eb2c-4fd3-97a0-ad3d04cc827e None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:39.394396 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd9116-994f-4566-a9ae-600f1bb4a5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:39.395569 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd9116-994f-4566-a9ae-600f1bb4a5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:39.396074 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd9116-994f-4566-a9ae-600f1bb4a5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:39.396569 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd9116-994f-4566-a9ae-600f1bb4a5c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:39.408701 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd9116-994f-4566-a9ae-600f1bb4a5c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:39.414659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-65fd9116-994f-4566-a9ae-600f1bb4a5c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:39.414659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:39.414659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:39.414659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:39.414659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:39.414659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:39.414659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:39.414659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:39.414659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:39.414659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:39.414659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:39.414659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:39.414659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:39.414659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:39.414659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:39.414659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:39.415554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:39.415554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:39.415554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:39.415554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:39.415554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:39.415554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:39.415554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:39.415554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:39.415554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:39.415554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:39.415554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:39.415554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:39.415554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:39.415554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:39.415554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:39.415554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:39.416340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:39.416340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:39.416340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:39.416340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:39.416340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:39.416340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:39.416340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:39.416340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:39.416340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:39.416340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:39.416340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:39.416340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:39.418974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 251/486] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:04:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:39.425955 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd9116-994f-4566-a9ae-600f1bb4a5c3 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:39.430155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94689ed-22a2-4641-9c19-27de6309b9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:39.430806 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94689ed-22a2-4641-9c19-27de6309b9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:39.431087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94689ed-22a2-4641-9c19-27de6309b9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:39.431421 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94689ed-22a2-4641-9c19-27de6309b9b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:39.432034 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:39.432141 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94689ed-22a2-4641-9c19-27de6309b9b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:39.432446 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94689ed-22a2-4641-9c19-27de6309b9b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:39.434147 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94689ed-22a2-4641-9c19-27de6309b9b0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:39.458992 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 236/487] 10.222.0.141 () {56 vars in 1108 bytes} [Tue Jul 26 16:04:39 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:39.464152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94689ed-22a2-4641-9c19-27de6309b9b0 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:39.588165 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94689ed-22a2-4641-9c19-27de6309b9b0 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:39.602910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd9116-994f-4566-a9ae-600f1bb4a5c3 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:39.626101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81998e1b-7cb1-4df0-b4c8-57180f6cbe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:39.626749 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81998e1b-7cb1-4df0-b4c8-57180f6cbe8e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:39.627034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81998e1b-7cb1-4df0-b4c8-57180f6cbe8e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:39.627340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81998e1b-7cb1-4df0-b4c8-57180f6cbe8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:39.638602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81998e1b-7cb1-4df0-b4c8-57180f6cbe8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:39.640042 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81998e1b-7cb1-4df0-b4c8-57180f6cbe8e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:39.649623 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4337ad-fb8e-4439-9747-381fa3b794a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:39.650748 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4337ad-fb8e-4439-9747-381fa3b794a6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:39.651231 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4337ad-fb8e-4439-9747-381fa3b794a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:39.651720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4337ad-fb8e-4439-9747-381fa3b794a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:39.652628 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4337ad-fb8e-4439-9747-381fa3b794a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:39.653171 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4337ad-fb8e-4439-9747-381fa3b794a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:39.654732 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4337ad-fb8e-4439-9747-381fa3b794a6 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:39.655194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-81998e1b-7cb1-4df0-b4c8-57180f6cbe8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:39.655194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:39.655194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:39.655194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:39.655194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:39.655194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:39.655194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:39.655194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:39.655194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:39.655194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:39.655194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:39.655194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:39.655194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:39.655194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:39.655194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:39.656009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:39.656009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:39.656009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:39.656009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:39.656009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:39.656009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:39.656009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:39.656009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:39.656009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:39.656009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:39.656009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:39.656009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:39.656009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:39.656009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:39.656009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:39.656009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:39.656009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:39.656871 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:39.656871 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:39.656871 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:39.656871 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:39.656871 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 237/488] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:04:39.657933 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc9943-b20b-4a27-afcd-c1a4a43f7e27 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:39.658224 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc9943-b20b-4a27-afcd-c1a4a43f7e27 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:39.659026 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc9943-b20b-4a27-afcd-c1a4a43f7e27 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:39.660282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 238/489] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:39.664983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc9943-b20b-4a27-afcd-c1a4a43f7e27 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:39.668285 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 252/490] 10.222.0.141 () {56 vars in 1108 bytes} [Tue Jul 26 16:04:39 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:39.674270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5965ed-db72-45ff-88b0-c700902896ed None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:39.675321 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5965ed-db72-45ff-88b0-c700902896ed None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:39.675796 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5965ed-db72-45ff-88b0-c700902896ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:39.682755 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:39.699475 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-ec5965ed-db72-45ff-88b0-c700902896ed None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:39.700757 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ec5965ed-db72-45ff-88b0-c700902896ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:39.770019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:39.777576 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 253/491] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:39.784014 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5965ed-db72-45ff-88b0-c700902896ed None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:39.807547 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc9943-b20b-4a27-afcd-c1a4a43f7e27 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:39.858486 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751bcc2-9de6-40c1-b177-488a9cd55b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:39.859450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751bcc2-9de6-40c1-b177-488a9cd55b36 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:39.860600 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751bcc2-9de6-40c1-b177-488a9cd55b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:39.861435 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751bcc2-9de6-40c1-b177-488a9cd55b36 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:39.862654 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751bcc2-9de6-40c1-b177-488a9cd55b36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:39.863190 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751bcc2-9de6-40c1-b177-488a9cd55b36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:39.865506 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751bcc2-9de6-40c1-b177-488a9cd55b36 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:39.884093 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 239/492] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:39.885820 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751bcc2-9de6-40c1-b177-488a9cd55b36 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:39.911710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5965ed-db72-45ff-88b0-c700902896ed None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:39.952767 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef57e8-b85d-4870-8ece-3ca612c8bdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:39.954059 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef57e8-b85d-4870-8ece-3ca612c8bdad None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:39.954345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef57e8-b85d-4870-8ece-3ca612c8bdad None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:39.954622 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef57e8-b85d-4870-8ece-3ca612c8bdad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:39.966079 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef57e8-b85d-4870-8ece-3ca612c8bdad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:39.967552 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef57e8-b85d-4870-8ece-3ca612c8bdad None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:39.983322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-c0ef57e8-b85d-4870-8ece-3ca612c8bdad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:39.983322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:39.983322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:39.983322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:39.983322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:39.983322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:39.983322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:39.983322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:39.983322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:39.983322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:39.983322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:39.983322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:39.983322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:39.983322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:39.983322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:39.984219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:39.984219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:39.984219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:39.984219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:39.984219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:39.984219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:39.984219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:39.984219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:39.984219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:39.984219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:39.984219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:39.984219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:39.984219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:39.984219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:39.984219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:39.984219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:39.984219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:39.985106 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:39.985106 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:39.985106 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:39.985106 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:39.986150 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 254/493] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:39.987043 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef57e8-b85d-4870-8ece-3ca612c8bdad None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:39.989878 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:40.030061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751bcc2-9de6-40c1-b177-488a9cd55b36 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:40.041490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:40.067037 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a5cce-c917-48b8-804d-624b68779870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:40.068486 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a5cce-c917-48b8-804d-624b68779870 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:40.069005 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a5cce-c917-48b8-804d-624b68779870 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:40.069424 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a5cce-c917-48b8-804d-624b68779870 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:40.081421 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a5cce-c917-48b8-804d-624b68779870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:40.086371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-d34a5cce-c917-48b8-804d-624b68779870 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:40.086371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:40.086371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:40.086371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:40.086371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:40.086371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:40.086371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:40.086371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:40.086371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:40.086371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:40.086371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:40.086371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:40.086371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:40.086371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:40.086371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:40.086371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:40.093347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:40.093347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:40.093347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:40.093347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:40.093347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:40.093347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:40.093347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:40.093347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:40.093347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:40.093347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:40.093347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:40.093347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:40.093347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:40.093347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:40.093347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:40.093347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:40.094117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:40.094117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:40.094117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:40.094117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:40.094117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:40.094117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:40.094117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:40.094117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:40.094117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:40.094117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:40.094117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:40.094117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:40.094117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 240/494] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:04:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:40.094117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233da11c-bd99-493e-a2b5-b16f7820f1d6 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:40.094801 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233da11c-bd99-493e-a2b5-b16f7820f1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:40.094801 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233da11c-bd99-493e-a2b5-b16f7820f1d6 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:40.094801 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 241/495] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:40 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:40.095321 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233da11c-bd99-493e-a2b5-b16f7820f1d6 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:40.107110 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef57e8-b85d-4870-8ece-3ca612c8bdad None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:40.142179 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13473912-3e9c-42fe-b1b0-561be8529bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:40.142822 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13473912-3e9c-42fe-b1b0-561be8529bcb None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:40.143654 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13473912-3e9c-42fe-b1b0-561be8529bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:40.143916 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13473912-3e9c-42fe-b1b0-561be8529bcb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:40.151523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13473912-3e9c-42fe-b1b0-561be8529bcb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:40.153005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13473912-3e9c-42fe-b1b0-561be8529bcb None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:40.170547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-13473912-3e9c-42fe-b1b0-561be8529bcb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 16:04:40.170547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:40.170547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:40.170547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:40.170547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:40.170547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:40.170547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:40.170547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:40.170547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:40.170547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:40.170547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:40.170547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:40.170547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:04:40.170547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:04:40.170547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:04:40.170547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:04:40.171489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:40.171489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:40.171489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:04:40.171489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:40.171489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:04:40.171489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:40.171489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:40.171489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:40.171489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:40.171489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:40.171489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:40.171489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:40.171489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:40.171489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:40.171489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:40.171489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:40.171489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:40.171489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:40.172371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:40.172371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:40.172371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:04:40.172371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:04:40.172371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:04:40.172371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:04:40.172371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:04:40.172371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:04:40.172371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 16:04:40.172371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:40.172371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 255/496] 10.222.0.141 () {56 vars in 1098 bytes} [Tue Jul 26 16:04:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:40.173534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13473912-3e9c-42fe-b1b0-561be8529bcb None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:40.207462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233da11c-bd99-493e-a2b5-b16f7820f1d6 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:40.235568 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:40.244216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09844fc2-bab4-495d-9efd-565f5e5a34f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:40.244873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09844fc2-bab4-495d-9efd-565f5e5a34f7 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:40.245164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09844fc2-bab4-495d-9efd-565f5e5a34f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:40.251712 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09844fc2-bab4-495d-9efd-565f5e5a34f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:40.251712 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09844fc2-bab4-495d-9efd-565f5e5a34f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:40.251712 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09844fc2-bab4-495d-9efd-565f5e5a34f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:40.251712 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09844fc2-bab4-495d-9efd-565f5e5a34f7 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:40.259672 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 242/497] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:40.260717 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f37728-12bc-4268-8a2f-8619cb838a81 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:40.261015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f37728-12bc-4268-8a2f-8619cb838a81 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:40.261297 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f37728-12bc-4268-8a2f-8619cb838a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:40.279871 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-58f37728-12bc-4268-8a2f-8619cb838a81 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:40.281300 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-58f37728-12bc-4268-8a2f-8619cb838a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:40.291663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13473912-3e9c-42fe-b1b0-561be8529bcb None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:40.302301 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:40.331285 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e3c5b-011f-4f6f-92bf-8cf4d6d3330a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:40.331926 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e3c5b-011f-4f6f-92bf-8cf4d6d3330a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:40.332656 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e3c5b-011f-4f6f-92bf-8cf4d6d3330a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:40.333302 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e3c5b-011f-4f6f-92bf-8cf4d6d3330a None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:40.334148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e3c5b-011f-4f6f-92bf-8cf4d6d3330a None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:40.334757 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e3c5b-011f-4f6f-92bf-8cf4d6d3330a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:40.336575 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e3c5b-011f-4f6f-92bf-8cf4d6d3330a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:40.345094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 256/498] 10.222.0.141 () {56 vars in 1108 bytes} [Tue Jul 26 16:04:40 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:40.346096 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e3c5b-011f-4f6f-92bf-8cf4d6d3330a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:40.355228 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 243/499] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:40.356245 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f37728-12bc-4268-8a2f-8619cb838a81 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:40.447770 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e3c5b-011f-4f6f-92bf-8cf4d6d3330a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:40.453078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f37728-12bc-4268-8a2f-8619cb838a81 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:40.470117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:40.481010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deca93e-5d74-4edd-9fa3-0633b52069de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:40.481623 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deca93e-5d74-4edd-9fa3-0633b52069de None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:40.481902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deca93e-5d74-4edd-9fa3-0633b52069de None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:40.482172 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deca93e-5d74-4edd-9fa3-0633b52069de None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:40.482961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deca93e-5d74-4edd-9fa3-0633b52069de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:40.483274 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deca93e-5d74-4edd-9fa3-0633b52069de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:40.484721 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deca93e-5d74-4edd-9fa3-0633b52069de None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:40.486632 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d42c30-3a36-485b-9754-8d257fa5e575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:40.487324 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d42c30-3a36-485b-9754-8d257fa5e575 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:40.487609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d42c30-3a36-485b-9754-8d257fa5e575 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:40.487884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d42c30-3a36-485b-9754-8d257fa5e575 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:40.494959 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d42c30-3a36-485b-9754-8d257fa5e575 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:40.496408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d42c30-3a36-485b-9754-8d257fa5e575 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:40.510656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-65d42c30-3a36-485b-9754-8d257fa5e575 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 16:04:40.510656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:40.510656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:40.510656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:40.510656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:40.510656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:40.510656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:40.510656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:40.510656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:40.510656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:40.510656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:40.510656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:40.510656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:04:40.510656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:04:40.510656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:04:40.510656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:04:40.511607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:40.511607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:40.511607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:04:40.511607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:40.511607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:04:40.511607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:40.511607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:40.511607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:40.511607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:40.511607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:40.511607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:40.511607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:40.511607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:40.511607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:40.511607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:40.511607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:40.511607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:40.511607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:40.512476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:40.512476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:40.512476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:04:40.512476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:04:40.512476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:04:40.512476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:04:40.512476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:04:40.512476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:04:40.512476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 16:04:40.512476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:40.512476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 244/500] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:40.513561 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d42c30-3a36-485b-9754-8d257fa5e575 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:40.526852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 257/501] 10.222.0.141 () {56 vars in 1138 bytes} [Tue Jul 26 16:04:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:40.526852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce22b25-f491-4003-843a-10d8b50e386c None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:40.526852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce22b25-f491-4003-843a-10d8b50e386c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:40.526852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce22b25-f491-4003-843a-10d8b50e386c None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:40.526852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 258/502] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:40 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:40.526852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce22b25-f491-4003-843a-10d8b50e386c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:40.553157 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:40.615727 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d42c30-3a36-485b-9754-8d257fa5e575 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:40.625970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce22b25-f491-4003-843a-10d8b50e386c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:40.648710 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc07c7-e269-47a5-9abf-30d7542cd8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:40.649354 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc07c7-e269-47a5-9abf-30d7542cd8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:40.649638 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc07c7-e269-47a5-9abf-30d7542cd8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:40.649910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc07c7-e269-47a5-9abf-30d7542cd8c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:40.659604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adabf8-9aa5-485a-b57b-96e51c58a932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:40.660235 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adabf8-9aa5-485a-b57b-96e51c58a932 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:40.660359 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc07c7-e269-47a5-9abf-30d7542cd8c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:40.660517 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adabf8-9aa5-485a-b57b-96e51c58a932 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:40.660826 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adabf8-9aa5-485a-b57b-96e51c58a932 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:40.661856 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc07c7-e269-47a5-9abf-30d7542cd8c2 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:40.670622 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adabf8-9aa5-485a-b57b-96e51c58a932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:40.672051 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adabf8-9aa5-485a-b57b-96e51c58a932 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:40.676332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-7bcc07c7-e269-47a5-9abf-30d7542cd8c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:40.676332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:40.676332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:40.676332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:40.676332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:40.676332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:40.676332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:40.676332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:40.676332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:40.676332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:40.676332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:40.676332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:40.676332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:40.676332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:40.676332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:40.677310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:40.677310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:40.677310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:40.677310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:40.677310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:40.677310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:40.677310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:40.677310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:40.677310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:40.677310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:40.677310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:40.677310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:40.677310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:40.677310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:40.677310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:40.677310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:40.677310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:40.678153 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:40.678153 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:40.678153 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:40.678153 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:40.678153 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 245/503] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:40.678413 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc07c7-e269-47a5-9abf-30d7542cd8c2 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:40.687526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-38adabf8-9aa5-485a-b57b-96e51c58a932 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:40.687526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:40.687526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:40.687526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:40.687526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:40.687526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:40.687526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:40.687526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:40.687526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:40.687526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:40.687526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:40.687526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:40.687526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:40.687526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:40.687526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:40.688529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:40.688529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:40.688529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:40.688529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:40.688529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:40.688529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:40.688529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:40.688529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:40.688529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:40.688529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:40.688529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:40.688529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:40.688529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:40.688529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:40.688529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:40.688529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:40.688529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:40.690359 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:40.690359 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:40.690359 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:40.690359 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:40.690359 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 259/504] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:40.690359 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adabf8-9aa5-485a-b57b-96e51c58a932 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:40.714427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:40.772870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:40.782129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc07c7-e269-47a5-9abf-30d7542cd8c2 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:40.790898 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adabf8-9aa5-485a-b57b-96e51c58a932 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:40.816154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e06e18-8dcd-433b-a51e-41e3e94e168e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:40.816814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e06e18-8dcd-433b-a51e-41e3e94e168e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:40.817093 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e06e18-8dcd-433b-a51e-41e3e94e168e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:40.817367 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e06e18-8dcd-433b-a51e-41e3e94e168e None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:40.818148 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e06e18-8dcd-433b-a51e-41e3e94e168e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:40.818453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e06e18-8dcd-433b-a51e-41e3e94e168e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:40.819869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e06e18-8dcd-433b-a51e-41e3e94e168e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:40.826154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c351cd-4240-409d-816f-d35e7380c27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:40.826768 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c351cd-4240-409d-816f-d35e7380c27d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:40.827049 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c351cd-4240-409d-816f-d35e7380c27d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:40.827326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c351cd-4240-409d-816f-d35e7380c27d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:40.855412 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 246/505] 10.222.0.141 () {56 vars in 1142 bytes} [Tue Jul 26 16:04:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:40.856848 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62299ea2-2647-40e9-9c7d-bf0a0d845576 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:40.857139 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62299ea2-2647-40e9-9c7d-bf0a0d845576 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:40.857421 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62299ea2-2647-40e9-9c7d-bf0a0d845576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:40.874718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-62299ea2-2647-40e9-9c7d-bf0a0d845576 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:40.875911 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-62299ea2-2647-40e9-9c7d-bf0a0d845576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:40.894444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c351cd-4240-409d-816f-d35e7380c27d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:40.896596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c351cd-4240-409d-816f-d35e7380c27d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:40.940753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 247/506] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:40.941587 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62299ea2-2647-40e9-9c7d-bf0a0d845576 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:40.958837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:40.976310 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:40.995882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 260/507] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:40 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:40.996797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c351cd-4240-409d-816f-d35e7380c27d None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:41.043818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62299ea2-2647-40e9-9c7d-bf0a0d845576 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:41.078237 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7815d28-7bf9-4ad1-95de-8ae29b1b66d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:41.078848 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7815d28-7bf9-4ad1-95de-8ae29b1b66d6 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:41.079126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7815d28-7bf9-4ad1-95de-8ae29b1b66d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:41.079398 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7815d28-7bf9-4ad1-95de-8ae29b1b66d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:41.080081 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7815d28-7bf9-4ad1-95de-8ae29b1b66d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:41.080409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7815d28-7bf9-4ad1-95de-8ae29b1b66d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:41.081868 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7815d28-7bf9-4ad1-95de-8ae29b1b66d6 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:41.093029 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c351cd-4240-409d-816f-d35e7380c27d None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:41.093416 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 248/508] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:41.094121 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7815d28-7bf9-4ad1-95de-8ae29b1b66d6 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:41.130439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16801f8c-abaf-456f-9822-11bbaa6e3588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:41.131060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16801f8c-abaf-456f-9822-11bbaa6e3588 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:41.131342 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16801f8c-abaf-456f-9822-11bbaa6e3588 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:41.131619 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16801f8c-abaf-456f-9822-11bbaa6e3588 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:41.132306 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16801f8c-abaf-456f-9822-11bbaa6e3588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:41.132609 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16801f8c-abaf-456f-9822-11bbaa6e3588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:41.134015 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16801f8c-abaf-456f-9822-11bbaa6e3588 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:41.145220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 261/509] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:41.146276 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16801f8c-abaf-456f-9822-11bbaa6e3588 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:41.176259 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:41.187639 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:41.197009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7815d28-7bf9-4ad1-95de-8ae29b1b66d6 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:41.230637 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50d9de-999f-46cb-b148-206340616036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:41.231183 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50d9de-999f-46cb-b148-206340616036 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:41.231465 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50d9de-999f-46cb-b148-206340616036 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:41.231743 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50d9de-999f-46cb-b148-206340616036 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:41.244288 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16801f8c-abaf-456f-9822-11bbaa6e3588 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:41.278146 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca798af-2795-4b90-b5c3-4623a5594359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:41.278803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca798af-2795-4b90-b5c3-4623a5594359 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:41.279086 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca798af-2795-4b90-b5c3-4623a5594359 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:41.279363 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca798af-2795-4b90-b5c3-4623a5594359 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:41.289486 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca798af-2795-4b90-b5c3-4623a5594359 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:41.294902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-3ca798af-2795-4b90-b5c3-4623a5594359 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:41.294902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:41.294902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:41.294902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:41.294902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:41.294902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:41.294902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:41.294902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:41.294902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:41.294902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:41.294902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:41.294902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:41.294902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:41.294902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:41.294902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:41.294902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:41.295791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:41.295791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:41.295791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:41.295791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:41.295791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:41.295791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:41.295791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:41.295791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:41.295791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:41.295791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:41.295791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:41.295791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:41.295791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:41.295791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:41.295791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:41.295791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:41.296557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:41.296557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:41.296557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:41.296557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:41.296557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:41.296557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:41.296557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:41.296557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:41.296557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:41.296557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:41.296557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:41.296557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:41.296557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 262/510] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:04:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:41.297218 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca798af-2795-4b90-b5c3-4623a5594359 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:41.302316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50d9de-999f-46cb-b148-206340616036 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:41.303771 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50d9de-999f-46cb-b148-206340616036 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:41.378746 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:41.395514 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:41.398368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca798af-2795-4b90-b5c3-4623a5594359 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:41.401382 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 249/511] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:41 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:41.402175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50d9de-999f-46cb-b148-206340616036 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:41.433336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644dd1b-e089-40cd-990e-5ea6fb22b71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:41.433973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644dd1b-e089-40cd-990e-5ea6fb22b71e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:41.434262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644dd1b-e089-40cd-990e-5ea6fb22b71e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:41.434537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644dd1b-e089-40cd-990e-5ea6fb22b71e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:41.444495 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644dd1b-e089-40cd-990e-5ea6fb22b71e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:41.445986 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644dd1b-e089-40cd-990e-5ea6fb22b71e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:41.461250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-7644dd1b-e089-40cd-990e-5ea6fb22b71e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:41.461250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:41.461250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:41.461250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:41.461250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:41.461250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:41.461250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:41.461250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:41.461250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:41.461250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:41.461250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:41.461250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:41.461250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:41.461250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:41.461250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:41.462192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:41.462192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:41.462192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:41.462192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:41.462192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:41.462192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:41.462192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:41.462192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:41.462192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:41.462192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:41.462192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:41.462192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:41.462192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:41.462192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:41.462192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:41.462192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:41.462192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:41.463005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:41.463005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:41.463005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:41.463005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:41.463005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 263/512] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:41.463277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644dd1b-e089-40cd-990e-5ea6fb22b71e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:41.504377 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50d9de-999f-46cb-b148-206340616036 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:41.538197 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e02ab-dd22-4838-9298-700bd8697510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:41.538825 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e02ab-dd22-4838-9298-700bd8697510 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:41.539101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e02ab-dd22-4838-9298-700bd8697510 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:41.539372 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e02ab-dd22-4838-9298-700bd8697510 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:41.546502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e02ab-dd22-4838-9298-700bd8697510 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:41.548186 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e02ab-dd22-4838-9298-700bd8697510 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:41.559460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-b48e02ab-dd22-4838-9298-700bd8697510 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 16:04:41.559460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:41.559460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:41.559460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:41.559460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:41.559460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:41.559460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:41.559460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:41.559460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:41.559460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:41.559460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:41.559460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:41.559460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:04:41.559460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:04:41.559460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:04:41.559460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:04:41.560495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:41.560495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:41.560495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:04:41.560495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:41.560495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:04:41.560495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:41.560495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:41.560495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:41.560495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:41.560495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:41.560495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:41.560495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:41.560495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:41.560495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:41.560495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:41.560495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:41.560495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:41.560495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:41.561852 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:41.561852 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:41.561852 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:04:41.561852 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:04:41.561852 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:04:41.561852 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:04:41.561852 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:04:41.561852 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:04:41.561852 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 16:04:41.561852 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:41.562359 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644dd1b-e089-40cd-990e-5ea6fb22b71e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:41.562428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 250/513] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:41.562428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e02ab-dd22-4838-9298-700bd8697510 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:41.593497 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822a07d-8b94-41e1-8594-c6e78ff74a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:41.594104 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822a07d-8b94-41e1-8594-c6e78ff74a76 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:41.594383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822a07d-8b94-41e1-8594-c6e78ff74a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:41.594665 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822a07d-8b94-41e1-8594-c6e78ff74a76 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:41.595330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822a07d-8b94-41e1-8594-c6e78ff74a76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:41.597359 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822a07d-8b94-41e1-8594-c6e78ff74a76 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:41.603572 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:41.661676 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e02ab-dd22-4838-9298-700bd8697510 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:41.667355 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 264/514] 10.222.0.141 () {60 vars in 1137 bytes} [Tue Jul 26 16:04:41 2022] POST /identity/v3/users => generated 248 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:04:41.668162 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822a07d-8b94-41e1-8594-c6e78ff74a76 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:41.690742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:41.699051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c5697-2985-46ea-af3c-b0deeb67f65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:41.699692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c5697-2985-46ea-af3c-b0deeb67f65c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:41.699974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c5697-2985-46ea-af3c-b0deeb67f65c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:41.700252 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c5697-2985-46ea-af3c-b0deeb67f65c None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:41.701035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c5697-2985-46ea-af3c-b0deeb67f65c None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:41.701348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c5697-2985-46ea-af3c-b0deeb67f65c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:41.702781 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c5697-2985-46ea-af3c-b0deeb67f65c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:41.713174 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 251/515] 10.222.0.141 () {56 vars in 1108 bytes} [Tue Jul 26 16:04:41 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:41.713871 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c5697-2985-46ea-af3c-b0deeb67f65c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:41.797866 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822a07d-8b94-41e1-8594-c6e78ff74a76 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:41.831207 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:41.834896 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e81f6b-b93a-492e-8d3a-021bbaf18924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:41.835541 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e81f6b-b93a-492e-8d3a-021bbaf18924 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:41.835821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e81f6b-b93a-492e-8d3a-021bbaf18924 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:41.836091 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e81f6b-b93a-492e-8d3a-021bbaf18924 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:41.836328 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c5697-2985-46ea-af3c-b0deeb67f65c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:41.848526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e81f6b-b93a-492e-8d3a-021bbaf18924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:41.850074 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e81f6b-b93a-492e-8d3a-021bbaf18924 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:41.868570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-d1e81f6b-b93a-492e-8d3a-021bbaf18924 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:41.868570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:41.868570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:41.868570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:41.868570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:41.868570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:41.868570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:41.868570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:41.868570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:41.868570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:41.868570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:41.868570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:41.868570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:41.868570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:41.868570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:41.869490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:41.869490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:41.869490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:41.869490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:41.869490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:41.869490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:41.869490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:41.869490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:41.869490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:41.869490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:41.869490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:41.869490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:41.869490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:41.869490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:41.869490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:41.869490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:41.869490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:41.870312 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:41.870312 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:41.870312 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:41.870312 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:41.870312 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 265/516] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:41.870574 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e81f6b-b93a-492e-8d3a-021bbaf18924 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:41.875193 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63f947-795c-44ce-bad4-b278100a12b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:41.875812 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63f947-795c-44ce-bad4-b278100a12b3 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:41.876098 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63f947-795c-44ce-bad4-b278100a12b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:41.876374 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63f947-795c-44ce-bad4-b278100a12b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:41.877672 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63f947-795c-44ce-bad4-b278100a12b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:41.877965 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63f947-795c-44ce-bad4-b278100a12b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:41.879334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63f947-795c-44ce-bad4-b278100a12b3 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:41.891197 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 252/517] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:41.892077 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63f947-795c-44ce-bad4-b278100a12b3 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:41.944958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:41.989612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e81f6b-b93a-492e-8d3a-021bbaf18924 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:42.007308 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63f947-795c-44ce-bad4-b278100a12b3 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:42.025942 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7761932-4eb9-4c8a-9f88-009213a170c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:42.026573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7761932-4eb9-4c8a-9f88-009213a170c8 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:42.026853 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7761932-4eb9-4c8a-9f88-009213a170c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:42.027130 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7761932-4eb9-4c8a-9f88-009213a170c8 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:42.027922 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7761932-4eb9-4c8a-9f88-009213a170c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:42.028229 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7761932-4eb9-4c8a-9f88-009213a170c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:42.029687 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7761932-4eb9-4c8a-9f88-009213a170c8 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:42.052732 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 266/518] 10.222.0.141 () {56 vars in 1142 bytes} [Tue Jul 26 16:04:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:42.052732 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7761932-4eb9-4c8a-9f88-009213a170c8 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:42.053847 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33719cc-477d-4213-952a-56394d1cece9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:42.054493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33719cc-477d-4213-952a-56394d1cece9 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:42.054773 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33719cc-477d-4213-952a-56394d1cece9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:42.055072 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33719cc-477d-4213-952a-56394d1cece9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:42.066683 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33719cc-477d-4213-952a-56394d1cece9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:42.068440 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33719cc-477d-4213-952a-56394d1cece9 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:42.084417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-f33719cc-477d-4213-952a-56394d1cece9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:42.084417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:42.084417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:42.084417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:42.084417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:42.084417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:42.084417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:42.084417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:42.084417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:42.084417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:42.084417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:42.084417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:42.084417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:42.084417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:42.084417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:42.085451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:42.085451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:42.085451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:42.085451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:42.085451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:42.085451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:42.085451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:42.085451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:42.085451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:42.085451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:42.085451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:42.085451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:42.085451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:42.085451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:42.085451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:42.085451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:42.085451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:42.086408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:42.086408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:42.086408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:42.086408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:42.086408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 253/519] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:42.086408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33719cc-477d-4213-952a-56394d1cece9 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:42.102000 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:42.163415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7761932-4eb9-4c8a-9f88-009213a170c8 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:42.182588 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:42.193024 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33719cc-477d-4213-952a-56394d1cece9 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:42.200120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4db8e-2c87-4d6a-a84f-7e2a3e89c6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:42.200782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4db8e-2c87-4d6a-a84f-7e2a3e89c6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:42.201066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4db8e-2c87-4d6a-a84f-7e2a3e89c6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:42.201342 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4db8e-2c87-4d6a-a84f-7e2a3e89c6c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:42.202031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4db8e-2c87-4d6a-a84f-7e2a3e89c6c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:42.202395 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4db8e-2c87-4d6a-a84f-7e2a3e89c6c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:42.203720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4db8e-2c87-4d6a-a84f-7e2a3e89c6c5 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:42.219087 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 267/520] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:42.219087 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4db8e-2c87-4d6a-a84f-7e2a3e89c6c5 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:42.232734 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99623554-9b52-4c04-8d48-014fa4d7135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:42.233458 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99623554-9b52-4c04-8d48-014fa4d7135f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:42.233740 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99623554-9b52-4c04-8d48-014fa4d7135f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:42.234009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99623554-9b52-4c04-8d48-014fa4d7135f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:42.241869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99623554-9b52-4c04-8d48-014fa4d7135f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:42.243311 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99623554-9b52-4c04-8d48-014fa4d7135f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:42.256821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-99623554-9b52-4c04-8d48-014fa4d7135f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:42.256821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:42.256821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:42.256821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:42.256821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:42.256821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:42.256821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:42.256821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:42.256821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:42.256821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:42.256821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:42.256821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:42.256821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:04:42.256821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:04:42.256821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:04:42.257660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:04:42.257660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:42.257660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:42.257660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:42.257660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:42.257660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:42.257660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:42.257660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:42.257660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:42.257660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:42.257660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:42.257660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:42.257660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:42.257660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:42.257660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:42.257660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:42.257660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:42.258635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:04:42.258635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:04:42.258635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:04:42.258635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:04:42.258635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:04:42.258635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:04:42.258635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:42.258635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:42.258635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 254/521] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:42.259104 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99623554-9b52-4c04-8d48-014fa4d7135f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:42.334166 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:42.335738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4db8e-2c87-4d6a-a84f-7e2a3e89c6c5 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:42.364920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99623554-9b52-4c04-8d48-014fa4d7135f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:42.373924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccb0ac-decc-4d42-b224-2b76e5a6330a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:42.374545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccb0ac-decc-4d42-b224-2b76e5a6330a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:42.374830 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccb0ac-decc-4d42-b224-2b76e5a6330a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:42.375108 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccb0ac-decc-4d42-b224-2b76e5a6330a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:42.400638 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1536322-d3e8-4414-b4ec-e2bfde82db49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:42.401283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1536322-d3e8-4414-b4ec-e2bfde82db49 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:42.401565 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1536322-d3e8-4414-b4ec-e2bfde82db49 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:42.401838 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1536322-d3e8-4414-b4ec-e2bfde82db49 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:42.402527 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1536322-d3e8-4414-b4ec-e2bfde82db49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:42.402830 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1536322-d3e8-4414-b4ec-e2bfde82db49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:42.404210 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1536322-d3e8-4414-b4ec-e2bfde82db49 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:42.421240 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 255/522] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:42.421240 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1536322-d3e8-4414-b4ec-e2bfde82db49 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:42.430837 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:42.453021 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ccb0ac-decc-4d42-b224-2b76e5a6330a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:42.454514 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ccb0ac-decc-4d42-b224-2b76e5a6330a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:42.522884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1536322-d3e8-4414-b4ec-e2bfde82db49 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:42.554199 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:42.560520 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 268/523] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:42 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:42.560520 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccb0ac-decc-4d42-b224-2b76e5a6330a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:42.562518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0c1c5-dd9a-4dfd-a912-18c149f0cab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:42.563156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0c1c5-dd9a-4dfd-a912-18c149f0cab6 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:42.563433 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0c1c5-dd9a-4dfd-a912-18c149f0cab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:42.563704 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0c1c5-dd9a-4dfd-a912-18c149f0cab6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:42.570699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0c1c5-dd9a-4dfd-a912-18c149f0cab6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:42.572160 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0c1c5-dd9a-4dfd-a912-18c149f0cab6 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:42.584119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-0cf0c1c5-dd9a-4dfd-a912-18c149f0cab6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:42.584119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:42.584119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:42.584119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:42.584119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:42.584119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:42.584119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:42.584119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:42.584119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:42.584119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:42.584119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:42.584119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:42.584119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:04:42.584119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:04:42.584119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:04:42.585078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:04:42.585078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:42.585078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:42.585078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:42.585078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:42.585078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:42.585078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:42.585078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:42.585078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:42.585078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:42.585078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:42.585078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:42.585078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:42.585078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:42.585078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:42.585078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:42.585078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:42.585946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:04:42.585946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:04:42.585946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:04:42.585946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:04:42.585946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:04:42.585946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:04:42.585946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:42.585946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:42.585946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 256/524] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:42.586411 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0c1c5-dd9a-4dfd-a912-18c149f0cab6 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:42.642444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:42.664594 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccb0ac-decc-4d42-b224-2b76e5a6330a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:42.699536 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc007c7d-ef35-44fd-b590-5cc012e9c0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:42.700156 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc007c7d-ef35-44fd-b590-5cc012e9c0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:42.700443 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc007c7d-ef35-44fd-b590-5cc012e9c0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:42.700748 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc007c7d-ef35-44fd-b590-5cc012e9c0d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:42.701502 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc007c7d-ef35-44fd-b590-5cc012e9c0d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:42.701815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc007c7d-ef35-44fd-b590-5cc012e9c0d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:42.702809 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0c1c5-dd9a-4dfd-a912-18c149f0cab6 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:42.703245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc007c7d-ef35-44fd-b590-5cc012e9c0d4 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:42.720467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 269/525] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:04:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:42.721817 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc007c7d-ef35-44fd-b590-5cc012e9c0d4 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:42.748642 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037719fb-820a-4821-bca3-d6294e95f40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:42.749898 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037719fb-820a-4821-bca3-d6294e95f40c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:42.750597 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037719fb-820a-4821-bca3-d6294e95f40c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:42.751049 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037719fb-820a-4821-bca3-d6294e95f40c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:42.760507 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037719fb-820a-4821-bca3-d6294e95f40c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:42.762584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037719fb-820a-4821-bca3-d6294e95f40c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:42.776060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-037719fb-820a-4821-bca3-d6294e95f40c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 16:04:42.776060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:42.776060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:42.776060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:42.776060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:42.776060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:42.776060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:42.776060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:42.776060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:42.776060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:42.776060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:42.776060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:42.776060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:04:42.776060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:04:42.776060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:04:42.776060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:04:42.777079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:42.777079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:42.777079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:04:42.777079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:42.777079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:04:42.777079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:42.777079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:42.777079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:42.777079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:42.777079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:42.777079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:42.777079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:42.777079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:42.777079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:42.777079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:42.777079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:42.777079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:42.777079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:42.777964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:42.777964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:42.777964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:04:42.777964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:04:42.777964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:04:42.777964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:04:42.777964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:04:42.777964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:04:42.777964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 16:04:42.777964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:42.780979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 257/526] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:04:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:42.782165 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037719fb-820a-4821-bca3-d6294e95f40c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:42.835444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc007c7d-ef35-44fd-b590-5cc012e9c0d4 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:42.839276 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:42.881192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986169c6-636e-4e37-b5b8-5d73e52151d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:42.881837 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986169c6-636e-4e37-b5b8-5d73e52151d9 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:42.882119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986169c6-636e-4e37-b5b8-5d73e52151d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:42.882398 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986169c6-636e-4e37-b5b8-5d73e52151d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:42.889076 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037719fb-820a-4821-bca3-d6294e95f40c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:42.890201 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:42.894929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986169c6-636e-4e37-b5b8-5d73e52151d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:42.896381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986169c6-636e-4e37-b5b8-5d73e52151d9 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:42.915017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-986169c6-636e-4e37-b5b8-5d73e52151d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:42.915017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:42.915017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:42.915017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:42.915017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:42.915017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:42.915017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:42.915017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:42.915017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:42.915017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:42.915017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:42.915017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:42.915017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:42.915017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:42.915017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:42.915902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:42.915902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:42.915902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:42.915902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:42.915902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:42.915902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:42.915902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:42.915902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:42.915902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:42.915902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:42.915902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:42.915902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:42.915902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:42.915902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:42.915902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:42.915902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:42.915902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:42.916791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:42.916791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:42.916791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:42.916791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:42.916791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 270/527] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:42.916791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986169c6-636e-4e37-b5b8-5d73e52151d9 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:42.934523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be8af7-d062-40f8-94e2-1bca621080b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:42.935157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be8af7-d062-40f8-94e2-1bca621080b0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:42.935440 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be8af7-d062-40f8-94e2-1bca621080b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:42.935713 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be8af7-d062-40f8-94e2-1bca621080b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:42.936470 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be8af7-d062-40f8-94e2-1bca621080b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:42.936818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be8af7-d062-40f8-94e2-1bca621080b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:42.938262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be8af7-d062-40f8-94e2-1bca621080b0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:42.957962 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 258/528] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:04:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:42.958998 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be8af7-d062-40f8-94e2-1bca621080b0 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:43.029247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986169c6-636e-4e37-b5b8-5d73e52151d9 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:43.060800 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be8af7-d062-40f8-94e2-1bca621080b0 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:43.066315 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e35c1-8226-483e-807c-7a741ec826e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:43.066926 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e35c1-8226-483e-807c-7a741ec826e1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:43.067209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e35c1-8226-483e-807c-7a741ec826e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:43.067607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e35c1-8226-483e-807c-7a741ec826e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:43.068385 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e35c1-8226-483e-807c-7a741ec826e1 None admin] RBAC: Adding query filter params (role.id=6540af5baf2c4ff78d0fedfc4bea4e46, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=f7eac931cabf4921b6dbd42f63b9300f) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:43.068722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e35c1-8226-483e-807c-7a741ec826e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:43.070270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e35c1-8226-483e-807c-7a741ec826e1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:43.073367 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:43.075935 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 271/529] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:04:42 2022] GET /identity/v3/role_assignments?user.id=f7eac931cabf4921b6dbd42f63b9300f&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=6540af5baf2c4ff78d0fedfc4bea4e46 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:43.076728 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e35c1-8226-483e-807c-7a741ec826e1 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:43.108646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b103524-2aa7-47be-b075-c77ff047fad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:43.109329 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b103524-2aa7-47be-b075-c77ff047fad2 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:43.109610 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b103524-2aa7-47be-b075-c77ff047fad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:43.109941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b103524-2aa7-47be-b075-c77ff047fad2 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:43.110819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b103524-2aa7-47be-b075-c77ff047fad2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:43.111136 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b103524-2aa7-47be-b075-c77ff047fad2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:43.112709 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b103524-2aa7-47be-b075-c77ff047fad2 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:43.138966 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 259/530] 10.222.0.141 () {56 vars in 1144 bytes} [Tue Jul 26 16:04:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:43.139924 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b103524-2aa7-47be-b075-c77ff047fad2 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:43.169990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:43.229449 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e35c1-8226-483e-807c-7a741ec826e1 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:43.256927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b103524-2aa7-47be-b075-c77ff047fad2 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:43.280709 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f5a86-41b4-487a-97c6-881960c66f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:43.281826 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f5a86-41b4-487a-97c6-881960c66f97 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:43.282392 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f5a86-41b4-487a-97c6-881960c66f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:43.282852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f5a86-41b4-487a-97c6-881960c66f97 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:43.284431 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f5a86-41b4-487a-97c6-881960c66f97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:43.284978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f5a86-41b4-487a-97c6-881960c66f97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:43.287068 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f5a86-41b4-487a-97c6-881960c66f97 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:43.295783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed587704-40e2-443f-86d5-df5e396ae5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:43.296508 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed587704-40e2-443f-86d5-df5e396ae5fc None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:43.297332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed587704-40e2-443f-86d5-df5e396ae5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:43.297944 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed587704-40e2-443f-86d5-df5e396ae5fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:43.298811 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed587704-40e2-443f-86d5-df5e396ae5fc None admin] RBAC: Adding query filter params (role.id=6540af5baf2c4ff78d0fedfc4bea4e46, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=bb13d9d5d05a456fb2cb33a380c505f4) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:43.299290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed587704-40e2-443f-86d5-df5e396ae5fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:43.300830 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed587704-40e2-443f-86d5-df5e396ae5fc None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:43.305524 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 272/531] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:43.306553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f5a86-41b4-487a-97c6-881960c66f97 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:43.313392 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 260/532] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:04:43 2022] GET /identity/v3/role_assignments?user.id=bb13d9d5d05a456fb2cb33a380c505f4&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=6540af5baf2c4ff78d0fedfc4bea4e46 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:43.314330 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed587704-40e2-443f-86d5-df5e396ae5fc None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:43.375443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:43.507512 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed587704-40e2-443f-86d5-df5e396ae5fc None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:43.538656 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f5a86-41b4-487a-97c6-881960c66f97 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:43.544097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a85f3-1bfe-4b5b-888e-a41e079e7091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:43.544786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a85f3-1bfe-4b5b-888e-a41e079e7091 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:43.545069 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a85f3-1bfe-4b5b-888e-a41e079e7091 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:43.545342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a85f3-1bfe-4b5b-888e-a41e079e7091 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:43.553295 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a85f3-1bfe-4b5b-888e-a41e079e7091 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:43.554759 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a85f3-1bfe-4b5b-888e-a41e079e7091 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:43.568355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-d32a85f3-1bfe-4b5b-888e-a41e079e7091 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:43.568355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:43.568355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:43.568355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:43.568355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:43.568355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:43.568355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:43.568355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:43.568355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:43.568355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:43.568355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:43.568355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:43.568355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:04:43.568355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:04:43.568355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:04:43.569248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:04:43.569248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:43.569248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:43.569248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:43.569248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:43.569248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:43.569248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:43.569248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:43.569248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:43.569248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:43.569248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:43.569248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:43.569248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:43.569248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:43.569248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:43.569248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:43.569248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:43.570088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:04:43.570088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:04:43.570088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:04:43.570088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:04:43.570088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:04:43.570088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:04:43.570088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:43.570088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:43.570088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 261/533] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:43.577176 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:43.581841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a85f3-1bfe-4b5b-888e-a41e079e7091 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:43.599047 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e5887-1baa-42c3-853e-cbd16694b1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:43.599734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e5887-1baa-42c3-853e-cbd16694b1dc None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:43.600284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e5887-1baa-42c3-853e-cbd16694b1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:43.600747 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e5887-1baa-42c3-853e-cbd16694b1dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:43.672219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e5887-1baa-42c3-853e-cbd16694b1dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:43.673896 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e5887-1baa-42c3-853e-cbd16694b1dc None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:43.761052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:43.767133 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a85f3-1bfe-4b5b-888e-a41e079e7091 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:43.782619 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 273/534] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:43 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:43.788325 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ca4fd-fdb3-4719-8240-6ffe12af7df3 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:43.788613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ca4fd-fdb3-4719-8240-6ffe12af7df3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:43.788929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ca4fd-fdb3-4719-8240-6ffe12af7df3 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:43.790460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 274/535] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:43 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:43.791217 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ca4fd-fdb3-4719-8240-6ffe12af7df3 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:43.802285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c4b7c-ca50-4dbc-ba1c-ac7497d35413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:43.802905 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c4b7c-ca50-4dbc-ba1c-ac7497d35413 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:43.803186 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c4b7c-ca50-4dbc-ba1c-ac7497d35413 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:43.803462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c4b7c-ca50-4dbc-ba1c-ac7497d35413 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:43.804569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c4b7c-ca50-4dbc-ba1c-ac7497d35413 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:43.805061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c4b7c-ca50-4dbc-ba1c-ac7497d35413 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:43.807095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c4b7c-ca50-4dbc-ba1c-ac7497d35413 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:43.821063 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:43.822053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 262/536] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:04:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:43.823315 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b63d-748f-4bf3-8142-d34a8815231b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:43.823871 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b63d-748f-4bf3-8142-d34a8815231b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:43.824169 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b63d-748f-4bf3-8142-d34a8815231b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:43.843836 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a537b63d-748f-4bf3-8142-d34a8815231b None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:43.849890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a537b63d-748f-4bf3-8142-d34a8815231b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:43.905920 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ca4fd-fdb3-4719-8240-6ffe12af7df3 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:43.936740 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 263/537] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:43.937779 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537b63d-748f-4bf3-8142-d34a8815231b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:43.967887 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae03bd3-8ed5-4ac3-ba6c-3c7b9faf9fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:43.968904 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae03bd3-8ed5-4ac3-ba6c-3c7b9faf9fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:43.969241 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae03bd3-8ed5-4ac3-ba6c-3c7b9faf9fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:43.969605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae03bd3-8ed5-4ac3-ba6c-3c7b9faf9fb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:43.981423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae03bd3-8ed5-4ac3-ba6c-3c7b9faf9fb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:43.983185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae03bd3-8ed5-4ac3-ba6c-3c7b9faf9fb7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:44.010510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-3ae03bd3-8ed5-4ac3-ba6c-3c7b9faf9fb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:44.010510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:44.010510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:44.010510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:44.010510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:44.010510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:44.010510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:44.010510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:44.010510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:44.010510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:44.010510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:44.010510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:44.010510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:44.010510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:44.010510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:44.012319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:44.012319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:44.012319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:44.012319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:44.012319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:44.012319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:44.012319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:44.012319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:44.012319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:44.012319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:44.012319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:44.012319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:44.012319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:44.012319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:44.012319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:44.012319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:44.012319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:44.014268 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:44.014268 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:44.014268 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:44.014268 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:44.016306 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 275/538] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:44.017999 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae03bd3-8ed5-4ac3-ba6c-3c7b9faf9fb7 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:44.076889 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:44.107469 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537b63d-748f-4bf3-8142-d34a8815231b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:44.137079 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:44.171383 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465a442-5692-4da8-b448-a449219acf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:44.173227 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465a442-5692-4da8-b448-a449219acf13 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:44.174559 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465a442-5692-4da8-b448-a449219acf13 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:44.175282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465a442-5692-4da8-b448-a449219acf13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:44.176896 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465a442-5692-4da8-b448-a449219acf13 None admin] RBAC: Adding query filter params (role.id=6540af5baf2c4ff78d0fedfc4bea4e46, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=5d25aebc2bbc47b5adb7200275c98d90) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:44.177643 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465a442-5692-4da8-b448-a449219acf13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:44.180545 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465a442-5692-4da8-b448-a449219acf13 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:44.190558 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 264/539] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:04:43 2022] GET /identity/v3/role_assignments?user.id=5d25aebc2bbc47b5adb7200275c98d90&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=6540af5baf2c4ff78d0fedfc4bea4e46 => generated 260 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:44.192125 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465a442-5692-4da8-b448-a449219acf13 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:44.199935 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae03bd3-8ed5-4ac3-ba6c-3c7b9faf9fb7 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:44.260703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9169c-55c3-4c2f-bc9e-7ed798fa4bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:44.261844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9169c-55c3-4c2f-bc9e-7ed798fa4bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:44.262408 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9169c-55c3-4c2f-bc9e-7ed798fa4bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:44.262936 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9169c-55c3-4c2f-bc9e-7ed798fa4bb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:44.281525 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9169c-55c3-4c2f-bc9e-7ed798fa4bb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:44.292340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-62a9169c-55c3-4c2f-bc9e-7ed798fa4bb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:44.292340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:44.292340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:44.292340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:44.292340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:44.292340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:44.292340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:44.292340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:44.292340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:44.292340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:44.292340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:44.292340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:44.292340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:44.292340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:44.292340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:44.292340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:44.294094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:44.294094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:44.294094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:44.294094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:44.294094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:44.294094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:44.294094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:44.294094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:44.294094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:44.294094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:44.294094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:44.294094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:44.294094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:44.294094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:44.294094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:44.294094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:44.295571 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:44.295571 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:44.295571 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:44.295571 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:44.295571 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:44.295571 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:44.295571 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:44.295571 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:44.295571 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:44.295571 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:44.295571 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:44.295571 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:44.300984 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 276/540] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:04:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:44.305367 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9169c-55c3-4c2f-bc9e-7ed798fa4bb8 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:44.413065 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465a442-5692-4da8-b448-a449219acf13 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:44.475288 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9169c-55c3-4c2f-bc9e-7ed798fa4bb8 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:44.495395 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665a433-0e53-4a18-9484-548ba4f1cf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:44.496828 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665a433-0e53-4a18-9484-548ba4f1cf75 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:44.497522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665a433-0e53-4a18-9484-548ba4f1cf75 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:44.498213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665a433-0e53-4a18-9484-548ba4f1cf75 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:44.499670 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665a433-0e53-4a18-9484-548ba4f1cf75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:44.500446 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665a433-0e53-4a18-9484-548ba4f1cf75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:44.503359 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665a433-0e53-4a18-9484-548ba4f1cf75 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:44.524440 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 265/541] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:44.529424 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665a433-0e53-4a18-9484-548ba4f1cf75 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:44.538436 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:44.544468 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:44.552206 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f6434-05b6-4aa5-952d-725626cc7d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:44.553215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f6434-05b6-4aa5-952d-725626cc7d77 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:44.553630 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f6434-05b6-4aa5-952d-725626cc7d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:44.554026 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f6434-05b6-4aa5-952d-725626cc7d77 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:44.554863 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f6434-05b6-4aa5-952d-725626cc7d77 None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:44.555311 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f6434-05b6-4aa5-952d-725626cc7d77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:44.557304 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f6434-05b6-4aa5-952d-725626cc7d77 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:44.567578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 277/542] 10.222.0.141 () {56 vars in 1108 bytes} [Tue Jul 26 16:04:44 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:44.573322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f6434-05b6-4aa5-952d-725626cc7d77 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:44.696273 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665a433-0e53-4a18-9484-548ba4f1cf75 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:44.733837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391a69f-ae56-4a73-bba2-76e4387da713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:44.735005 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391a69f-ae56-4a73-bba2-76e4387da713 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:44.735489 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391a69f-ae56-4a73-bba2-76e4387da713 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:44.736135 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391a69f-ae56-4a73-bba2-76e4387da713 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:44.743669 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391a69f-ae56-4a73-bba2-76e4387da713 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:44.745385 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391a69f-ae56-4a73-bba2-76e4387da713 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:44.759205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-c391a69f-ae56-4a73-bba2-76e4387da713 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:44.759205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:44.759205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:44.759205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:44.759205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:44.759205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:44.759205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:44.759205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:44.759205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:44.759205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:44.759205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:44.759205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:44.759205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:04:44.759205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:04:44.759205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:04:44.760075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:04:44.760075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:44.760075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:44.760075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:44.760075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:44.760075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:44.760075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:44.760075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:44.760075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:44.760075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:44.760075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:44.760075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:44.760075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:44.760075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:44.760075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:44.760075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:44.760075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:44.760936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:04:44.760936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:04:44.760936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:04:44.760936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:04:44.760936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:04:44.760936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:04:44.760936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:44.760936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:44.763290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 266/543] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:04:44.769538 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391a69f-ae56-4a73-bba2-76e4387da713 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:44.795448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f6434-05b6-4aa5-952d-725626cc7d77 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:44.866097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:44.880864 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391a69f-ae56-4a73-bba2-76e4387da713 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:44.897397 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35359b71-eea1-4d0c-9169-a47eb810abe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:44.898064 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35359b71-eea1-4d0c-9169-a47eb810abe0 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:44.898352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35359b71-eea1-4d0c-9169-a47eb810abe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:44.898624 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35359b71-eea1-4d0c-9169-a47eb810abe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:44.920853 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a6e9c-fb89-4e5c-9e6f-4acaf51933ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:44.921987 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a6e9c-fb89-4e5c-9e6f-4acaf51933ec None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:44.922737 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a6e9c-fb89-4e5c-9e6f-4acaf51933ec None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:44.923227 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a6e9c-fb89-4e5c-9e6f-4acaf51933ec None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:44.924222 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a6e9c-fb89-4e5c-9e6f-4acaf51933ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:44.924755 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a6e9c-fb89-4e5c-9e6f-4acaf51933ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:44.925842 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35359b71-eea1-4d0c-9169-a47eb810abe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:44.927078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a6e9c-fb89-4e5c-9e6f-4acaf51933ec None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:44.927297 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35359b71-eea1-4d0c-9169-a47eb810abe0 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:44.948129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 267/544] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:04:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:44.954741 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a6e9c-fb89-4e5c-9e6f-4acaf51933ec None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:44.970441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-35359b71-eea1-4d0c-9169-a47eb810abe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:44.970441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:44.970441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:44.970441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:44.970441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:44.970441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:44.970441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:44.970441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:44.970441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:44.970441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:44.970441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:44.970441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:44.970441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:44.970441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:44.970441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:44.971357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:44.971357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:44.971357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:44.971357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:44.971357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:44.971357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:44.971357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:44.971357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:44.971357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:44.971357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:44.971357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:44.971357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:44.971357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:44.971357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:44.971357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:44.971357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:44.971357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:44.972170 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:44.972170 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:44.972170 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:44.972170 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:44.972170 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 278/545] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:44.977802 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35359b71-eea1-4d0c-9169-a47eb810abe0 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:45.050969 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:45.120126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a6e9c-fb89-4e5c-9e6f-4acaf51933ec None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:45.193388 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:45.200185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35359b71-eea1-4d0c-9169-a47eb810abe0 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:45.208514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a08d05-5e4c-4542-99c9-30461254cba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:45.209176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a08d05-5e4c-4542-99c9-30461254cba1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:45.209456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a08d05-5e4c-4542-99c9-30461254cba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:45.209730 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a08d05-5e4c-4542-99c9-30461254cba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:45.210639 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a08d05-5e4c-4542-99c9-30461254cba1 None admin] RBAC: Adding query filter params (role.id=6540af5baf2c4ff78d0fedfc4bea4e46, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=d1a99faad91b4357973f4bbb6632c724) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:45.210953 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a08d05-5e4c-4542-99c9-30461254cba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:45.212679 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a08d05-5e4c-4542-99c9-30461254cba1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:45.225039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 268/546] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:04:44 2022] GET /identity/v3/role_assignments?user.id=d1a99faad91b4357973f4bbb6632c724&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=6540af5baf2c4ff78d0fedfc4bea4e46 => generated 260 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:45.244481 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c122c1d-3a2f-42bd-b199-26887762205a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:45.245135 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c122c1d-3a2f-42bd-b199-26887762205a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:45.245411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c122c1d-3a2f-42bd-b199-26887762205a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:45.245926 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c122c1d-3a2f-42bd-b199-26887762205a None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:45.246372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c122c1d-3a2f-42bd-b199-26887762205a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:45.246668 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c122c1d-3a2f-42bd-b199-26887762205a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:45.248063 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c122c1d-3a2f-42bd-b199-26887762205a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:45.272239 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 279/547] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:45.277296 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a08d05-5e4c-4542-99c9-30461254cba1 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:45.405296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226a8e2-664d-48f6-8dd3-91aea5e54ce8 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:45.405620 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226a8e2-664d-48f6-8dd3-91aea5e54ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:45.405849 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226a8e2-664d-48f6-8dd3-91aea5e54ce8 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:45.407184 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 280/548] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:04:45.416332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1fecf-a6e6-4e93-9281-eab6141b60cb None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:45.416620 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1fecf-a6e6-4e93-9281-eab6141b60cb None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:45.416923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1fecf-a6e6-4e93-9281-eab6141b60cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:45.433375 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a08d05-5e4c-4542-99c9-30461254cba1 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:45.436227 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-eca1fecf-a6e6-4e93-9281-eab6141b60cb None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:45.437464 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-eca1fecf-a6e6-4e93-9281-eab6141b60cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:45.468909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8298ba-21db-48ef-bf94-8f783895a72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:45.471530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8298ba-21db-48ef-bf94-8f783895a72a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:45.471735 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8298ba-21db-48ef-bf94-8f783895a72a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:45.472091 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8298ba-21db-48ef-bf94-8f783895a72a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:45.479924 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8298ba-21db-48ef-bf94-8f783895a72a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:45.481528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8298ba-21db-48ef-bf94-8f783895a72a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:45.493682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-cc8298ba-21db-48ef-bf94-8f783895a72a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 16:04:45.493682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:45.493682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:45.493682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:45.493682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:45.493682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:45.493682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:45.493682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:45.493682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:45.493682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:45.493682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:45.493682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:45.493682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:04:45.493682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:04:45.493682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:04:45.493682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:04:45.495881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:45.495881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:45.495881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:04:45.495881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:45.495881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:04:45.495881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:45.495881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:45.495881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:45.495881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:45.495881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:45.495881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:45.495881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:45.495881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:45.495881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:45.495881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:45.495881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:45.495881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:45.495881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:45.498084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:45.498084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:45.498084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:04:45.498084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:04:45.498084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:04:45.498084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:04:45.498084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:04:45.498084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:04:45.498084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 16:04:45.498084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:45.498084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 269/549] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:04:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:45.503789 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8298ba-21db-48ef-bf94-8f783895a72a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:45.570667 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 281/550] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:04:45.583582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:45.603709 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1fecf-a6e6-4e93-9281-eab6141b60cb None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:45.655713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:45.665593 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8298ba-21db-48ef-bf94-8f783895a72a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:45.718725 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c8320-4131-4ce3-b347-b57b48d85b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:45.720173 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c8320-4131-4ce3-b347-b57b48d85b8f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:45.720487 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c8320-4131-4ce3-b347-b57b48d85b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:45.721321 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c8320-4131-4ce3-b347-b57b48d85b8f None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:45.722121 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c8320-4131-4ce3-b347-b57b48d85b8f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:45.722427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c8320-4131-4ce3-b347-b57b48d85b8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:45.723865 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c8320-4131-4ce3-b347-b57b48d85b8f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:45.751287 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 270/551] 10.222.0.141 () {56 vars in 1140 bytes} [Tue Jul 26 16:04:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:45.752491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1fecf-a6e6-4e93-9281-eab6141b60cb None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:45.752808 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb931f47-0203-4d27-9547-49f94c8ec2dc None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:45.753095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb931f47-0203-4d27-9547-49f94c8ec2dc None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:45.753372 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb931f47-0203-4d27-9547-49f94c8ec2dc None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:45.755377 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 271/552] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:45.757437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb931f47-0203-4d27-9547-49f94c8ec2dc None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:45.793381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a125a83-693d-4e9d-a536-9e1a0f7434dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:45.794005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a125a83-693d-4e9d-a536-9e1a0f7434dc None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:45.794300 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a125a83-693d-4e9d-a536-9e1a0f7434dc None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:45.794854 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a125a83-693d-4e9d-a536-9e1a0f7434dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:45.806260 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a125a83-693d-4e9d-a536-9e1a0f7434dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:45.811212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-1a125a83-693d-4e9d-a536-9e1a0f7434dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:45.811212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:45.811212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:45.811212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:45.811212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:45.811212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:45.811212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:45.811212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:45.811212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:45.811212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:45.811212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:45.811212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:45.811212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:45.811212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:45.811212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:45.811212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:45.812103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:45.812103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:45.812103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:45.812103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:45.812103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:45.812103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:45.812103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:45.812103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:45.812103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:45.812103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:45.812103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:45.812103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:45.812103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:45.812103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:45.812103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:45.812103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:45.812956 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:45.812956 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:45.812956 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:45.812956 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:45.812956 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:45.812956 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:45.812956 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:45.812956 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:45.812956 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:45.812956 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:45.812956 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:45.812956 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:45.812956 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 282/553] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:04:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:04:45.814529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2132e78-190e-4e70-90e7-86ccdcee0726 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:45.814529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2132e78-190e-4e70-90e7-86ccdcee0726 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:45.814529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2132e78-190e-4e70-90e7-86ccdcee0726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:45.834340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c2132e78-190e-4e70-90e7-86ccdcee0726 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:45.835707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c2132e78-190e-4e70-90e7-86ccdcee0726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:45.898573 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb931f47-0203-4d27-9547-49f94c8ec2dc None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:45.916727 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 283/554] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:45.917693 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2132e78-190e-4e70-90e7-86ccdcee0726 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:45.918358 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:45.950666 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da303b-3998-4457-8bce-5e4d4dd53c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:45.951543 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da303b-3998-4457-8bce-5e4d4dd53c93 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:45.951829 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da303b-3998-4457-8bce-5e4d4dd53c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:45.952103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da303b-3998-4457-8bce-5e4d4dd53c93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:45.959321 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:46.040173 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da303b-3998-4457-8bce-5e4d4dd53c93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:46.041954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da303b-3998-4457-8bce-5e4d4dd53c93 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:46.046236 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2132e78-190e-4e70-90e7-86ccdcee0726 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:46.085879 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3eac0-6584-4057-bd1c-092765804566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:46.086748 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3eac0-6584-4057-bd1c-092765804566 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:46.087168 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3eac0-6584-4057-bd1c-092765804566 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:46.087579 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3eac0-6584-4057-bd1c-092765804566 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:46.088429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3eac0-6584-4057-bd1c-092765804566 None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:46.089910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3eac0-6584-4057-bd1c-092765804566 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:46.090786 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3eac0-6584-4057-bd1c-092765804566 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:46.100647 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 284/555] 10.222.0.141 () {56 vars in 1108 bytes} [Tue Jul 26 16:04:45 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:46.101801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3eac0-6584-4057-bd1c-092765804566 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:46.170509 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 272/556] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:45 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 16:04:46.171610 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da303b-3998-4457-8bce-5e4d4dd53c93 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:46.187126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:46.209572 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:46.229994 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3eac0-6584-4057-bd1c-092765804566 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:46.269440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490ccc7-eb58-4f38-b73d-804006f0488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:46.270369 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490ccc7-eb58-4f38-b73d-804006f0488b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:46.270518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490ccc7-eb58-4f38-b73d-804006f0488b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:46.270724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490ccc7-eb58-4f38-b73d-804006f0488b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:46.281960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490ccc7-eb58-4f38-b73d-804006f0488b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:46.287755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-e490ccc7-eb58-4f38-b73d-804006f0488b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:46.287755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:46.287755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:46.287755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:46.287755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:46.287755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:46.287755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:46.287755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:46.287755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:46.287755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:46.287755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:46.287755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:46.287755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:46.287755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:46.287755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:46.287755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:46.288958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:46.288958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:46.288958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:46.288958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:46.288958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:46.288958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:46.288958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:46.288958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:46.288958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:46.288958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:46.288958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:46.288958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:46.288958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:46.288958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:46.288958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:46.288958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:46.289968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:46.289968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:46.289968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:46.289968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:46.289968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:46.289968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:46.289968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:46.289968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:46.289968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:46.289968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:46.289968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:46.289968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:46.289968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 285/557] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:04:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:46.289968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490ccc7-eb58-4f38-b73d-804006f0488b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:46.300184 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da303b-3998-4457-8bce-5e4d4dd53c93 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:46.337215 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e354695-cea6-4da8-aa55-14ae231341d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:46.338207 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e354695-cea6-4da8-aa55-14ae231341d8 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:46.338719 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e354695-cea6-4da8-aa55-14ae231341d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:46.339193 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e354695-cea6-4da8-aa55-14ae231341d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:46.349836 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e354695-cea6-4da8-aa55-14ae231341d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:46.351543 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e354695-cea6-4da8-aa55-14ae231341d8 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:46.367818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-2e354695-cea6-4da8-aa55-14ae231341d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:46.367818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:46.367818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:46.367818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:46.367818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:46.367818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:46.367818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:46.367818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:46.367818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:46.367818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:46.367818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:46.367818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:46.367818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:46.367818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:46.367818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:46.369225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:46.369225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:46.369225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:46.369225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:46.369225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:46.369225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:46.369225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:46.369225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:46.369225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:46.369225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:46.369225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:46.369225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:46.369225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:46.369225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:46.369225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:46.369225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:46.369225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:46.370085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:46.370085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:46.370085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:46.370085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:46.372287 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 273/558] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:46.373369 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e354695-cea6-4da8-aa55-14ae231341d8 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:46.405360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490ccc7-eb58-4f38-b73d-804006f0488b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:46.436937 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:46.443851 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3572a-f446-4144-a16b-4a29d4c73f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:46.444483 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3572a-f446-4144-a16b-4a29d4c73f57 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:46.444796 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3572a-f446-4144-a16b-4a29d4c73f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:46.445082 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3572a-f446-4144-a16b-4a29d4c73f57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:46.458374 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3572a-f446-4144-a16b-4a29d4c73f57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:46.459891 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3572a-f446-4144-a16b-4a29d4c73f57 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:46.461748 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:46.477050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-03e3572a-f446-4144-a16b-4a29d4c73f57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:46.477050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:46.477050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:46.477050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:46.477050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:46.477050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:46.477050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:46.477050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:46.477050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:46.477050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:46.477050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:46.477050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:46.477050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:46.477050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:46.477050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:46.478018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:46.478018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:46.478018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:46.478018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:46.478018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:46.478018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:46.478018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:46.478018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:46.478018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:46.478018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:46.478018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:46.478018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:46.478018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:46.478018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:46.478018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:46.478018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:46.478018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:46.478952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:46.478952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:46.478952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:46.478952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:46.480674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 286/559] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:46.481590 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3572a-f446-4144-a16b-4a29d4c73f57 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:46.481835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e354695-cea6-4da8-aa55-14ae231341d8 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:46.523068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3583d-49c5-41a6-9012-a0d617c84e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:46.523827 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3583d-49c5-41a6-9012-a0d617c84e83 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:46.524182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3583d-49c5-41a6-9012-a0d617c84e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:46.524560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3583d-49c5-41a6-9012-a0d617c84e83 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:46.525426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3583d-49c5-41a6-9012-a0d617c84e83 None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:46.525807 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3583d-49c5-41a6-9012-a0d617c84e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:46.527476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3583d-49c5-41a6-9012-a0d617c84e83 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:46.542912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 274/560] 10.222.0.141 () {56 vars in 1108 bytes} [Tue Jul 26 16:04:46 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:46.543979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3583d-49c5-41a6-9012-a0d617c84e83 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:46.599338 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3572a-f446-4144-a16b-4a29d4c73f57 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:46.636365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477de822-9591-4892-acf9-c15ca55c77c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:46.637336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477de822-9591-4892-acf9-c15ca55c77c6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:46.637906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477de822-9591-4892-acf9-c15ca55c77c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:46.638391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477de822-9591-4892-acf9-c15ca55c77c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:46.639274 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477de822-9591-4892-acf9-c15ca55c77c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:46.639776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477de822-9591-4892-acf9-c15ca55c77c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:46.641575 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477de822-9591-4892-acf9-c15ca55c77c6 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:46.649552 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3583d-49c5-41a6-9012-a0d617c84e83 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:46.659258 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 287/561] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:46.660547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477de822-9591-4892-acf9-c15ca55c77c6 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:46.677076 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:46.685449 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96432e42-0236-43ff-865f-ddb7e5ff064d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:46.686171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96432e42-0236-43ff-865f-ddb7e5ff064d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:46.686476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96432e42-0236-43ff-865f-ddb7e5ff064d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:46.686882 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96432e42-0236-43ff-865f-ddb7e5ff064d None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:46.687631 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96432e42-0236-43ff-865f-ddb7e5ff064d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:46.688008 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96432e42-0236-43ff-865f-ddb7e5ff064d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:46.690429 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96432e42-0236-43ff-865f-ddb7e5ff064d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:46.707797 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 275/562] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:46.708614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96432e42-0236-43ff-865f-ddb7e5ff064d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:46.719441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:46.763978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477de822-9591-4892-acf9-c15ca55c77c6 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:46.800158 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9197586-c304-4248-a238-995e99c4fb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:46.800832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9197586-c304-4248-a238-995e99c4fb02 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:46.801117 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9197586-c304-4248-a238-995e99c4fb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:46.801392 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9197586-c304-4248-a238-995e99c4fb02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:46.811849 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9197586-c304-4248-a238-995e99c4fb02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:46.813330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9197586-c304-4248-a238-995e99c4fb02 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:46.820143 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96432e42-0236-43ff-865f-ddb7e5ff064d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:46.829247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-d9197586-c304-4248-a238-995e99c4fb02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:46.829247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:46.829247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:46.829247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:46.829247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:46.829247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:46.829247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:46.829247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:46.829247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:46.829247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:46.829247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:46.829247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:46.829247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:46.829247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:46.829247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:46.830175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:46.830175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:46.830175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:46.830175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:46.830175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:46.830175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:46.830175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:46.830175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:46.830175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:46.830175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:46.830175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:46.830175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:46.830175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:46.830175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:46.830175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:46.830175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:46.830175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:46.831067 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:46.831067 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:46.831067 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:46.831067 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:46.835032 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 288/563] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:46.836271 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b8861-4152-49e8-a164-63c3c9fb636a None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:46.836557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b8861-4152-49e8-a164-63c3c9fb636a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:46.836854 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b8861-4152-49e8-a164-63c3c9fb636a None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:46.838113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 289/564] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:46.838800 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b8861-4152-49e8-a164-63c3c9fb636a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:46.859414 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87e025-14df-43cc-a7b7-a7158604ea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:46.860056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87e025-14df-43cc-a7b7-a7158604ea91 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:46.860339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87e025-14df-43cc-a7b7-a7158604ea91 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:46.860613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87e025-14df-43cc-a7b7-a7158604ea91 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:46.869327 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87e025-14df-43cc-a7b7-a7158604ea91 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:46.870776 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87e025-14df-43cc-a7b7-a7158604ea91 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:46.887980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-9a87e025-14df-43cc-a7b7-a7158604ea91 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 16:04:46.887980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:46.887980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:46.887980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:46.887980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:46.887980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:46.887980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:46.887980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:46.887980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:46.887980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:46.887980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:46.887980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:46.887980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:04:46.887980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:04:46.887980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:04:46.887980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:04:46.889216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:46.889216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:46.889216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:04:46.889216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:46.889216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:04:46.889216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:46.889216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:46.889216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:46.889216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:46.889216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:46.889216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:46.889216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:46.889216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:46.889216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:46.889216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:46.889216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:46.889216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:46.889216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:46.890152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:46.890152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:46.890152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:04:46.890152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:04:46.890152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:04:46.890152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:04:46.890152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:04:46.890152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:04:46.890152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 16:04:46.890152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:46.890152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 276/565] 10.222.0.141 () {56 vars in 1098 bytes} [Tue Jul 26 16:04:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:46.890738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87e025-14df-43cc-a7b7-a7158604ea91 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:46.941141 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:46.965822 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b8861-4152-49e8-a164-63c3c9fb636a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:46.973273 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:46.997449 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87e025-14df-43cc-a7b7-a7158604ea91 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:47.000931 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8301c-69b5-4a86-80d9-6eca53392514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:47.001578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8301c-69b5-4a86-80d9-6eca53392514 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:47.001864 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8301c-69b5-4a86-80d9-6eca53392514 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:47.002166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8301c-69b5-4a86-80d9-6eca53392514 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:47.008960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8301c-69b5-4a86-80d9-6eca53392514 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:47.010452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8301c-69b5-4a86-80d9-6eca53392514 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:47.023027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-4da8301c-69b5-4a86-80d9-6eca53392514 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:47.023027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:47.023027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:47.023027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:47.023027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:47.023027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:47.023027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:47.023027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:47.023027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:47.023027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:47.023027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:47.023027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:47.023027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:04:47.023027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:04:47.023027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:04:47.025605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:04:47.025605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:47.025605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:47.025605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:47.025605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:47.025605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:47.025605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:47.025605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:47.025605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:47.025605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:47.025605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:47.025605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:47.025605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:47.025605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:47.025605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:47.025605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:47.025605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:47.026458 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:04:47.026458 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:04:47.026458 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:04:47.026458 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:04:47.026458 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:04:47.026458 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:04:47.026458 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:47.026458 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:47.026458 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 290/566] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:47.030198 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df310e-6619-4906-bf5b-a7b5b0efd127 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:47.030550 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df310e-6619-4906-bf5b-a7b5b0efd127 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:47.030899 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df310e-6619-4906-bf5b-a7b5b0efd127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:47.036795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936164c-4ac0-4bbd-9101-3f85f4bdaa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:47.037410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936164c-4ac0-4bbd-9101-3f85f4bdaa9a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:47.037699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936164c-4ac0-4bbd-9101-3f85f4bdaa9a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:47.037973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936164c-4ac0-4bbd-9101-3f85f4bdaa9a None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:47.039298 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936164c-4ac0-4bbd-9101-3f85f4bdaa9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:47.039298 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936164c-4ac0-4bbd-9101-3f85f4bdaa9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:47.040419 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936164c-4ac0-4bbd-9101-3f85f4bdaa9a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:47.050273 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f3df310e-6619-4906-bf5b-a7b5b0efd127 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:47.051557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f3df310e-6619-4906-bf5b-a7b5b0efd127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:47.054162 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 277/567] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:47.054826 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936164c-4ac0-4bbd-9101-3f85f4bdaa9a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:47.127683 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 291/568] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:47.128526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df310e-6619-4906-bf5b-a7b5b0efd127 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:47.202803 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936164c-4ac0-4bbd-9101-3f85f4bdaa9a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:47.205885 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:47.240008 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853aac50-d526-4fdc-9a58-2dd5bd254792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:47.240622 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853aac50-d526-4fdc-9a58-2dd5bd254792 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:47.240931 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853aac50-d526-4fdc-9a58-2dd5bd254792 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:47.241204 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853aac50-d526-4fdc-9a58-2dd5bd254792 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:47.241986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853aac50-d526-4fdc-9a58-2dd5bd254792 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:47.242291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853aac50-d526-4fdc-9a58-2dd5bd254792 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:47.244373 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853aac50-d526-4fdc-9a58-2dd5bd254792 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:47.260903 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 278/569] 10.222.0.141 () {56 vars in 1138 bytes} [Tue Jul 26 16:04:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:47.261711 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853aac50-d526-4fdc-9a58-2dd5bd254792 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:47.275702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:47.281337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df310e-6619-4906-bf5b-a7b5b0efd127 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:47.318988 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3e716-3910-48d7-b312-4b2b21bc4ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:47.319848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3e716-3910-48d7-b312-4b2b21bc4ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:47.320304 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3e716-3910-48d7-b312-4b2b21bc4ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:47.320590 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3e716-3910-48d7-b312-4b2b21bc4ee7 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:47.321362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3e716-3910-48d7-b312-4b2b21bc4ee7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:47.321668 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3e716-3910-48d7-b312-4b2b21bc4ee7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:47.323083 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3e716-3910-48d7-b312-4b2b21bc4ee7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:47.340182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 292/570] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:04:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:47.341004 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3e716-3910-48d7-b312-4b2b21bc4ee7 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:47.368847 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853aac50-d526-4fdc-9a58-2dd5bd254792 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:47.406684 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3228fc5-13f4-4676-aa16-f1d35fbac3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:47.407576 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3228fc5-13f4-4676-aa16-f1d35fbac3af None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:47.408247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3228fc5-13f4-4676-aa16-f1d35fbac3af None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:47.409073 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3228fc5-13f4-4676-aa16-f1d35fbac3af None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:47.417271 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3228fc5-13f4-4676-aa16-f1d35fbac3af None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:47.418820 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3228fc5-13f4-4676-aa16-f1d35fbac3af None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:47.430964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-e3228fc5-13f4-4676-aa16-f1d35fbac3af None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 16:04:47.430964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:47.430964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:47.430964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:47.430964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:47.430964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:47.430964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:47.430964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:47.430964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:47.430964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:47.430964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:47.430964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:47.430964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:04:47.430964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:04:47.430964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:04:47.430964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:04:47.431927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:47.431927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:47.431927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:04:47.431927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:47.431927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:04:47.431927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:47.431927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:47.431927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:47.431927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:47.431927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:47.431927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:47.431927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:47.431927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:47.431927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:47.431927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:47.431927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:47.431927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:47.431927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:47.432883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:47.432883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:47.432883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:04:47.432883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:04:47.432883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:04:47.432883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:04:47.432883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:04:47.432883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:04:47.432883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 16:04:47.432883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:47.432883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 279/571] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:47.432883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3228fc5-13f4-4676-aa16-f1d35fbac3af None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:47.453398 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3e716-3910-48d7-b312-4b2b21bc4ee7 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:47.460551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:47.488059 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2efc2f-470d-42d6-bc3e-dcd461a9e3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:47.488711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2efc2f-470d-42d6-bc3e-dcd461a9e3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:47.488992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2efc2f-470d-42d6-bc3e-dcd461a9e3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:47.489264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2efc2f-470d-42d6-bc3e-dcd461a9e3f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:47.499297 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2efc2f-470d-42d6-bc3e-dcd461a9e3f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:47.504738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-9e2efc2f-470d-42d6-bc3e-dcd461a9e3f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:47.504738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:47.504738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:47.504738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:47.504738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:47.504738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:47.504738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:47.504738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:47.504738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:47.504738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:47.504738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:47.504738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:47.504738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:47.504738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:47.504738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:47.504738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:47.505725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:47.505725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:47.505725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:47.505725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:47.505725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:47.505725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:47.505725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:47.505725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:47.505725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:47.505725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:47.505725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:47.505725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:47.505725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:47.505725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:47.505725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:47.505725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:47.506561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:47.506561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:47.506561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:47.506561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:47.506561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:47.506561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:47.506561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:47.506561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:47.506561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:47.506561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:47.506561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:47.506561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:47.506561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 293/572] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:04:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:47.507418 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2efc2f-470d-42d6-bc3e-dcd461a9e3f3 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:47.525342 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:47.538492 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3228fc5-13f4-4676-aa16-f1d35fbac3af None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:47.571498 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04e5b0-0923-4a74-8062-23ed9919da0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:47.572126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04e5b0-0923-4a74-8062-23ed9919da0e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:47.572403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04e5b0-0923-4a74-8062-23ed9919da0e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:47.572704 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04e5b0-0923-4a74-8062-23ed9919da0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:47.582866 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04e5b0-0923-4a74-8062-23ed9919da0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:47.584307 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04e5b0-0923-4a74-8062-23ed9919da0e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:47.599107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-bf04e5b0-0923-4a74-8062-23ed9919da0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:47.599107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:47.599107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:47.599107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:47.599107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:47.599107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:47.599107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:47.599107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:47.599107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:47.599107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:47.599107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:47.599107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:47.599107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:47.599107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:47.599107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:47.599967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:47.599967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:47.599967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:47.599967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:47.599967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:47.599967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:47.599967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:47.599967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:47.599967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:47.599967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:47.599967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:47.599967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:47.599967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:47.599967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:47.599967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:47.599967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:47.599967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:47.601058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:47.601058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:47.601058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:47.601058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:47.601058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 280/573] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:47.601058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04e5b0-0923-4a74-8062-23ed9919da0e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:47.608597 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2efc2f-470d-42d6-bc3e-dcd461a9e3f3 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:47.640524 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b683a6-b313-4c94-a7c2-7cae08faf909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:47.641159 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b683a6-b313-4c94-a7c2-7cae08faf909 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:47.641443 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b683a6-b313-4c94-a7c2-7cae08faf909 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:47.641715 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b683a6-b313-4c94-a7c2-7cae08faf909 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:47.642488 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b683a6-b313-4c94-a7c2-7cae08faf909 None admin] RBAC: Adding query filter params (role.id=6540af5baf2c4ff78d0fedfc4bea4e46, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=6c5f92f21868436a99a5c7aaa1fc40b5) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:47.643322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b683a6-b313-4c94-a7c2-7cae08faf909 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:47.644778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b683a6-b313-4c94-a7c2-7cae08faf909 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:47.660698 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 294/574] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:04:47 2022] GET /identity/v3/role_assignments?user.id=6c5f92f21868436a99a5c7aaa1fc40b5&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=6540af5baf2c4ff78d0fedfc4bea4e46 => generated 260 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:47.660698 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a45b1-9442-47b2-baec-ddc00eaa6701 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:47.660698 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a45b1-9442-47b2-baec-ddc00eaa6701 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:47.660698 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a45b1-9442-47b2-baec-ddc00eaa6701 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:47.660698 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 295/575] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:47 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:47.660698 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a45b1-9442-47b2-baec-ddc00eaa6701 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:47.684832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:47.713198 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04e5b0-0923-4a74-8062-23ed9919da0e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:47.748645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:47.752617 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce48f3c-4e4c-45c2-a694-7520f61fe134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:47.753275 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce48f3c-4e4c-45c2-a694-7520f61fe134 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:47.753556 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce48f3c-4e4c-45c2-a694-7520f61fe134 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:47.753819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce48f3c-4e4c-45c2-a694-7520f61fe134 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:47.754623 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce48f3c-4e4c-45c2-a694-7520f61fe134 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:47.754929 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce48f3c-4e4c-45c2-a694-7520f61fe134 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:47.756409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce48f3c-4e4c-45c2-a694-7520f61fe134 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:47.771723 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a45b1-9442-47b2-baec-ddc00eaa6701 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:47.782843 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 281/576] 10.222.0.141 () {56 vars in 1142 bytes} [Tue Jul 26 16:04:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:47.782843 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce48f3c-4e4c-45c2-a694-7520f61fe134 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:47.809981 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12910dad-d967-4a9c-908f-bef01527a286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:47.810598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12910dad-d967-4a9c-908f-bef01527a286 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:47.810879 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12910dad-d967-4a9c-908f-bef01527a286 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:47.811140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12910dad-d967-4a9c-908f-bef01527a286 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:47.811849 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12910dad-d967-4a9c-908f-bef01527a286 None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:47.812157 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12910dad-d967-4a9c-908f-bef01527a286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:47.813552 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12910dad-d967-4a9c-908f-bef01527a286 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:47.822743 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 296/577] 10.222.0.141 () {56 vars in 1108 bytes} [Tue Jul 26 16:04:47 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:47.823930 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc150eb6-3834-4b7d-a1d9-9fbb63a22f42 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:47.824211 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc150eb6-3834-4b7d-a1d9-9fbb63a22f42 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:47.824480 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc150eb6-3834-4b7d-a1d9-9fbb63a22f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:47.843826 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-cc150eb6-3834-4b7d-a1d9-9fbb63a22f42 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:47.845154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-cc150eb6-3834-4b7d-a1d9-9fbb63a22f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:47.887577 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce48f3c-4e4c-45c2-a694-7520f61fe134 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:47.919323 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:47.925054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03acad-5f63-450d-9f95-60aa07c35e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:47.925688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03acad-5f63-450d-9f95-60aa07c35e17 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:47.925968 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03acad-5f63-450d-9f95-60aa07c35e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:47.926242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03acad-5f63-450d-9f95-60aa07c35e17 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:47.932938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03acad-5f63-450d-9f95-60aa07c35e17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:47.932938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03acad-5f63-450d-9f95-60aa07c35e17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:47.933656 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 297/578] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:47.933656 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc150eb6-3834-4b7d-a1d9-9fbb63a22f42 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:47.933832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03acad-5f63-450d-9f95-60aa07c35e17 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:47.948543 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 282/579] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:47.950288 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03acad-5f63-450d-9f95-60aa07c35e17 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:48.014622 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:48.048034 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc150eb6-3834-4b7d-a1d9-9fbb63a22f42 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:48.054984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03acad-5f63-450d-9f95-60aa07c35e17 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:48.087086 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb7fc0-da5a-42e6-b875-a2b92bc2f54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:48.087730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb7fc0-da5a-42e6-b875-a2b92bc2f54e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:48.088009 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb7fc0-da5a-42e6-b875-a2b92bc2f54e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:48.088285 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb7fc0-da5a-42e6-b875-a2b92bc2f54e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:48.090816 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb0ff5-835c-454a-9e1b-789d3a53f424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:48.096079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb0ff5-835c-454a-9e1b-789d3a53f424 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:48.096079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb0ff5-835c-454a-9e1b-789d3a53f424 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:48.096079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb0ff5-835c-454a-9e1b-789d3a53f424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:48.099210 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb7fc0-da5a-42e6-b875-a2b92bc2f54e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:48.100677 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb7fc0-da5a-42e6-b875-a2b92bc2f54e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:48.103668 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb0ff5-835c-454a-9e1b-789d3a53f424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:48.105349 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb0ff5-835c-454a-9e1b-789d3a53f424 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:48.117381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-6beb7fc0-da5a-42e6-b875-a2b92bc2f54e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:48.117381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:48.117381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:48.117381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:48.117381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:48.117381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:48.117381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:48.117381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:48.117381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:48.117381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:48.117381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:48.117381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:48.117381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:48.117381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:48.117381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:48.118326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:48.118326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:48.118326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:48.118326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:48.118326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:48.118326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:48.118326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:48.118326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:48.118326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:48.118326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:48.118326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:48.118326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:48.118326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:48.118326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:48.118326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:48.118326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:48.118326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:48.119180 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:48.119180 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:48.119180 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:48.119180 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:48.120675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-bfdb0ff5-835c-454a-9e1b-789d3a53f424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:48.120675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:48.120675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:48.120675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:48.120675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:48.120675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:48.120675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:48.120675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:48.120675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:48.120675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:48.120675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:48.120675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:48.120675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:48.120675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:48.120675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:48.125176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:48.125176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:48.125176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:48.125176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:48.125176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:48.125176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:48.125176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:48.125176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:48.125176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:48.125176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:48.125176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:48.125176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:48.125176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:48.125176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:48.125176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:48.125176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:48.125176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:48.126131 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:48.126131 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:48.126131 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:48.126131 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:48.126131 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 283/580] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:48.126131 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb0ff5-835c-454a-9e1b-789d3a53f424 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:48.126458 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 298/581] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:48.126458 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb7fc0-da5a-42e6-b875-a2b92bc2f54e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:48.178205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:48.231580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb7fc0-da5a-42e6-b875-a2b92bc2f54e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:48.237360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb0ff5-835c-454a-9e1b-789d3a53f424 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:48.255823 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:48.268123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c740b4c-a902-449c-9c15-03d716f74126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:48.268123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c740b4c-a902-449c-9c15-03d716f74126 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:48.268123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c740b4c-a902-449c-9c15-03d716f74126 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:48.268123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c740b4c-a902-449c-9c15-03d716f74126 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:48.273613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45282492-e80b-43e1-b389-6d7fc9667d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:48.274249 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45282492-e80b-43e1-b389-6d7fc9667d5d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:48.274530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45282492-e80b-43e1-b389-6d7fc9667d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:48.274802 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45282492-e80b-43e1-b389-6d7fc9667d5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:48.279789 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c740b4c-a902-449c-9c15-03d716f74126 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:48.281567 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45282492-e80b-43e1-b389-6d7fc9667d5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:48.283008 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45282492-e80b-43e1-b389-6d7fc9667d5d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:48.285280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-5c740b4c-a902-449c-9c15-03d716f74126 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:48.285280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:48.285280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:48.285280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:48.285280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:48.285280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:48.285280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:48.285280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:48.285280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:48.285280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:48.285280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:48.285280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:48.285280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:48.285280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:48.285280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:48.285280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:48.286391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:48.286391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:48.286391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:48.286391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:48.286391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:48.286391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:48.286391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:48.286391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:48.286391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:48.286391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:48.286391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:48.286391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:48.286391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:48.286391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:48.286391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:48.286391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:48.287399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:48.287399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:48.287399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:48.287399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:48.287399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:48.287399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:48.287399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:48.287399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:48.287399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:48.287399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:48.287399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:48.287399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:48.291866 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 299/582] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:04:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:48.292886 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c740b4c-a902-449c-9c15-03d716f74126 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:48.299087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-45282492-e80b-43e1-b389-6d7fc9667d5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:48.299087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:48.299087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:48.299087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:48.299087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:48.299087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:48.299087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:48.299087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:48.299087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:48.299087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:48.299087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:48.299087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:48.299087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:04:48.299087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:04:48.299087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:04:48.300103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:04:48.300103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:48.300103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:48.300103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:48.300103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:48.300103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:48.300103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:48.300103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:48.300103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:48.300103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:48.300103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:48.300103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:48.300103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:48.300103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:48.300103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:48.300103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:48.300103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:48.301052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:04:48.301052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:04:48.301052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:04:48.301052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:04:48.301052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:04:48.301052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:04:48.301052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:48.301052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:48.301052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 284/583] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:48.301549 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45282492-e80b-43e1-b389-6d7fc9667d5d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:48.408014 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c740b4c-a902-449c-9c15-03d716f74126 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:48.409316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45282492-e80b-43e1-b389-6d7fc9667d5d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:48.413136 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:48.443633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31ac44-559b-43ad-9d73-5e7e134b4008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:48.444481 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31ac44-559b-43ad-9d73-5e7e134b4008 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:48.444950 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31ac44-559b-43ad-9d73-5e7e134b4008 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:48.445395 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31ac44-559b-43ad-9d73-5e7e134b4008 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:48.446120 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c2bce-1eeb-4b4e-9859-2054ef057edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:48.446644 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31ac44-559b-43ad-9d73-5e7e134b4008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:48.447055 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c2bce-1eeb-4b4e-9859-2054ef057edd None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:48.447312 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31ac44-559b-43ad-9d73-5e7e134b4008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:48.447538 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c2bce-1eeb-4b4e-9859-2054ef057edd None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:48.448085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c2bce-1eeb-4b4e-9859-2054ef057edd None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:48.449077 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c2bce-1eeb-4b4e-9859-2054ef057edd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:48.449640 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c2bce-1eeb-4b4e-9859-2054ef057edd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:48.449745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31ac44-559b-43ad-9d73-5e7e134b4008 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:48.451322 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c2bce-1eeb-4b4e-9859-2054ef057edd None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:48.468970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 300/584] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:48.468970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31ac44-559b-43ad-9d73-5e7e134b4008 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:48.469257 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 285/585] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:48.469257 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c2bce-1eeb-4b4e-9859-2054ef057edd None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:48.515184 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:48.570576 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31ac44-559b-43ad-9d73-5e7e134b4008 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:48.571932 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c2bce-1eeb-4b4e-9859-2054ef057edd None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:48.604115 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0183ba-98a0-476d-a226-5d1ed4f2706e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:48.604769 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0183ba-98a0-476d-a226-5d1ed4f2706e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:48.605055 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0183ba-98a0-476d-a226-5d1ed4f2706e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:48.605331 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0183ba-98a0-476d-a226-5d1ed4f2706e None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:48.606042 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0183ba-98a0-476d-a226-5d1ed4f2706e None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:48.606345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0183ba-98a0-476d-a226-5d1ed4f2706e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:48.606902 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c0454-74d3-4de9-82c1-456c4adc2293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:48.607538 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c0454-74d3-4de9-82c1-456c4adc2293 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:48.607740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0183ba-98a0-476d-a226-5d1ed4f2706e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:48.607834 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c0454-74d3-4de9-82c1-456c4adc2293 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:48.608077 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c0454-74d3-4de9-82c1-456c4adc2293 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:48.608931 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c0454-74d3-4de9-82c1-456c4adc2293 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:48.609243 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c0454-74d3-4de9-82c1-456c4adc2293 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:48.610790 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c0454-74d3-4de9-82c1-456c4adc2293 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:48.620391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 301/586] 10.222.0.141 () {56 vars in 1108 bytes} [Tue Jul 26 16:04:48 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:48.620391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0183ba-98a0-476d-a226-5d1ed4f2706e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:48.631206 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 286/587] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:04:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:48.631206 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c0454-74d3-4de9-82c1-456c4adc2293 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:48.654739 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:48.731663 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c0454-74d3-4de9-82c1-456c4adc2293 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:48.731864 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0183ba-98a0-476d-a226-5d1ed4f2706e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:48.741725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:48.769243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd07b0-f6d0-4e36-957c-2d5bd71e1711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:48.770526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd07b0-f6d0-4e36-957c-2d5bd71e1711 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:48.770640 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d5154-856b-4702-aeaa-e106d74e346f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:48.770745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd07b0-f6d0-4e36-957c-2d5bd71e1711 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:48.770745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd07b0-f6d0-4e36-957c-2d5bd71e1711 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:48.771109 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d5154-856b-4702-aeaa-e106d74e346f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:48.771461 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d5154-856b-4702-aeaa-e106d74e346f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:48.771793 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d5154-856b-4702-aeaa-e106d74e346f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:48.778325 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd07b0-f6d0-4e36-957c-2d5bd71e1711 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:48.779848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd07b0-f6d0-4e36-957c-2d5bd71e1711 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:48.779953 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d5154-856b-4702-aeaa-e106d74e346f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:48.781460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d5154-856b-4702-aeaa-e106d74e346f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:48.791894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-fafd07b0-f6d0-4e36-957c-2d5bd71e1711 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 16:04:48.791894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:48.791894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:48.791894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:48.791894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:48.791894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:48.791894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:48.791894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:48.791894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:48.791894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:48.791894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:48.791894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:48.791894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:04:48.791894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:04:48.791894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:04:48.791894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:04:48.793098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:48.793098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:48.793098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:04:48.793098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:48.793098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:04:48.793098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:48.793098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:48.793098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:48.793098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:48.793098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:48.793098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:48.793098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:48.793098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:48.793098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:48.793098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:48.793098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:48.793098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:48.793098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:48.794220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:48.794220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:48.794220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:04:48.794220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:04:48.794220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:04:48.794220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:04:48.794220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:04:48.794220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:04:48.794220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 16:04:48.794220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:48.795632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 302/588] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:48.800885 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd07b0-f6d0-4e36-957c-2d5bd71e1711 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:48.801022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-a15d5154-856b-4702-aeaa-e106d74e346f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:48.801022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:48.801022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:48.801022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:48.801022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:48.801022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:48.801022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:48.801022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:48.801022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:48.801022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:48.801022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:48.801022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:48.801022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:04:48.801022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:04:48.801022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:04:48.801832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:04:48.801832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:48.801832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:48.801832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:48.801832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:48.801832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:48.801832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:48.801832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:48.801832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:48.801832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:48.801832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:48.801832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:48.801832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:48.801832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:48.801832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:48.801832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:48.801832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:48.802775 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:04:48.802775 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:04:48.802775 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:04:48.802775 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:04:48.802775 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:04:48.802775 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:04:48.802775 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:48.802775 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:48.802775 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 287/589] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:48.802775 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d5154-856b-4702-aeaa-e106d74e346f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:48.890502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:48.906382 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d5154-856b-4702-aeaa-e106d74e346f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:48.907947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd07b0-f6d0-4e36-957c-2d5bd71e1711 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:48.949490 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff362f19-82dc-4c0e-93c6-1d86f4c251e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:48.950159 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff362f19-82dc-4c0e-93c6-1d86f4c251e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:48.950448 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff362f19-82dc-4c0e-93c6-1d86f4c251e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:48.950704 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff362f19-82dc-4c0e-93c6-1d86f4c251e8 None admin] PATH_INFO: `/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/f7eac931cabf4921b6dbd42f63b9300f/roles/6540af5baf2c4ff78d0fedfc4bea4e46` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:48.953524 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361cfb5-faf4-4321-b479-ff8fab5b8e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:48.954268 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361cfb5-faf4-4321-b479-ff8fab5b8e09 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:48.954551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361cfb5-faf4-4321-b479-ff8fab5b8e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:48.954824 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361cfb5-faf4-4321-b479-ff8fab5b8e09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:48.965583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff362f19-82dc-4c0e-93c6-1d86f4c251e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3747e176cdf2495d9b31a1afae618f68, user_id=f7eac931cabf4921b6dbd42f63b9300f, role_id=6540af5baf2c4ff78d0fedfc4bea4e46)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:48.966105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361cfb5-faf4-4321-b479-ff8fab5b8e09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:48.967023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff362f19-82dc-4c0e-93c6-1d86f4c251e8 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:48.967531 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361cfb5-faf4-4321-b479-ff8fab5b8e09 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:48.982389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-6361cfb5-faf4-4321-b479-ff8fab5b8e09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:48.982389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:48.982389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:48.982389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:48.982389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:48.982389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:48.982389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:48.982389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:48.982389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:48.982389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:48.982389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:48.982389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:48.982389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:48.982389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:48.982389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:48.984275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:48.984275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:48.984275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:48.984275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:48.984275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:48.984275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:48.984275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:48.984275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:48.984275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:48.984275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:48.984275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:48.984275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:48.984275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:48.984275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:48.984275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:48.984275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:48.984275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:48.985192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:48.985192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:48.985192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:48.985192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:48.985192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 303/590] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:48.985192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361cfb5-faf4-4321-b479-ff8fab5b8e09 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:49.003685 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:49.035840 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 288/591] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:04:48 2022] PUT /identity/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/f7eac931cabf4921b6dbd42f63b9300f/roles/6540af5baf2c4ff78d0fedfc4bea4e46 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:04:49.036892 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff362f19-82dc-4c0e-93c6-1d86f4c251e8 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:49.113079 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361cfb5-faf4-4321-b479-ff8fab5b8e09 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:49.158483 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f512ff-7791-4ba7-8ec2-6f9df6144259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:49.159074 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f512ff-7791-4ba7-8ec2-6f9df6144259 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:49.159362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f512ff-7791-4ba7-8ec2-6f9df6144259 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:49.159643 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f512ff-7791-4ba7-8ec2-6f9df6144259 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:49.160696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f512ff-7791-4ba7-8ec2-6f9df6144259 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:49.161022 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f512ff-7791-4ba7-8ec2-6f9df6144259 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:49.163192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f512ff-7791-4ba7-8ec2-6f9df6144259 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:49.164680 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff362f19-82dc-4c0e-93c6-1d86f4c251e8 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:49.185711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 304/592] 10.222.0.141 () {56 vars in 1142 bytes} [Tue Jul 26 16:04:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:49.187084 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f512ff-7791-4ba7-8ec2-6f9df6144259 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:49.212108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57010818-d356-498e-85ff-2c7fc58dfb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:49.212782 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57010818-d356-498e-85ff-2c7fc58dfb83 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:49.213068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57010818-d356-498e-85ff-2c7fc58dfb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:49.213344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57010818-d356-498e-85ff-2c7fc58dfb83 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:49.214740 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57010818-d356-498e-85ff-2c7fc58dfb83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:49.215067 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57010818-d356-498e-85ff-2c7fc58dfb83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:49.216869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57010818-d356-498e-85ff-2c7fc58dfb83 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:49.226242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:49.233229 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 289/593] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:04:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:49.233229 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57010818-d356-498e-85ff-2c7fc58dfb83 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:49.303426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:49.336759 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f512ff-7791-4ba7-8ec2-6f9df6144259 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:49.354242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57010818-d356-498e-85ff-2c7fc58dfb83 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:49.387541 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe0707-86bb-4bfe-a645-a4b6315a8e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:49.388603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe0707-86bb-4bfe-a645-a4b6315a8e0a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:49.389125 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe0707-86bb-4bfe-a645-a4b6315a8e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:49.389586 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe0707-86bb-4bfe-a645-a4b6315a8e0a None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:49.390552 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe0707-86bb-4bfe-a645-a4b6315a8e0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:49.390659 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832dffc-71bd-46af-8cfa-e6429235c19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:49.391135 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe0707-86bb-4bfe-a645-a4b6315a8e0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:49.391403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832dffc-71bd-46af-8cfa-e6429235c19e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:49.391762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832dffc-71bd-46af-8cfa-e6429235c19e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:49.392140 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832dffc-71bd-46af-8cfa-e6429235c19e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:49.394001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe0707-86bb-4bfe-a645-a4b6315a8e0a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:49.404323 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832dffc-71bd-46af-8cfa-e6429235c19e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:49.405918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832dffc-71bd-46af-8cfa-e6429235c19e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:49.410131 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 305/594] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:49.411163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe0707-86bb-4bfe-a645-a4b6315a8e0a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:49.426019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-f832dffc-71bd-46af-8cfa-e6429235c19e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:49.426019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:49.426019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:49.426019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:49.426019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:49.426019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:49.426019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:49.426019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:49.426019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:49.426019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:49.426019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:49.426019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:49.426019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:49.426019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:49.426019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:49.426967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:49.426967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:49.426967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:49.426967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:49.426967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:49.426967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:49.426967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:49.426967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:49.426967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:49.426967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:49.426967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:49.426967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:49.426967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:49.426967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:49.426967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:49.426967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:49.426967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:49.427819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:49.427819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:49.427819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:49.427819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:49.427819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 290/595] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:49.428793 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832dffc-71bd-46af-8cfa-e6429235c19e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:49.478651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:49.539072 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832dffc-71bd-46af-8cfa-e6429235c19e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:49.558015 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe0707-86bb-4bfe-a645-a4b6315a8e0a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:49.576842 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53e948-0aa7-4d11-a98b-5184b7f9f693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:49.577607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53e948-0aa7-4d11-a98b-5184b7f9f693 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:49.578277 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53e948-0aa7-4d11-a98b-5184b7f9f693 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:49.578277 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53e948-0aa7-4d11-a98b-5184b7f9f693 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:49.586674 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53e948-0aa7-4d11-a98b-5184b7f9f693 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:49.588152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53e948-0aa7-4d11-a98b-5184b7f9f693 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:49.600126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-bb53e948-0aa7-4d11-a98b-5184b7f9f693 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 16:04:49.600126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:49.600126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:49.600126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:49.600126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:49.600126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:49.600126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:49.600126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:49.600126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:49.600126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:49.600126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:49.600126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:49.600126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:04:49.600126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:04:49.600126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:04:49.600126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:04:49.601191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:49.601191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:49.601191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:04:49.601191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:49.601191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:04:49.601191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:49.601191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:49.601191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:49.601191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:49.601191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:49.601191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:49.601191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:49.601191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:49.601191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:49.601191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:49.601191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:49.601191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:49.601191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:49.602107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:49.602107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:49.602107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:04:49.602107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:04:49.602107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:04:49.602107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:04:49.602107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:04:49.602107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:04:49.602107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 16:04:49.602107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:49.604321 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e8e52-4e6f-4314-91f5-1e0c81ba29e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:49.605081 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e8e52-4e6f-4314-91f5-1e0c81ba29e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:49.605296 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 291/596] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:04:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:49.605395 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e8e52-4e6f-4314-91f5-1e0c81ba29e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:49.605585 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e8e52-4e6f-4314-91f5-1e0c81ba29e0 None admin] PATH_INFO: `/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/bb13d9d5d05a456fb2cb33a380c505f4/roles/6540af5baf2c4ff78d0fedfc4bea4e46` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:49.606579 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53e948-0aa7-4d11-a98b-5184b7f9f693 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:49.612840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:49.623598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e8e52-4e6f-4314-91f5-1e0c81ba29e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3747e176cdf2495d9b31a1afae618f68, user_id=bb13d9d5d05a456fb2cb33a380c505f4, role_id=6540af5baf2c4ff78d0fedfc4bea4e46)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:49.624916 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e8e52-4e6f-4314-91f5-1e0c81ba29e0 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:49.703520 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 306/597] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:04:49 2022] PUT /identity/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/bb13d9d5d05a456fb2cb33a380c505f4/roles/6540af5baf2c4ff78d0fedfc4bea4e46 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:04:49.704742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e8e52-4e6f-4314-91f5-1e0c81ba29e0 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:49.718876 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53e948-0aa7-4d11-a98b-5184b7f9f693 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:49.730428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:49.774707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f9a74-bed8-4afa-a8b3-b39440f93d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:49.775370 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f9a74-bed8-4afa-a8b3-b39440f93d29 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:49.775658 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f9a74-bed8-4afa-a8b3-b39440f93d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:49.775940 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f9a74-bed8-4afa-a8b3-b39440f93d29 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:49.776965 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f9a74-bed8-4afa-a8b3-b39440f93d29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:49.777279 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f9a74-bed8-4afa-a8b3-b39440f93d29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:49.778971 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f9a74-bed8-4afa-a8b3-b39440f93d29 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:49.804849 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 292/598] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:49.806667 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a396350-dd47-4fc6-ab5b-f05921ddd283 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:49.809055 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a396350-dd47-4fc6-ab5b-f05921ddd283 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:49.809536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a396350-dd47-4fc6-ab5b-f05921ddd283 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:49.811970 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 293/599] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:49 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:49.813080 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a396350-dd47-4fc6-ab5b-f05921ddd283 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:49.841582 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e8e52-4e6f-4314-91f5-1e0c81ba29e0 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:49.889124 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512274d-430a-4ebc-914f-80a0e2478671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:49.889845 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512274d-430a-4ebc-914f-80a0e2478671 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:49.890306 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512274d-430a-4ebc-914f-80a0e2478671 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:49.890588 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512274d-430a-4ebc-914f-80a0e2478671 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:49.891385 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512274d-430a-4ebc-914f-80a0e2478671 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:49.891697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512274d-430a-4ebc-914f-80a0e2478671 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:49.893181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512274d-430a-4ebc-914f-80a0e2478671 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:49.911478 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 307/600] 10.222.0.141 () {56 vars in 1144 bytes} [Tue Jul 26 16:04:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:49.912509 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9142a-f610-484a-94fe-380f04d237c4 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:49.912886 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9142a-f610-484a-94fe-380f04d237c4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:49.916006 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9142a-f610-484a-94fe-380f04d237c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:49.943185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5ee9142a-f610-484a-94fe-380f04d237c4 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:49.944377 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5ee9142a-f610-484a-94fe-380f04d237c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:49.950399 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a396350-dd47-4fc6-ab5b-f05921ddd283 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:49.988432 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:49.998524 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe498e-4394-4633-9614-b5661707a69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:49.999646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe498e-4394-4633-9614-b5661707a69d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:50.000096 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe498e-4394-4633-9614-b5661707a69d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:50.000539 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe498e-4394-4633-9614-b5661707a69d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:50.009996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe498e-4394-4633-9614-b5661707a69d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:50.012429 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe498e-4394-4633-9614-b5661707a69d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:50.015939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 308/601] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:50.021107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9142a-f610-484a-94fe-380f04d237c4 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:50.025493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-fabe498e-4394-4633-9614-b5661707a69d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:50.025493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:50.025493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:50.025493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:50.025493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:50.025493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:50.025493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:50.025493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:50.025493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:50.025493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:50.025493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:50.025493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:50.025493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:04:50.025493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:04:50.025493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:04:50.026338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:04:50.026338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:50.026338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:50.026338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:50.026338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:50.026338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:50.026338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:50.026338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:50.026338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:50.026338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:50.026338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:50.026338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:50.026338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:50.026338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:50.026338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:50.026338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:50.026338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:50.027186 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:04:50.027186 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:04:50.027186 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:04:50.027186 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:04:50.027186 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:04:50.027186 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:04:50.027186 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:50.027186 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:50.029242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 294/602] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:50.036717 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe498e-4394-4633-9614-b5661707a69d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:50.079027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:50.141578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9142a-f610-484a-94fe-380f04d237c4 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:50.165394 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe498e-4394-4633-9614-b5661707a69d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:50.177718 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc487c-9430-40f7-9d66-ee0ffffe6533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:50.178364 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc487c-9430-40f7-9d66-ee0ffffe6533 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:50.178645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc487c-9430-40f7-9d66-ee0ffffe6533 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:50.178921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc487c-9430-40f7-9d66-ee0ffffe6533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:50.192938 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc487c-9430-40f7-9d66-ee0ffffe6533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:50.194193 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc487c-9430-40f7-9d66-ee0ffffe6533 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:50.211337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-71fc487c-9430-40f7-9d66-ee0ffffe6533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:50.211337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:50.211337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:50.211337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:50.211337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:50.211337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:50.211337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:50.211337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:50.211337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:50.211337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:50.211337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:50.211337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:50.211337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:50.211337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:50.211337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:50.212264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:50.212264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:50.212264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:50.212264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:50.212264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:50.212264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:50.212264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:50.212264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:50.212264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:50.212264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:50.212264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:50.212264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:50.212264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:50.212264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:50.212264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:50.212264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:50.212264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:50.213195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:50.213195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:50.213195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:50.213195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:50.213485 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1608c57-ec8f-4786-b5fa-bf4661b33ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:50.213485 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1608c57-ec8f-4786-b5fa-bf4661b33ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:50.213485 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1608c57-ec8f-4786-b5fa-bf4661b33ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:50.213485 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1608c57-ec8f-4786-b5fa-bf4661b33ec5 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:50.213939 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1608c57-ec8f-4786-b5fa-bf4661b33ec5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:50.214253 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1608c57-ec8f-4786-b5fa-bf4661b33ec5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:50.215432 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 309/603] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:50.216357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc487c-9430-40f7-9d66-ee0ffffe6533 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:50.220337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1608c57-ec8f-4786-b5fa-bf4661b33ec5 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:50.241017 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 295/604] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:04:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:50.241959 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1608c57-ec8f-4786-b5fa-bf4661b33ec5 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:50.254240 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:50.342318 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc487c-9430-40f7-9d66-ee0ffffe6533 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:50.343561 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:50.359597 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1608c57-ec8f-4786-b5fa-bf4661b33ec5 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:50.378750 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a844a4-45b1-4dac-af47-491fe652ff10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:50.379390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a844a4-45b1-4dac-af47-491fe652ff10 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:50.379674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a844a4-45b1-4dac-af47-491fe652ff10 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:50.379953 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a844a4-45b1-4dac-af47-491fe652ff10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:50.391242 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a844a4-45b1-4dac-af47-491fe652ff10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:50.397231 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c5ed2-7b5a-456a-82a9-e715b401022c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:50.397979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-72a844a4-45b1-4dac-af47-491fe652ff10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:50.397979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:50.397979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:50.397979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:50.397979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:50.397979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:50.397979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:50.397979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:50.397979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:50.397979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:50.397979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:50.397979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:50.397979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:50.397979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:50.397979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:50.397979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:50.398911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:50.398911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:50.398911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:50.398911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:50.398911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:50.398911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:50.398911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:50.398911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:50.398911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:50.398911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:50.398911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:50.398911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:50.398911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:50.398911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:50.398911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:50.398911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:50.399745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:50.399745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:50.399745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:50.399745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:50.399745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:50.399745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:50.399745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:50.399745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:50.399745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:50.399745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:50.399745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:50.399745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:50.399745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 310/605] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:04:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:50.400469 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a844a4-45b1-4dac-af47-491fe652ff10 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:50.400814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c5ed2-7b5a-456a-82a9-e715b401022c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:50.401227 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c5ed2-7b5a-456a-82a9-e715b401022c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:50.401641 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c5ed2-7b5a-456a-82a9-e715b401022c None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:50.402481 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c5ed2-7b5a-456a-82a9-e715b401022c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:50.402997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c5ed2-7b5a-456a-82a9-e715b401022c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:50.404560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c5ed2-7b5a-456a-82a9-e715b401022c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:50.417427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 296/606] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:50.418143 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c5ed2-7b5a-456a-82a9-e715b401022c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:50.508228 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:50.521252 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c5ed2-7b5a-456a-82a9-e715b401022c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:50.529039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a844a4-45b1-4dac-af47-491fe652ff10 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:50.557201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23068f34-b21f-49ee-a3da-472e3609367f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:50.557824 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23068f34-b21f-49ee-a3da-472e3609367f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:50.558110 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23068f34-b21f-49ee-a3da-472e3609367f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:50.558386 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23068f34-b21f-49ee-a3da-472e3609367f None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:50.559101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23068f34-b21f-49ee-a3da-472e3609367f None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:50.559420 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23068f34-b21f-49ee-a3da-472e3609367f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:50.560854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23068f34-b21f-49ee-a3da-472e3609367f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:50.573442 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 297/607] 10.222.0.141 () {56 vars in 1108 bytes} [Tue Jul 26 16:04:50 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:50.573442 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23068f34-b21f-49ee-a3da-472e3609367f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:50.579173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff48e58-e020-4f58-aed2-4e4215fbaeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:50.580626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff48e58-e020-4f58-aed2-4e4215fbaeff None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:50.581612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff48e58-e020-4f58-aed2-4e4215fbaeff None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:50.582112 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff48e58-e020-4f58-aed2-4e4215fbaeff None admin] PATH_INFO: `/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/5d25aebc2bbc47b5adb7200275c98d90/roles/6540af5baf2c4ff78d0fedfc4bea4e46` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:50.583536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:50.602661 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff48e58-e020-4f58-aed2-4e4215fbaeff None admin] RBAC: Authorizing `identity:create_grant(project_id=3747e176cdf2495d9b31a1afae618f68, user_id=5d25aebc2bbc47b5adb7200275c98d90, role_id=6540af5baf2c4ff78d0fedfc4bea4e46)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:50.604974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff48e58-e020-4f58-aed2-4e4215fbaeff None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:50.687305 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23068f34-b21f-49ee-a3da-472e3609367f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:50.696358 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 311/608] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:04:50 2022] PUT /identity/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/5d25aebc2bbc47b5adb7200275c98d90/roles/6540af5baf2c4ff78d0fedfc4bea4e46 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:04:50.698280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff48e58-e020-4f58-aed2-4e4215fbaeff None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:50.726387 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71e94f-6a60-4d4e-a6bb-c19ca339e3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:50.727092 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71e94f-6a60-4d4e-a6bb-c19ca339e3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:50.727381 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71e94f-6a60-4d4e-a6bb-c19ca339e3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:50.727657 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71e94f-6a60-4d4e-a6bb-c19ca339e3c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:50.748558 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71e94f-6a60-4d4e-a6bb-c19ca339e3c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:50.750212 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71e94f-6a60-4d4e-a6bb-c19ca339e3c1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:50.775589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-ba71e94f-6a60-4d4e-a6bb-c19ca339e3c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:50.775589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:50.775589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:50.775589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:50.775589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:50.775589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:50.775589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:50.775589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:50.775589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:50.775589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:50.775589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:50.775589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:50.775589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:04:50.775589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:04:50.775589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:04:50.776581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:04:50.776581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:50.776581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:50.776581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:50.776581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:50.776581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:50.776581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:50.776581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:50.776581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:50.776581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:50.776581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:50.776581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:50.776581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:50.776581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:50.776581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:50.776581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:50.776581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:50.777475 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:04:50.777475 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:04:50.777475 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:04:50.777475 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:04:50.777475 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:04:50.777475 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:04:50.777475 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:50.777475 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:50.777475 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 298/609] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:50.781764 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71e94f-6a60-4d4e-a6bb-c19ca339e3c1 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:50.831673 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff48e58-e020-4f58-aed2-4e4215fbaeff None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:50.876519 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2d4cb-cb11-4ab6-b15a-2344da1d9be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:50.877422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2d4cb-cb11-4ab6-b15a-2344da1d9be6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:50.877704 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2d4cb-cb11-4ab6-b15a-2344da1d9be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:50.877982 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2d4cb-cb11-4ab6-b15a-2344da1d9be6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:50.881312 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:50.893051 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2d4cb-cb11-4ab6-b15a-2344da1d9be6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:50.897439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2d4cb-cb11-4ab6-b15a-2344da1d9be6 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:50.913388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-d2b2d4cb-cb11-4ab6-b15a-2344da1d9be6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:50.913388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:50.913388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:50.913388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:50.913388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:50.913388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:50.913388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:50.913388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:50.913388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:50.913388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:50.913388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:50.913388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:50.913388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:50.913388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:50.913388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:50.914352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:50.914352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:50.914352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:50.914352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:50.914352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:50.914352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:50.914352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:50.914352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:50.914352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:50.914352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:50.914352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:50.914352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:50.914352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:50.914352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:50.914352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:50.914352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:50.914352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:50.915223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:50.915223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:50.915223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:50.915223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:50.915437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:50.916553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 312/610] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:50.921816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2d4cb-cb11-4ab6-b15a-2344da1d9be6 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:50.986393 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71e94f-6a60-4d4e-a6bb-c19ca339e3c1 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:51.036593 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da44f42-54ed-4ef1-a61c-be83a98885b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:51.037419 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da44f42-54ed-4ef1-a61c-be83a98885b6 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:51.037704 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da44f42-54ed-4ef1-a61c-be83a98885b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:51.038360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da44f42-54ed-4ef1-a61c-be83a98885b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:51.039119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da44f42-54ed-4ef1-a61c-be83a98885b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:51.039430 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da44f42-54ed-4ef1-a61c-be83a98885b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:51.040932 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da44f42-54ed-4ef1-a61c-be83a98885b6 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:51.056864 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2d4cb-cb11-4ab6-b15a-2344da1d9be6 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:51.060280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 299/611] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:04:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:51.065583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da44f42-54ed-4ef1-a61c-be83a98885b6 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:51.113750 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0616a74-5aca-4fef-9664-fc4a47757eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:51.114482 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0616a74-5aca-4fef-9664-fc4a47757eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:51.114758 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0616a74-5aca-4fef-9664-fc4a47757eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:51.115094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0616a74-5aca-4fef-9664-fc4a47757eb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:51.115841 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0616a74-5aca-4fef-9664-fc4a47757eb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:51.116147 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0616a74-5aca-4fef-9664-fc4a47757eb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:51.117546 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0616a74-5aca-4fef-9664-fc4a47757eb3 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:51.144790 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 313/612] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:04:51.151092 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0616a74-5aca-4fef-9664-fc4a47757eb3 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:51.242044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:51.254679 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da44f42-54ed-4ef1-a61c-be83a98885b6 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:51.305898 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:51.315184 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e3beb-c50c-423c-82e5-8bdbbe474ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:51.317896 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e3beb-c50c-423c-82e5-8bdbbe474ad6 None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:51.317896 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e3beb-c50c-423c-82e5-8bdbbe474ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:51.317896 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e3beb-c50c-423c-82e5-8bdbbe474ad6 None admin] PATH_INFO: `/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/d1a99faad91b4357973f4bbb6632c724/roles/6540af5baf2c4ff78d0fedfc4bea4e46` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:51.326344 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0616a74-5aca-4fef-9664-fc4a47757eb3 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:51.338981 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e3beb-c50c-423c-82e5-8bdbbe474ad6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3747e176cdf2495d9b31a1afae618f68, user_id=d1a99faad91b4357973f4bbb6632c724, role_id=6540af5baf2c4ff78d0fedfc4bea4e46)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:51.341393 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e3beb-c50c-423c-82e5-8bdbbe474ad6 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:51.373446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964c493-b261-496d-b63b-42c59a7574b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:51.374089 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964c493-b261-496d-b63b-42c59a7574b3 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:51.374375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964c493-b261-496d-b63b-42c59a7574b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:51.374636 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964c493-b261-496d-b63b-42c59a7574b3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:51.382151 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964c493-b261-496d-b63b-42c59a7574b3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:51.383772 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964c493-b261-496d-b63b-42c59a7574b3 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:51.399844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-e964c493-b261-496d-b63b-42c59a7574b3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 16:04:51.399844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:51.399844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:51.399844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:51.399844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:51.399844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:51.399844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:51.399844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:51.399844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:51.399844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:51.399844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:51.399844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:51.399844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:04:51.399844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:04:51.399844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:04:51.399844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:04:51.401128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:51.401128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:51.401128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:04:51.401128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:51.401128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:04:51.401128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:51.401128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:51.401128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:51.401128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:51.401128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:51.401128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:51.401128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:51.401128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:51.401128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:51.401128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:51.401128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:51.401128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:51.401128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:51.411031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:51.411031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:51.411031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:04:51.411031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:04:51.411031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:04:51.411031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:04:51.411031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:04:51.411031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:04:51.411031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 16:04:51.411031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:51.411031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 314/613] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:04:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:04:51.411031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b114c0-d47f-4a86-8cec-d049ec535b48 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:51.411031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b114c0-d47f-4a86-8cec-d049ec535b48 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:51.411707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b114c0-d47f-4a86-8cec-d049ec535b48 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:51.411707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 315/614] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:51.411707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b60548-914a-45c4-8429-4d2a0b02a097 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:51.411707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b60548-914a-45c4-8429-4d2a0b02a097 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:51.411707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b60548-914a-45c4-8429-4d2a0b02a097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:51.430438 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-73b60548-914a-45c4-8429-4d2a0b02a097 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:51.431743 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-73b60548-914a-45c4-8429-4d2a0b02a097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:51.453043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 300/615] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:04:51 2022] PUT /identity/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/d1a99faad91b4357973f4bbb6632c724/roles/6540af5baf2c4ff78d0fedfc4bea4e46 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:04:51.460870 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e3beb-c50c-423c-82e5-8bdbbe474ad6 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:51.569254 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 316/616] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:04:51.593313 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b60548-914a-45c4-8429-4d2a0b02a097 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:51.652808 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e3beb-c50c-423c-82e5-8bdbbe474ad6 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:51.686488 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:51.713219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84f1de-8a6e-4975-8452-d6deba37bd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:51.714301 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84f1de-8a6e-4975-8452-d6deba37bd41 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:51.714778 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84f1de-8a6e-4975-8452-d6deba37bd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:51.718814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84f1de-8a6e-4975-8452-d6deba37bd41 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:51.719929 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84f1de-8a6e-4975-8452-d6deba37bd41 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:51.721004 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84f1de-8a6e-4975-8452-d6deba37bd41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:51.723388 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84f1de-8a6e-4975-8452-d6deba37bd41 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:51.746392 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 301/617] 10.222.0.141 () {56 vars in 1140 bytes} [Tue Jul 26 16:04:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:51.762990 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84f1de-8a6e-4975-8452-d6deba37bd41 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:51.801539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b60548-914a-45c4-8429-4d2a0b02a097 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:51.826257 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:51.840132 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8923b-7d1d-4cfa-b481-74b16d8f623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:51.840751 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8923b-7d1d-4cfa-b481-74b16d8f623b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:51.841167 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8923b-7d1d-4cfa-b481-74b16d8f623b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:51.841549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8923b-7d1d-4cfa-b481-74b16d8f623b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:51.853174 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8923b-7d1d-4cfa-b481-74b16d8f623b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:51.858328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-9ae8923b-7d1d-4cfa-b481-74b16d8f623b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:51.858328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:51.858328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:51.858328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:51.858328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:51.858328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:51.858328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:51.858328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:51.858328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:51.858328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:51.858328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:51.858328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:51.858328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:51.858328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:51.858328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:51.858328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:51.859225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:51.859225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:51.859225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:51.859225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:51.859225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:51.859225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:51.859225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:51.859225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:51.859225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:51.859225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:51.859225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:51.859225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:51.859225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:51.859225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:51.859225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:51.859225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:51.860183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:51.860183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:51.860183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:51.860183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:51.860183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:51.860183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:51.860183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:51.860183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:51.860183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:51.860183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:51.860183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:51.860183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:51.860183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 317/618] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:04:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:51.865623 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8923b-7d1d-4cfa-b481-74b16d8f623b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:51.967099 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84f1de-8a6e-4975-8452-d6deba37bd41 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:51.979330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8923b-7d1d-4cfa-b481-74b16d8f623b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:51.981146 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:52.006242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1365d-d8ab-42f1-9854-792d5988f685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:52.007901 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1365d-d8ab-42f1-9854-792d5988f685 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:52.008650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1365d-d8ab-42f1-9854-792d5988f685 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:52.009410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1365d-d8ab-42f1-9854-792d5988f685 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:52.022460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa7500-b00d-4ff2-b3cb-58aa15d77f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:52.022754 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1365d-d8ab-42f1-9854-792d5988f685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:52.023228 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa7500-b00d-4ff2-b3cb-58aa15d77f2b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:52.023578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa7500-b00d-4ff2-b3cb-58aa15d77f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:52.023922 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa7500-b00d-4ff2-b3cb-58aa15d77f2b None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:52.024738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa7500-b00d-4ff2-b3cb-58aa15d77f2b None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:52.025113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa7500-b00d-4ff2-b3cb-58aa15d77f2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:52.025611 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1365d-d8ab-42f1-9854-792d5988f685 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:52.026794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa7500-b00d-4ff2-b3cb-58aa15d77f2b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:52.043066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 318/619] 10.222.0.141 () {56 vars in 1108 bytes} [Tue Jul 26 16:04:51 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:52.044528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c003e-0eaa-448d-b302-514ab3d9a524 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:52.044973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c003e-0eaa-448d-b302-514ab3d9a524 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:52.045460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c003e-0eaa-448d-b302-514ab3d9a524 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:52.047077 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 319/620] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:52.048795 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c003e-0eaa-448d-b302-514ab3d9a524 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:52.052053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-a7d1365d-d8ab-42f1-9854-792d5988f685 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:52.052053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:52.052053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:52.052053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:52.052053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:52.052053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:52.052053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:52.052053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:52.052053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:52.052053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:52.052053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:52.052053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:52.052053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:52.052053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:52.052053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:52.053344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:52.053344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:52.053344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:52.053344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:52.053344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:52.053344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:52.053344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:52.053344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:52.053344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:52.053344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:52.053344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:52.053344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:52.053344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:52.053344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:52.053344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:52.053344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:52.053344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:52.054443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:52.054443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:52.054443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:52.054443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:52.055170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 302/621] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:52.058257 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ec9af-d598-41ad-a175-62f32a870f5f None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:52.063986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ec9af-d598-41ad-a175-62f32a870f5f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:52.064527 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ec9af-d598-41ad-a175-62f32a870f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:52.091412 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e32ec9af-d598-41ad-a175-62f32a870f5f None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:52.091412 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e32ec9af-d598-41ad-a175-62f32a870f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:52.173953 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 303/622] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:52.174881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ec9af-d598-41ad-a175-62f32a870f5f None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:52.174998 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c003e-0eaa-448d-b302-514ab3d9a524 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:52.196096 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:52.222890 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f07bcc-b1fc-4d93-8acd-bdebabb63f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:52.224264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f07bcc-b1fc-4d93-8acd-bdebabb63f46 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:52.225099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f07bcc-b1fc-4d93-8acd-bdebabb63f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:52.225734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f07bcc-b1fc-4d93-8acd-bdebabb63f46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:52.242002 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f07bcc-b1fc-4d93-8acd-bdebabb63f46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:52.244651 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f07bcc-b1fc-4d93-8acd-bdebabb63f46 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:52.265501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-79f07bcc-b1fc-4d93-8acd-bdebabb63f46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:52.265501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:52.265501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:52.265501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:52.265501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:52.265501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:52.265501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:52.265501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:52.265501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:52.265501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:52.265501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:52.265501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:52.265501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:52.265501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:52.265501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:52.266415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:52.266415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:52.266415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:52.266415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:52.266415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:52.266415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:52.266415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:52.266415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:52.266415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:52.266415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:52.266415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:52.266415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:52.266415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:52.266415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:52.266415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:52.266415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:52.266415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:52.267282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:52.267282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:52.267282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:52.267282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:52.270162 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 320/623] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:52.275269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f07bcc-b1fc-4d93-8acd-bdebabb63f46 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:52.294802 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:52.300381 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ec9af-d598-41ad-a175-62f32a870f5f None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:52.347156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16b8f5-0468-4a4f-a3a2-dcfc8351b3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:52.348297 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16b8f5-0468-4a4f-a3a2-dcfc8351b3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:52.349104 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16b8f5-0468-4a4f-a3a2-dcfc8351b3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:52.349384 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16b8f5-0468-4a4f-a3a2-dcfc8351b3b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:52.350120 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16b8f5-0468-4a4f-a3a2-dcfc8351b3b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:52.350429 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16b8f5-0468-4a4f-a3a2-dcfc8351b3b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:52.351822 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16b8f5-0468-4a4f-a3a2-dcfc8351b3b4 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:52.368507 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 304/624] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:52.368507 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16b8f5-0468-4a4f-a3a2-dcfc8351b3b4 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:52.404893 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f07bcc-b1fc-4d93-8acd-bdebabb63f46 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:52.451083 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:52.456752 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851aeaeb-8d3f-4434-bdae-83a306b90b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:52.457880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851aeaeb-8d3f-4434-bdae-83a306b90b1a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:52.458467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851aeaeb-8d3f-4434-bdae-83a306b90b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:52.462663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851aeaeb-8d3f-4434-bdae-83a306b90b1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:52.473275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851aeaeb-8d3f-4434-bdae-83a306b90b1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:52.474352 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16b8f5-0468-4a4f-a3a2-dcfc8351b3b4 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:52.479720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-851aeaeb-8d3f-4434-bdae-83a306b90b1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:52.479720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:52.479720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:52.479720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:52.479720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:52.479720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:52.479720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:52.479720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:52.479720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:52.479720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:52.479720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:52.479720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:52.479720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:52.479720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:52.479720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:52.479720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:52.480705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:52.480705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:52.480705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:52.480705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:52.480705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:52.480705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:52.480705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:52.480705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:52.480705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:52.480705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:52.480705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:52.480705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:52.480705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:52.480705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:52.480705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:52.480705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:52.481535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:52.481535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:52.481535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:52.481535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:52.481535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:52.481535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:52.481535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:52.481535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:52.481535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:52.481535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:52.481535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:52.481535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:52.483224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 321/625] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:04:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:52.484295 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851aeaeb-8d3f-4434-bdae-83a306b90b1a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:52.515312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b7555-ddee-415a-9087-4fc1131bc1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:52.516069 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b7555-ddee-415a-9087-4fc1131bc1ad None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:52.516451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b7555-ddee-415a-9087-4fc1131bc1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:52.516752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b7555-ddee-415a-9087-4fc1131bc1ad None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:52.518145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b7555-ddee-415a-9087-4fc1131bc1ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:52.518454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b7555-ddee-415a-9087-4fc1131bc1ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:52.520069 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b7555-ddee-415a-9087-4fc1131bc1ad None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:52.533584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 305/626] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:52.534586 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b7555-ddee-415a-9087-4fc1131bc1ad None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:52.559434 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:52.590470 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851aeaeb-8d3f-4434-bdae-83a306b90b1a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:52.625340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b7aa3-b6da-44ef-b40a-e5228135b664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:52.626083 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b7aa3-b6da-44ef-b40a-e5228135b664 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:52.626258 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b7aa3-b6da-44ef-b40a-e5228135b664 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:52.626536 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b7aa3-b6da-44ef-b40a-e5228135b664 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:52.634010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b7aa3-b6da-44ef-b40a-e5228135b664 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:52.635456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b7aa3-b6da-44ef-b40a-e5228135b664 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:52.646860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-e88b7aa3-b6da-44ef-b40a-e5228135b664 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:52.646860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:52.646860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:52.646860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:52.646860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:52.646860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:52.646860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:52.646860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:52.646860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:52.646860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:52.646860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:52.646860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:52.646860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:04:52.646860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:04:52.646860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:04:52.647961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:04:52.647961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:52.647961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:52.647961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:52.647961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:52.647961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:52.647961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:52.647961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:52.647961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:52.647961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:52.647961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:52.647961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:52.647961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:52.647961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:52.647961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:52.647961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:52.647961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:52.648918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:04:52.648918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:04:52.648918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:04:52.648918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:04:52.648918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:04:52.648918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:04:52.648918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:52.648918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:52.648918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 322/627] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:52.649414 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b7aa3-b6da-44ef-b40a-e5228135b664 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:52.651110 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b7555-ddee-415a-9087-4fc1131bc1ad None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:52.690419 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f7bb3-c132-4757-b84d-810003a1a4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:52.691383 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f7bb3-c132-4757-b84d-810003a1a4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:52.691935 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f7bb3-c132-4757-b84d-810003a1a4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:52.692489 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f7bb3-c132-4757-b84d-810003a1a4f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:52.693500 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f7bb3-c132-4757-b84d-810003a1a4f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:52.694030 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f7bb3-c132-4757-b84d-810003a1a4f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:52.695627 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f7bb3-c132-4757-b84d-810003a1a4f2 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:52.702053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:52.706791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 306/628] 10.222.0.141 () {56 vars in 1108 bytes} [Tue Jul 26 16:04:52 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:52.716995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f7bb3-c132-4757-b84d-810003a1a4f2 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:52.756180 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b7aa3-b6da-44ef-b40a-e5228135b664 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:52.785268 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:52.790205 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf1ae5-09e9-44a2-be9f-4068ab65eb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:52.790845 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf1ae5-09e9-44a2-be9f-4068ab65eb78 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:52.791126 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf1ae5-09e9-44a2-be9f-4068ab65eb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:52.791402 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf1ae5-09e9-44a2-be9f-4068ab65eb78 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:52.800301 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf1ae5-09e9-44a2-be9f-4068ab65eb78 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:52.801748 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf1ae5-09e9-44a2-be9f-4068ab65eb78 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:52.813456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-69bf1ae5-09e9-44a2-be9f-4068ab65eb78 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 16:04:52.813456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:52.813456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:52.813456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:52.813456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:52.813456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:52.813456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:52.813456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:52.813456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:52.813456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:52.813456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:52.813456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:52.813456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:04:52.813456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:04:52.813456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:04:52.813456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:04:52.814547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:52.814547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:52.814547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:04:52.814547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:52.814547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:04:52.814547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:52.814547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:52.814547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:52.814547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:52.814547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:52.814547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:52.814547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:52.814547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:52.814547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:52.814547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:52.814547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:52.814547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:52.814547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:52.815463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:52.815463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:52.815463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:04:52.815463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:04:52.815463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:04:52.815463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:04:52.815463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:04:52.815463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:04:52.815463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 16:04:52.815463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:52.815463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 323/629] 10.222.0.141 () {56 vars in 1098 bytes} [Tue Jul 26 16:04:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:52.816045 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf1ae5-09e9-44a2-be9f-4068ab65eb78 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:52.826817 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f7bb3-c132-4757-b84d-810003a1a4f2 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:52.867558 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a1e6e-1d48-4a64-824a-151f5d937357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:52.868542 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a1e6e-1d48-4a64-824a-151f5d937357 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:52.869079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a1e6e-1d48-4a64-824a-151f5d937357 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:52.869631 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a1e6e-1d48-4a64-824a-151f5d937357 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:52.870883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a1e6e-1d48-4a64-824a-151f5d937357 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:52.871436 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a1e6e-1d48-4a64-824a-151f5d937357 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:52.873259 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a1e6e-1d48-4a64-824a-151f5d937357 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:52.888109 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 307/630] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:04:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:52.889415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a1e6e-1d48-4a64-824a-151f5d937357 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:52.921143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf1ae5-09e9-44a2-be9f-4068ab65eb78 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:52.956086 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746929ec-0eff-4e92-8a86-87aa638784a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:52.956752 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746929ec-0eff-4e92-8a86-87aa638784a5 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:52.957091 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746929ec-0eff-4e92-8a86-87aa638784a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:52.957306 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746929ec-0eff-4e92-8a86-87aa638784a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:52.967991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746929ec-0eff-4e92-8a86-87aa638784a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:52.968560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:52.969676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746929ec-0eff-4e92-8a86-87aa638784a5 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:52.984805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-746929ec-0eff-4e92-8a86-87aa638784a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:52.984805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:52.984805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:52.984805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:52.984805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:52.984805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:52.984805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:52.984805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:52.984805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:52.984805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:52.984805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:52.984805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:52.984805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:52.984805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:52.984805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:52.992695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:52.992695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:52.992695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:52.992695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:52.992695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:52.992695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:52.992695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:52.992695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:52.992695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:52.992695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:52.992695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:52.992695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:52.992695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:52.992695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:52.992695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:52.992695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:52.992695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:52.993929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:52.993929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:52.993929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:52.993929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:52.993929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 324/631] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:52.993929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746929ec-0eff-4e92-8a86-87aa638784a5 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:53.016435 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a1e6e-1d48-4a64-824a-151f5d937357 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:53.038223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:53.052008 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a0006-3b4c-447c-9247-7fcf42b33b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:53.052630 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a0006-3b4c-447c-9247-7fcf42b33b74 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:53.052939 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a0006-3b4c-447c-9247-7fcf42b33b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:53.053212 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a0006-3b4c-447c-9247-7fcf42b33b74 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:53.053997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a0006-3b4c-447c-9247-7fcf42b33b74 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:53.054304 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a0006-3b4c-447c-9247-7fcf42b33b74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:53.055736 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a0006-3b4c-447c-9247-7fcf42b33b74 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:53.074339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 308/632] 10.222.0.141 () {56 vars in 1138 bytes} [Tue Jul 26 16:04:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:53.075529 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8473d9-eec6-4684-a7b7-faa1cf1f6d57 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:53.075814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8473d9-eec6-4684-a7b7-faa1cf1f6d57 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:53.076089 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8473d9-eec6-4684-a7b7-faa1cf1f6d57 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:53.080778 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 309/633] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:53.080778 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8473d9-eec6-4684-a7b7-faa1cf1f6d57 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:53.102044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746929ec-0eff-4e92-8a86-87aa638784a5 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:53.138718 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc80774-2709-489a-951b-c452caa83c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:53.139509 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc80774-2709-489a-951b-c452caa83c19 None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:53.140012 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc80774-2709-489a-951b-c452caa83c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:53.140389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc80774-2709-489a-951b-c452caa83c19 None admin] PATH_INFO: `/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/6c5f92f21868436a99a5c7aaa1fc40b5/roles/6540af5baf2c4ff78d0fedfc4bea4e46` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:53.155725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc80774-2709-489a-951b-c452caa83c19 None admin] RBAC: Authorizing `identity:create_grant(project_id=3747e176cdf2495d9b31a1afae618f68, user_id=6c5f92f21868436a99a5c7aaa1fc40b5, role_id=6540af5baf2c4ff78d0fedfc4bea4e46)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:53.157245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc80774-2709-489a-951b-c452caa83c19 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:53.185865 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8473d9-eec6-4684-a7b7-faa1cf1f6d57 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:53.203285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:53.221449 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5616b76-e4fa-4a55-9bff-16c2fee54ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:53.222074 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5616b76-e4fa-4a55-9bff-16c2fee54ecb None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:53.222358 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5616b76-e4fa-4a55-9bff-16c2fee54ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:53.222635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5616b76-e4fa-4a55-9bff-16c2fee54ecb None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:53.232999 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 325/634] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:04:52 2022] PUT /identity/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/6c5f92f21868436a99a5c7aaa1fc40b5/roles/6540af5baf2c4ff78d0fedfc4bea4e46 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:04:53.233573 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5616b76-e4fa-4a55-9bff-16c2fee54ecb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:53.233573 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5616b76-e4fa-4a55-9bff-16c2fee54ecb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:53.233798 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc80774-2709-489a-951b-c452caa83c19 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:53.233872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5616b76-e4fa-4a55-9bff-16c2fee54ecb None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:53.242015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 310/635] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:53.243464 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b646d2-e088-47aa-bf60-8e75e3c87608 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:53.243756 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b646d2-e088-47aa-bf60-8e75e3c87608 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:53.244043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b646d2-e088-47aa-bf60-8e75e3c87608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:53.273797 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a4b646d2-e088-47aa-bf60-8e75e3c87608 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:53.276025 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a4b646d2-e088-47aa-bf60-8e75e3c87608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:53.349253 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:53.357237 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc80774-2709-489a-951b-c452caa83c19 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:53.380840 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 311/636] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:53.382068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b646d2-e088-47aa-bf60-8e75e3c87608 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:53.406006 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdc8e2-829d-4a6d-8955-29ff1bf4c25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:53.406643 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdc8e2-829d-4a6d-8955-29ff1bf4c25b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:53.406988 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdc8e2-829d-4a6d-8955-29ff1bf4c25b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:53.407330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdc8e2-829d-4a6d-8955-29ff1bf4c25b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:53.503646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdc8e2-829d-4a6d-8955-29ff1bf4c25b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:53.505652 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdc8e2-829d-4a6d-8955-29ff1bf4c25b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:53.506423 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b646d2-e088-47aa-bf60-8e75e3c87608 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:53.516934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:53.546021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db142f-1790-454e-83fb-e891c288563c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:53.546949 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db142f-1790-454e-83fb-e891c288563c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:53.547617 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db142f-1790-454e-83fb-e891c288563c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:53.547907 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db142f-1790-454e-83fb-e891c288563c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:53.556317 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db142f-1790-454e-83fb-e891c288563c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:53.558040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db142f-1790-454e-83fb-e891c288563c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:53.571718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-e6db142f-1790-454e-83fb-e891c288563c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 16:04:53.571718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:53.571718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:53.571718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:53.571718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:53.571718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:53.571718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:53.571718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:53.571718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:53.571718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:53.571718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:53.571718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:53.571718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:04:53.571718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:04:53.571718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:04:53.571718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:04:53.572888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:53.572888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:53.572888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:04:53.572888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:53.572888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:04:53.572888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:53.572888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:53.572888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:53.572888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:53.572888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:53.572888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:53.572888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:53.572888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:53.572888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:53.572888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:53.572888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:53.572888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:53.572888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:53.574016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:53.574016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:53.574016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:04:53.574016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:04:53.574016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:04:53.574016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:04:53.574016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:04:53.574016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:04:53.574016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 16:04:53.574016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:53.579560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 312/637] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:53.581075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db142f-1790-454e-83fb-e891c288563c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:53.631247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:53.642070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 326/638] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:53 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:53.646743 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdc8e2-829d-4a6d-8955-29ff1bf4c25b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:53.701039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db142f-1790-454e-83fb-e891c288563c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:53.747302 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2130517-64a1-4689-b05f-c9311b3bc87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:53.747948 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2130517-64a1-4689-b05f-c9311b3bc87b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:53.748228 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2130517-64a1-4689-b05f-c9311b3bc87b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:53.748503 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2130517-64a1-4689-b05f-c9311b3bc87b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:53.759767 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2130517-64a1-4689-b05f-c9311b3bc87b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:53.760806 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdc8e2-829d-4a6d-8955-29ff1bf4c25b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:53.765071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-e2130517-64a1-4689-b05f-c9311b3bc87b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:53.765071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:53.765071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:53.765071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:53.765071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:53.765071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:53.765071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:53.765071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:53.765071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:53.765071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:53.765071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:53.765071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:53.765071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:53.765071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:53.765071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:53.765071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:53.765986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:53.765986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:53.765986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:53.765986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:53.765986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:53.765986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:53.765986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:53.765986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:53.765986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:53.765986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:53.765986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:53.765986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:53.765986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:53.765986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:53.765986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:53.765986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:53.766795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:53.766795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:53.766795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:53.766795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:53.766795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:53.766795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:53.766795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:53.766795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:53.766795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:53.766795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:53.766795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:53.766795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:53.771180 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 313/639] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:04:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:53.772109 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2130517-64a1-4689-b05f-c9311b3bc87b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:53.802726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:53.802912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe16831-a25e-4c7b-8024-59419dae78db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:53.803399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe16831-a25e-4c7b-8024-59419dae78db None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:53.803661 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe16831-a25e-4c7b-8024-59419dae78db None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:53.803935 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe16831-a25e-4c7b-8024-59419dae78db None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:53.805135 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe16831-a25e-4c7b-8024-59419dae78db None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:53.805444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe16831-a25e-4c7b-8024-59419dae78db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:53.806920 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe16831-a25e-4c7b-8024-59419dae78db None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:53.825517 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 327/640] 10.222.0.141 () {56 vars in 1142 bytes} [Tue Jul 26 16:04:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:53.826653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe16831-a25e-4c7b-8024-59419dae78db None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:53.881499 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2130517-64a1-4689-b05f-c9311b3bc87b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:53.882517 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:53.920386 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601b7d2-3eaf-4695-bf44-a1cf99e89e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:53.921065 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601b7d2-3eaf-4695-bf44-a1cf99e89e59 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:53.921777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601b7d2-3eaf-4695-bf44-a1cf99e89e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:53.922053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601b7d2-3eaf-4695-bf44-a1cf99e89e59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:53.933006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601b7d2-3eaf-4695-bf44-a1cf99e89e59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:53.934690 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601b7d2-3eaf-4695-bf44-a1cf99e89e59 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:53.938457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe16831-a25e-4c7b-8024-59419dae78db None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:53.950195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-0601b7d2-3eaf-4695-bf44-a1cf99e89e59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:53.950195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:53.950195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:53.950195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:53.950195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:53.950195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:53.950195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:53.950195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:53.950195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:53.950195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:53.950195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:53.950195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:53.950195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:53.950195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:53.950195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:53.951171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:53.951171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:53.951171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:53.951171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:53.951171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:53.951171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:53.951171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:53.951171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:53.951171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:53.951171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:53.951171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:53.951171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:53.951171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:53.951171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:53.951171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:53.951171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:53.951171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:53.952056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:53.952056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:53.952056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:53.952056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:53.952056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 314/641] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:53.953084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9658a-eff9-48f0-83e0-90eb74f39fd7 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:53.953084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9658a-eff9-48f0-83e0-90eb74f39fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:53.953245 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9658a-eff9-48f0-83e0-90eb74f39fd7 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:53.956814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 315/642] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:53.956814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9658a-eff9-48f0-83e0-90eb74f39fd7 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:53.983189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758c606-e16a-459e-809e-552650db0d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:53.983808 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758c606-e16a-459e-809e-552650db0d5e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:53.984094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758c606-e16a-459e-809e-552650db0d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:53.984367 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758c606-e16a-459e-809e-552650db0d5e None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:53.985116 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758c606-e16a-459e-809e-552650db0d5e None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:53.985435 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758c606-e16a-459e-809e-552650db0d5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:53.986857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758c606-e16a-459e-809e-552650db0d5e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:53.995870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 328/643] 10.222.0.141 () {56 vars in 1108 bytes} [Tue Jul 26 16:04:53 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:53.996615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758c606-e16a-459e-809e-552650db0d5e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:54.049323 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:54.070119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9658a-eff9-48f0-83e0-90eb74f39fd7 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:54.104394 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758c606-e16a-459e-809e-552650db0d5e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:54.106195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a54e8-865d-42d0-8de6-7e846bd89420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:54.107572 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a54e8-865d-42d0-8de6-7e846bd89420 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:54.107858 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a54e8-865d-42d0-8de6-7e846bd89420 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:54.108160 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a54e8-865d-42d0-8de6-7e846bd89420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:54.119145 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:54.140169 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd20f3-72b0-4ff1-9c6e-1cc5431da7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:54.140886 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd20f3-72b0-4ff1-9c6e-1cc5431da7de None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:54.141212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd20f3-72b0-4ff1-9c6e-1cc5431da7de None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:54.141492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd20f3-72b0-4ff1-9c6e-1cc5431da7de None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:54.142181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd20f3-72b0-4ff1-9c6e-1cc5431da7de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:54.142997 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd20f3-72b0-4ff1-9c6e-1cc5431da7de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:54.144467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd20f3-72b0-4ff1-9c6e-1cc5431da7de None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:54.161110 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 329/644] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:54.161110 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf96c7d-f344-43df-bc8e-0960f313880b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:54.161110 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf96c7d-f344-43df-bc8e-0960f313880b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:54.161110 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf96c7d-f344-43df-bc8e-0960f313880b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:54.178545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-fcf96c7d-f344-43df-bc8e-0960f313880b None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:54.179744 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fcf96c7d-f344-43df-bc8e-0960f313880b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:54.184386 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a54e8-865d-42d0-8de6-7e846bd89420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:54.185892 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a54e8-865d-42d0-8de6-7e846bd89420 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:54.259583 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 330/645] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:54.259583 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf96c7d-f344-43df-bc8e-0960f313880b None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:54.280575 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:54.308368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 316/646] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:53 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:54.308368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a54e8-865d-42d0-8de6-7e846bd89420 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:54.355160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf96c7d-f344-43df-bc8e-0960f313880b None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:54.360309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:54.393510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a9d3c-204f-4a2e-b863-de11a2efa101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:54.394226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a9d3c-204f-4a2e-b863-de11a2efa101 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:54.394727 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a9d3c-204f-4a2e-b863-de11a2efa101 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:54.395384 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a9d3c-204f-4a2e-b863-de11a2efa101 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:54.407202 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a9d3c-204f-4a2e-b863-de11a2efa101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:54.408718 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a9d3c-204f-4a2e-b863-de11a2efa101 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:54.410803 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a54e8-865d-42d0-8de6-7e846bd89420 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:54.424608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-f03a9d3c-204f-4a2e-b863-de11a2efa101 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:54.424608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:54.424608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:54.424608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:54.424608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:54.424608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:54.424608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:54.424608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:54.424608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:54.424608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:54.424608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:54.424608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:54.424608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:54.424608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:54.424608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:54.425573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:54.425573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:54.425573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:54.425573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:54.425573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:54.425573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:54.425573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:54.425573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:54.425573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:54.425573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:54.425573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:54.425573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:54.425573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:54.425573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:54.425573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:54.425573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:54.425573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:54.426599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:54.426599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:54.426599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:54.426599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:54.426599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 331/647] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:54.426599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a9d3c-204f-4a2e-b863-de11a2efa101 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:54.453042 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19b70d-0474-411d-a2fb-b8058a77d509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:54.453682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19b70d-0474-411d-a2fb-b8058a77d509 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:54.453964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19b70d-0474-411d-a2fb-b8058a77d509 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:54.454240 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19b70d-0474-411d-a2fb-b8058a77d509 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:54.460919 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19b70d-0474-411d-a2fb-b8058a77d509 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:54.462363 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19b70d-0474-411d-a2fb-b8058a77d509 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:54.474456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-3f19b70d-0474-411d-a2fb-b8058a77d509 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:54.474456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:54.474456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:54.474456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:54.474456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:54.474456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:54.474456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:54.474456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:54.474456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:54.474456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:54.474456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:54.474456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:54.474456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:04:54.474456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:04:54.474456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:04:54.475356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:04:54.475356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:54.475356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:54.475356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:54.475356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:54.475356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:54.475356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:54.475356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:54.475356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:54.475356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:54.475356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:54.475356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:54.475356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:54.475356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:54.475356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:54.475356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:54.475356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:54.476233 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:04:54.476233 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:04:54.476233 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:04:54.476233 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:04:54.476233 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:04:54.476233 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:04:54.476233 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:54.476233 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:54.476233 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 317/648] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:54.477267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19b70d-0474-411d-a2fb-b8058a77d509 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:54.523590 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:54.538216 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a9d3c-204f-4a2e-b863-de11a2efa101 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:54.573759 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062c5b7-b25c-4b25-9459-149ebb2d0f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:54.574397 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062c5b7-b25c-4b25-9459-149ebb2d0f02 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:54.574678 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062c5b7-b25c-4b25-9459-149ebb2d0f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:54.574957 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062c5b7-b25c-4b25-9459-149ebb2d0f02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:54.583639 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19b70d-0474-411d-a2fb-b8058a77d509 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:54.585036 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062c5b7-b25c-4b25-9459-149ebb2d0f02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:54.590332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-d062c5b7-b25c-4b25-9459-149ebb2d0f02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:54.590332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:54.590332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:54.590332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:54.590332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:54.590332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:54.590332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:54.590332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:54.590332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:54.590332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:54.590332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:54.590332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:54.590332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:54.590332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:54.590332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:54.590332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:54.591277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:54.591277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:54.591277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:54.591277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:54.591277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:54.591277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:54.591277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:54.591277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:54.591277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:54.591277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:54.591277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:54.591277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:54.591277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:54.591277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:54.591277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:54.591277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:54.592101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:54.592101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:54.592101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:54.592101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:54.592101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:54.592101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:54.592101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:54.592101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:54.592101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:54.592101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:54.592101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:54.592101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:54.592101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 332/649] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:04:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:54.593384 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062c5b7-b25c-4b25-9459-149ebb2d0f02 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:54.612119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:54.624160 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16861d-7b19-4f2a-924e-4d04b4989f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:54.624837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16861d-7b19-4f2a-924e-4d04b4989f3d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:54.625113 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16861d-7b19-4f2a-924e-4d04b4989f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:54.631048 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16861d-7b19-4f2a-924e-4d04b4989f3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:54.636236 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16861d-7b19-4f2a-924e-4d04b4989f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:54.637815 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16861d-7b19-4f2a-924e-4d04b4989f3d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:54.651976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-7a16861d-7b19-4f2a-924e-4d04b4989f3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:54.651976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:54.651976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:54.651976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:54.651976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:54.651976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:54.651976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:54.651976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:54.651976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:54.651976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:54.651976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:54.651976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:54.651976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:54.651976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:54.651976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:54.653145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:54.653145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:54.653145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:54.653145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:54.653145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:54.653145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:54.653145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:54.653145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:54.653145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:54.653145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:54.653145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:54.653145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:54.653145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:54.653145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:54.653145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:54.653145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:54.653145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:54.654000 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:54.654000 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:54.654000 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:54.654000 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:54.654000 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 318/650] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:54.654000 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16861d-7b19-4f2a-924e-4d04b4989f3d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:54.700780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062c5b7-b25c-4b25-9459-149ebb2d0f02 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:54.736737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01356435-aa4b-4018-9de9-3cc2b54b2349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:54.737408 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01356435-aa4b-4018-9de9-3cc2b54b2349 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:54.737859 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01356435-aa4b-4018-9de9-3cc2b54b2349 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:54.738139 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01356435-aa4b-4018-9de9-3cc2b54b2349 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:54.738829 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01356435-aa4b-4018-9de9-3cc2b54b2349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:54.739132 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01356435-aa4b-4018-9de9-3cc2b54b2349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:54.740505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01356435-aa4b-4018-9de9-3cc2b54b2349 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:54.748683 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:54.757720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 333/651] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:54.757720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01356435-aa4b-4018-9de9-3cc2b54b2349 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:54.761828 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16861d-7b19-4f2a-924e-4d04b4989f3d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:54.796352 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabfbf2-aa0b-4541-a723-69ea7fa58f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:54.796918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabfbf2-aa0b-4541-a723-69ea7fa58f32 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:54.797203 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabfbf2-aa0b-4541-a723-69ea7fa58f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:54.797734 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabfbf2-aa0b-4541-a723-69ea7fa58f32 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:54.798527 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecabfbf2-aa0b-4541-a723-69ea7fa58f32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:54.798900 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecabfbf2-aa0b-4541-a723-69ea7fa58f32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:54.800335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecabfbf2-aa0b-4541-a723-69ea7fa58f32 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:54.812116 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 319/652] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:04:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:54.813010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabfbf2-aa0b-4541-a723-69ea7fa58f32 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:54.840017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:54.864598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01356435-aa4b-4018-9de9-3cc2b54b2349 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:54.902450 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350226b-862f-43e9-b0c1-7b6ec91ebe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:54.903079 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350226b-862f-43e9-b0c1-7b6ec91ebe7e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:54.903366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350226b-862f-43e9-b0c1-7b6ec91ebe7e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:54.903640 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350226b-862f-43e9-b0c1-7b6ec91ebe7e None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:54.904346 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350226b-862f-43e9-b0c1-7b6ec91ebe7e None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:54.904652 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350226b-862f-43e9-b0c1-7b6ec91ebe7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:54.906040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350226b-862f-43e9-b0c1-7b6ec91ebe7e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:54.917922 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 334/653] 10.222.0.141 () {56 vars in 1108 bytes} [Tue Jul 26 16:04:54 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:54.919015 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350226b-862f-43e9-b0c1-7b6ec91ebe7e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:54.920623 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabfbf2-aa0b-4541-a723-69ea7fa58f32 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:54.961419 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d62643-4a90-4fae-8e94-6cda1c7e2356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:54.962261 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d62643-4a90-4fae-8e94-6cda1c7e2356 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:54.962546 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d62643-4a90-4fae-8e94-6cda1c7e2356 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:54.962819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d62643-4a90-4fae-8e94-6cda1c7e2356 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:54.963815 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d62643-4a90-4fae-8e94-6cda1c7e2356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:54.963815 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d62643-4a90-4fae-8e94-6cda1c7e2356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:54.965193 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d62643-4a90-4fae-8e94-6cda1c7e2356 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:54.980831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 320/654] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:54.982532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d62643-4a90-4fae-8e94-6cda1c7e2356 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:54.997687 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:55.031636 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350226b-862f-43e9-b0c1-7b6ec91ebe7e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:55.067709 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a3394-66c2-40e0-abd3-4d3d5f31da47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:55.068274 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a3394-66c2-40e0-abd3-4d3d5f31da47 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:55.068552 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a3394-66c2-40e0-abd3-4d3d5f31da47 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:55.068864 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a3394-66c2-40e0-abd3-4d3d5f31da47 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:55.076457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a3394-66c2-40e0-abd3-4d3d5f31da47 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:55.077919 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a3394-66c2-40e0-abd3-4d3d5f31da47 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:55.079669 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:55.085575 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d62643-4a90-4fae-8e94-6cda1c7e2356 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:55.089914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-235a3394-66c2-40e0-abd3-4d3d5f31da47 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 16:04:55.089914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:55.089914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:55.089914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:55.089914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:55.089914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:55.089914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:55.089914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:55.089914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:55.089914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:55.089914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:55.089914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:55.089914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:04:55.089914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:04:55.089914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:04:55.089914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:04:55.090819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:55.090819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:55.090819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:04:55.090819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:55.090819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:04:55.090819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:55.090819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:55.090819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:55.090819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:55.090819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:55.090819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:55.090819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:55.090819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:55.090819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:55.090819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:55.090819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:55.090819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:55.090819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:55.091731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:55.091731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:55.091731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:04:55.091731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:04:55.091731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:04:55.091731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:04:55.091731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:04:55.091731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:04:55.091731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 16:04:55.091731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:55.091731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 335/655] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:55.092308 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a3394-66c2-40e0-abd3-4d3d5f31da47 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:55.125704 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e18e89-72ec-4c1d-aaf6-5ac2f5fe0f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:55.126318 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e18e89-72ec-4c1d-aaf6-5ac2f5fe0f6f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:55.126608 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e18e89-72ec-4c1d-aaf6-5ac2f5fe0f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:55.126877 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e18e89-72ec-4c1d-aaf6-5ac2f5fe0f6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:55.127663 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e18e89-72ec-4c1d-aaf6-5ac2f5fe0f6f None admin] RBAC: Adding query filter params (role.id=6540af5baf2c4ff78d0fedfc4bea4e46, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=f7eac931cabf4921b6dbd42f63b9300f) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:55.127977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e18e89-72ec-4c1d-aaf6-5ac2f5fe0f6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:55.129464 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e18e89-72ec-4c1d-aaf6-5ac2f5fe0f6f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:55.135204 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 321/656] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:04:54 2022] GET /identity/v3/role_assignments?user.id=f7eac931cabf4921b6dbd42f63b9300f&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=6540af5baf2c4ff78d0fedfc4bea4e46 => generated 610 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:55.135990 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e18e89-72ec-4c1d-aaf6-5ac2f5fe0f6f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:55.217666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a3394-66c2-40e0-abd3-4d3d5f31da47 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:55.250421 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:55.258289 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64398f4b-1133-4a5d-b316-121b936b00a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:55.260330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64398f4b-1133-4a5d-b316-121b936b00a6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:55.260330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64398f4b-1133-4a5d-b316-121b936b00a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:55.260330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64398f4b-1133-4a5d-b316-121b936b00a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:55.273042 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64398f4b-1133-4a5d-b316-121b936b00a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:55.274762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64398f4b-1133-4a5d-b316-121b936b00a6 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:55.277030 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e18e89-72ec-4c1d-aaf6-5ac2f5fe0f6f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:55.292380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-64398f4b-1133-4a5d-b316-121b936b00a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:55.292380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:55.292380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:55.292380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:55.292380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:55.292380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:55.292380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:55.292380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:55.292380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:55.292380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:55.292380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:55.292380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:55.292380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:55.292380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:55.292380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:55.293340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:55.293340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:55.293340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:55.293340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:55.293340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:55.293340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:55.293340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:55.293340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:55.293340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:55.293340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:55.293340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:55.293340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:55.293340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:55.293340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:55.293340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:55.293340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:55.293340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:55.294214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:55.294214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:55.294214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:55.294214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:55.296160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 336/657] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:55.297261 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64398f4b-1133-4a5d-b316-121b936b00a6 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:55.314766 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a329927-7557-4d42-b707-73b00de6b1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:55.315411 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a329927-7557-4d42-b707-73b00de6b1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:55.315690 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a329927-7557-4d42-b707-73b00de6b1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:55.315958 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a329927-7557-4d42-b707-73b00de6b1f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:55.324325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a329927-7557-4d42-b707-73b00de6b1f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:55.325773 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a329927-7557-4d42-b707-73b00de6b1f2 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:55.339580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-0a329927-7557-4d42-b707-73b00de6b1f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:55.339580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:55.339580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:55.339580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:55.339580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:55.339580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:55.339580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:55.339580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:55.339580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:55.339580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:55.339580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:55.339580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:55.339580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:04:55.339580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:04:55.339580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:04:55.340462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:04:55.340462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:55.340462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:55.340462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:55.340462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:55.340462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:55.340462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:55.340462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:55.340462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:55.340462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:55.340462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:55.340462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:55.340462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:55.340462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:55.340462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:55.340462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:55.340462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:55.341463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:04:55.341463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:04:55.341463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:04:55.341463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:04:55.341463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:04:55.341463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:04:55.341463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:55.341463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:55.341463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 322/658] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:55.342404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27464bbf-e9bd-4be8-b994-5265c6f20b98 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:55.342693 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27464bbf-e9bd-4be8-b994-5265c6f20b98 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:55.342962 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27464bbf-e9bd-4be8-b994-5265c6f20b98 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:55.344793 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 323/659] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:55.345953 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27464bbf-e9bd-4be8-b994-5265c6f20b98 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:55.354826 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:55.410404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64398f4b-1133-4a5d-b316-121b936b00a6 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:55.444780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e7d44-74fc-4598-a95e-8edda46c649f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:55.445785 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e7d44-74fc-4598-a95e-8edda46c649f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:55.446068 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e7d44-74fc-4598-a95e-8edda46c649f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:55.446341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e7d44-74fc-4598-a95e-8edda46c649f None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:55.447142 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e7d44-74fc-4598-a95e-8edda46c649f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:55.447449 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e7d44-74fc-4598-a95e-8edda46c649f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:55.448918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e7d44-74fc-4598-a95e-8edda46c649f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:55.458592 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27464bbf-e9bd-4be8-b994-5265c6f20b98 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:55.468160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 337/660] 10.222.0.141 () {56 vars in 1142 bytes} [Tue Jul 26 16:04:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:55.468919 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e7d44-74fc-4598-a95e-8edda46c649f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:55.499926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cfe23-ed06-47c7-a516-445373b0edd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:55.500642 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cfe23-ed06-47c7-a516-445373b0edd8 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:55.500901 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cfe23-ed06-47c7-a516-445373b0edd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:55.501192 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cfe23-ed06-47c7-a516-445373b0edd8 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:55.502513 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3cfe23-ed06-47c7-a516-445373b0edd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:55.503152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3cfe23-ed06-47c7-a516-445373b0edd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:55.504363 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3cfe23-ed06-47c7-a516-445373b0edd8 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:55.507577 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:55.519547 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 324/661] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:55.521140 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4bdc2-fcac-4b45-b0db-5d57fa369abb None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:55.521140 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4bdc2-fcac-4b45-b0db-5d57fa369abb None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:55.521543 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4bdc2-fcac-4b45-b0db-5d57fa369abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:55.539326 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-58c4bdc2-fcac-4b45-b0db-5d57fa369abb None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:55.540621 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-58c4bdc2-fcac-4b45-b0db-5d57fa369abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:55.581210 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e7d44-74fc-4598-a95e-8edda46c649f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:55.591048 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:55.613765 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 325/662] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:55.616970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adf304-86e2-4032-9d35-26e8fc55a185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:55.617589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adf304-86e2-4032-9d35-26e8fc55a185 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:55.617868 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adf304-86e2-4032-9d35-26e8fc55a185 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:55.618144 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adf304-86e2-4032-9d35-26e8fc55a185 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:55.618885 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adf304-86e2-4032-9d35-26e8fc55a185 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:55.619191 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adf304-86e2-4032-9d35-26e8fc55a185 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:55.620619 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adf304-86e2-4032-9d35-26e8fc55a185 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:55.625543 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4bdc2-fcac-4b45-b0db-5d57fa369abb None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:55.638358 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 338/663] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:04:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:55.639591 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adf304-86e2-4032-9d35-26e8fc55a185 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:55.752944 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4bdc2-fcac-4b45-b0db-5d57fa369abb None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:55.759338 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adf304-86e2-4032-9d35-26e8fc55a185 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:55.778683 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:55.787709 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bcb3d-ddcf-4d2e-9181-6eb39c3b95e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:55.795917 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bcb3d-ddcf-4d2e-9181-6eb39c3b95e3 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:55.795917 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bcb3d-ddcf-4d2e-9181-6eb39c3b95e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:55.795917 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bcb3d-ddcf-4d2e-9181-6eb39c3b95e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:55.796170 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a9459-d27b-40cb-b5fb-4810c43b7cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:55.796170 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a9459-d27b-40cb-b5fb-4810c43b7cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:55.796170 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a9459-d27b-40cb-b5fb-4810c43b7cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:55.796170 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a9459-d27b-40cb-b5fb-4810c43b7cb2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:55.804916 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a9459-d27b-40cb-b5fb-4810c43b7cb2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:55.806379 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a9459-d27b-40cb-b5fb-4810c43b7cb2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:55.817580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-bc0a9459-d27b-40cb-b5fb-4810c43b7cb2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 16:04:55.817580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:55.817580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:55.817580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:55.817580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:55.817580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:55.817580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:55.817580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:55.817580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:55.817580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:55.817580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:55.817580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:55.817580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:04:55.817580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:04:55.817580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:04:55.817580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:04:55.818551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:55.818551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:55.818551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:04:55.818551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:55.818551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:04:55.818551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:55.818551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:55.818551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:55.818551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:55.818551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:55.818551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:55.818551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:55.818551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:55.818551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:55.818551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:55.818551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:55.818551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:55.818551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:55.819581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:55.819581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:55.819581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:04:55.819581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:04:55.819581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:04:55.819581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:04:55.819581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:04:55.819581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:04:55.819581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 16:04:55.819581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:55.819581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 339/664] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:04:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:55.819581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a9459-d27b-40cb-b5fb-4810c43b7cb2 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:55.849915 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:55.861935 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bcb3d-ddcf-4d2e-9181-6eb39c3b95e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:55.863431 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bcb3d-ddcf-4d2e-9181-6eb39c3b95e3 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:55.926767 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a9459-d27b-40cb-b5fb-4810c43b7cb2 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:55.962208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdba386-ecd4-4b8f-aa8e-7c08ad05898e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:55.962846 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdba386-ecd4-4b8f-aa8e-7c08ad05898e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:55.963125 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdba386-ecd4-4b8f-aa8e-7c08ad05898e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:55.963399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdba386-ecd4-4b8f-aa8e-7c08ad05898e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:55.964280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 326/665] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:55 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:55.965206 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bcb3d-ddcf-4d2e-9181-6eb39c3b95e3 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:55.978935 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdba386-ecd4-4b8f-aa8e-7c08ad05898e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:55.984422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-5fdba386-ecd4-4b8f-aa8e-7c08ad05898e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:55.984422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:55.984422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:55.984422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:55.984422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:55.984422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:55.984422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:55.984422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:55.984422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:55.984422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:55.984422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:55.984422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:55.984422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:55.984422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:55.984422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:55.984422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:55.985506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:55.985506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:55.985506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:55.985506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:55.985506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:55.985506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:55.985506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:55.985506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:55.985506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:55.985506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:55.985506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:55.985506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:55.985506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:55.985506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:55.985506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:55.985506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:55.986906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:55.986906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:55.986906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:55.986906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:55.986906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:55.986906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:55.986906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:55.986906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:55.986906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:55.986906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:55.986906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:04:55.986906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:55.986906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 340/666] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:04:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:55.988067 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdba386-ecd4-4b8f-aa8e-7c08ad05898e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:56.029993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:56.071090 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bcb3d-ddcf-4d2e-9181-6eb39c3b95e3 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:56.080362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:56.093179 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdba386-ecd4-4b8f-aa8e-7c08ad05898e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:56.108998 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e504f-824f-493a-b512-3375a09ae9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:56.109667 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e504f-824f-493a-b512-3375a09ae9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:56.109951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e504f-824f-493a-b512-3375a09ae9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:56.110245 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e504f-824f-493a-b512-3375a09ae9f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:56.111609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e504f-824f-493a-b512-3375a09ae9f5 None admin] RBAC: Adding query filter params (role.id=6540af5baf2c4ff78d0fedfc4bea4e46, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=bb13d9d5d05a456fb2cb33a380c505f4) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:56.111919 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e504f-824f-493a-b512-3375a09ae9f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:56.113381 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e504f-824f-493a-b512-3375a09ae9f5 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:56.119139 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 327/667] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:04:55 2022] GET /identity/v3/role_assignments?user.id=bb13d9d5d05a456fb2cb33a380c505f4&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=6540af5baf2c4ff78d0fedfc4bea4e46 => generated 610 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:56.119139 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e504f-824f-493a-b512-3375a09ae9f5 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:56.143677 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555ddaa-3d60-423e-86c9-e8d7dd32235b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:56.144634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555ddaa-3d60-423e-86c9-e8d7dd32235b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:56.144951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555ddaa-3d60-423e-86c9-e8d7dd32235b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:56.145221 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555ddaa-3d60-423e-86c9-e8d7dd32235b None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:56.146579 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555ddaa-3d60-423e-86c9-e8d7dd32235b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:56.146898 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555ddaa-3d60-423e-86c9-e8d7dd32235b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:56.148859 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555ddaa-3d60-423e-86c9-e8d7dd32235b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:56.174685 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 341/668] 10.222.0.141 () {56 vars in 1144 bytes} [Tue Jul 26 16:04:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:56.175562 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555ddaa-3d60-423e-86c9-e8d7dd32235b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:56.219131 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:56.233927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e504f-824f-493a-b512-3375a09ae9f5 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:56.283369 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b4a92-ea5d-4cac-8d26-40c73aeec030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:56.284214 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b4a92-ea5d-4cac-8d26-40c73aeec030 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:56.284597 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b4a92-ea5d-4cac-8d26-40c73aeec030 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:56.284999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b4a92-ea5d-4cac-8d26-40c73aeec030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:56.300192 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b4a92-ea5d-4cac-8d26-40c73aeec030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:56.301524 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b4a92-ea5d-4cac-8d26-40c73aeec030 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:56.320297 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555ddaa-3d60-423e-86c9-e8d7dd32235b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:56.322409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-729b4a92-ea5d-4cac-8d26-40c73aeec030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:56.322409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:56.322409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:56.322409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:56.322409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:56.322409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:56.322409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:56.322409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:56.322409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:56.322409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:56.322409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:56.322409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:56.322409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:56.322409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:56.322409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:56.323457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:56.323457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:56.323457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:56.323457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:56.323457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:56.323457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:56.323457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:56.323457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:56.323457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:56.323457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:56.323457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:56.323457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:56.323457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:56.323457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:56.323457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:56.323457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:56.323457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:56.324536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:56.324536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:56.324536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:56.324536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:56.324536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 328/669] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:56.324536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b4a92-ea5d-4cac-8d26-40c73aeec030 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:56.367789 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587bd20-0d70-47ee-9731-6f46f1cf85bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:56.368345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587bd20-0d70-47ee-9731-6f46f1cf85bc None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:56.368622 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587bd20-0d70-47ee-9731-6f46f1cf85bc None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:56.368934 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587bd20-0d70-47ee-9731-6f46f1cf85bc None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:56.369809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587bd20-0d70-47ee-9731-6f46f1cf85bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:56.369991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587bd20-0d70-47ee-9731-6f46f1cf85bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:56.371372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587bd20-0d70-47ee-9731-6f46f1cf85bc None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:56.384973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 342/670] 10.222.0.141 () {56 vars in 1108 bytes} [Tue Jul 26 16:04:56 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:56.385907 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587bd20-0d70-47ee-9731-6f46f1cf85bc None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:56.403266 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:56.449875 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b4a92-ea5d-4cac-8d26-40c73aeec030 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:56.486703 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f53ced-b875-4c40-ad4b-ea7db2896c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:56.487319 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f53ced-b875-4c40-ad4b-ea7db2896c0b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:56.487602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f53ced-b875-4c40-ad4b-ea7db2896c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:56.487874 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f53ced-b875-4c40-ad4b-ea7db2896c0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:56.500688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:56.523127 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587bd20-0d70-47ee-9731-6f46f1cf85bc None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:56.560483 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454512e-4669-4380-a196-8e4e2abf2b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:56.561184 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454512e-4669-4380-a196-8e4e2abf2b11 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:56.561462 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454512e-4669-4380-a196-8e4e2abf2b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:56.561791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454512e-4669-4380-a196-8e4e2abf2b11 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:56.562485 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454512e-4669-4380-a196-8e4e2abf2b11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:56.562845 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454512e-4669-4380-a196-8e4e2abf2b11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:56.564852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454512e-4669-4380-a196-8e4e2abf2b11 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:56.573065 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f53ced-b875-4c40-ad4b-ea7db2896c0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:56.575211 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f53ced-b875-4c40-ad4b-ea7db2896c0b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:56.577770 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 343/671] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:56.578593 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454512e-4669-4380-a196-8e4e2abf2b11 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:56.650776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:56.696235 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454512e-4669-4380-a196-8e4e2abf2b11 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:56.703220 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 329/672] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:56 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:56.704118 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f53ced-b875-4c40-ad4b-ea7db2896c0b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:56.746681 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64763ed0-8bd2-4280-bc68-57a07a541934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:56.747349 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64763ed0-8bd2-4280-bc68-57a07a541934 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:56.747629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64763ed0-8bd2-4280-bc68-57a07a541934 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:56.747902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64763ed0-8bd2-4280-bc68-57a07a541934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:56.754504 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:56.759278 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64763ed0-8bd2-4280-bc68-57a07a541934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:56.760816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64763ed0-8bd2-4280-bc68-57a07a541934 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:56.776387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-64763ed0-8bd2-4280-bc68-57a07a541934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:56.776387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:56.776387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:56.776387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:56.776387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:56.776387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:56.776387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:56.776387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:56.776387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:56.776387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:56.776387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:56.776387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:56.776387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:56.776387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:56.776387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:56.777614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:56.777614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:56.777614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:56.777614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:56.777614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:56.777614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:56.777614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:56.777614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:56.777614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:56.777614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:56.777614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:56.777614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:56.777614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:56.777614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:56.777614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:56.777614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:56.777614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:56.779017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:56.779017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:56.779017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:56.779017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:56.779017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 344/673] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:56.779017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64763ed0-8bd2-4280-bc68-57a07a541934 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:56.828318 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f53ced-b875-4c40-ad4b-ea7db2896c0b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:56.873223 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce84185-8b09-4aef-97f4-f35bef394abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:56.874630 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce84185-8b09-4aef-97f4-f35bef394abc None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:56.875348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce84185-8b09-4aef-97f4-f35bef394abc None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:56.875806 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce84185-8b09-4aef-97f4-f35bef394abc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:56.885151 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce84185-8b09-4aef-97f4-f35bef394abc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:56.886313 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64763ed0-8bd2-4280-bc68-57a07a541934 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:56.887080 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce84185-8b09-4aef-97f4-f35bef394abc None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:56.907493 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:56.927855 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209d276-69c3-4d56-8dba-6d02d689d98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:56.928577 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209d276-69c3-4d56-8dba-6d02d689d98e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:56.928911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209d276-69c3-4d56-8dba-6d02d689d98e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:56.929222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209d276-69c3-4d56-8dba-6d02d689d98e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:56.944806 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209d276-69c3-4d56-8dba-6d02d689d98e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:56.946390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209d276-69c3-4d56-8dba-6d02d689d98e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:56.962816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-4209d276-69c3-4d56-8dba-6d02d689d98e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:56.962816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:56.962816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:56.962816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:56.962816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:56.962816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:56.962816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:56.962816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:56.962816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:56.962816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:56.962816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:56.962816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:56.962816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:56.962816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:56.962816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:56.963960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:56.963960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:56.963960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:56.963960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:56.963960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:56.963960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:56.963960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:56.963960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:56.963960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:56.963960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:56.963960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:56.963960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:56.963960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:56.963960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:56.963960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:56.963960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:56.963960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:56.965070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:56.965070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:56.965070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:56.965070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:56.971060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 345/674] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:56.971060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209d276-69c3-4d56-8dba-6d02d689d98e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:57.042316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-bce84185-8b09-4aef-97f4-f35bef394abc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:57.042316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:57.042316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:57.042316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:57.042316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:57.042316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:57.042316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:57.042316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:57.042316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:57.042316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:57.042316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:57.042316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:57.042316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:04:57.042316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:04:57.042316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:04:57.043455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:04:57.043455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:57.043455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:57.043455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:57.043455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:57.043455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:57.043455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:57.043455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:57.043455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:57.043455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:57.043455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:57.043455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:57.043455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:57.043455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:57.043455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:57.043455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:57.043455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:57.044530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:04:57.044530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:04:57.044530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:04:57.044530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:04:57.044530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:04:57.044530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:04:57.044530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:57.044530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:57.052088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 330/675] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:57.053322 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce84185-8b09-4aef-97f4-f35bef394abc None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:57.084838 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209d276-69c3-4d56-8dba-6d02d689d98e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:57.126014 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002485ce-0d72-4b85-a0f1-829f0078edc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:57.127006 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002485ce-0d72-4b85-a0f1-829f0078edc1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:57.127510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002485ce-0d72-4b85-a0f1-829f0078edc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:57.127968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002485ce-0d72-4b85-a0f1-829f0078edc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:57.128871 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002485ce-0d72-4b85-a0f1-829f0078edc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:57.129365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002485ce-0d72-4b85-a0f1-829f0078edc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:57.130915 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002485ce-0d72-4b85-a0f1-829f0078edc1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:57.144418 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 346/676] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:57.145651 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002485ce-0d72-4b85-a0f1-829f0078edc1 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:57.173053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce84185-8b09-4aef-97f4-f35bef394abc None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:57.174763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:57.183420 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:57.217571 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4d5b0-e19a-4267-b01b-da7de6a8f0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:57.218626 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4d5b0-e19a-4267-b01b-da7de6a8f0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:57.219008 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4d5b0-e19a-4267-b01b-da7de6a8f0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:57.219296 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4d5b0-e19a-4267-b01b-da7de6a8f0a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:57.219991 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4d5b0-e19a-4267-b01b-da7de6a8f0a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:57.220894 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4d5b0-e19a-4267-b01b-da7de6a8f0a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:57.222230 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4d5b0-e19a-4267-b01b-da7de6a8f0a1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:57.235674 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 331/677] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:57.240953 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4d5b0-e19a-4267-b01b-da7de6a8f0a1 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:57.268175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002485ce-0d72-4b85-a0f1-829f0078edc1 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:57.312444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ca18f-da22-4dff-87f0-7217dda31553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:57.313094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ca18f-da22-4dff-87f0-7217dda31553 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:57.313375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ca18f-da22-4dff-87f0-7217dda31553 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:57.313649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ca18f-da22-4dff-87f0-7217dda31553 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:57.314426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ca18f-da22-4dff-87f0-7217dda31553 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:57.314733 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ca18f-da22-4dff-87f0-7217dda31553 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:57.316162 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ca18f-da22-4dff-87f0-7217dda31553 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:57.327886 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 347/678] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:04:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:57.328711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ca18f-da22-4dff-87f0-7217dda31553 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:57.359939 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4d5b0-e19a-4267-b01b-da7de6a8f0a1 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:57.397404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953807ab-4fbb-4d1d-b540-e5185b74c14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:57.398042 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953807ab-4fbb-4d1d-b540-e5185b74c14d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:57.398341 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953807ab-4fbb-4d1d-b540-e5185b74c14d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:57.398636 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953807ab-4fbb-4d1d-b540-e5185b74c14d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:57.406794 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953807ab-4fbb-4d1d-b540-e5185b74c14d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:57.408889 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953807ab-4fbb-4d1d-b540-e5185b74c14d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:57.423280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-953807ab-4fbb-4d1d-b540-e5185b74c14d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 16:04:57.423280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:57.423280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:57.423280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:57.423280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:57.423280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:57.423280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:57.423280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:57.423280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:57.423280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:57.423280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:57.423280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:57.423280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:04:57.423280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:04:57.423280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:04:57.423280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:04:57.424292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:57.424292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:57.424292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:04:57.424292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:57.424292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:04:57.424292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:57.424292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:57.424292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:57.424292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:57.424292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:57.424292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:57.424292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:57.424292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:57.424292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:57.424292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:57.424292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:57.424292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:57.424292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:57.425581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:57.425581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:57.425581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:04:57.425581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:04:57.425581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:04:57.425581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:04:57.425581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:04:57.425581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:04:57.425581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 16:04:57.425581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:57.425581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 332/679] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:04:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:57.425581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48524d33-59a4-469d-8b77-8ba868436b2e None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:57.426226 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48524d33-59a4-469d-8b77-8ba868436b2e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:57.426226 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48524d33-59a4-469d-8b77-8ba868436b2e None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:57.431478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 333/680] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:57 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:57.431478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48524d33-59a4-469d-8b77-8ba868436b2e None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:57.441665 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:57.450207 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ca18f-da22-4dff-87f0-7217dda31553 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:57.457532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:57.484565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebe6d9-a85d-4cbb-8e19-69d159675bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:57.486365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebe6d9-a85d-4cbb-8e19-69d159675bae None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:57.486365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebe6d9-a85d-4cbb-8e19-69d159675bae None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:57.486365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebe6d9-a85d-4cbb-8e19-69d159675bae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:57.492958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebe6d9-a85d-4cbb-8e19-69d159675bae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:57.494408 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebe6d9-a85d-4cbb-8e19-69d159675bae None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:57.506372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-54ebe6d9-a85d-4cbb-8e19-69d159675bae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:57.506372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:57.506372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:57.506372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:57.506372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:57.506372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:57.506372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:57.506372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:57.506372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:57.506372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:57.506372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:57.506372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:57.506372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:04:57.506372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:04:57.506372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:04:57.507247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:04:57.507247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:57.507247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:57.507247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:57.507247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:57.507247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:57.507247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:57.507247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:57.507247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:57.507247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:57.507247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:57.507247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:57.507247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:57.507247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:57.507247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:57.507247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:57.507247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:57.508185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:04:57.508185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:04:57.508185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:04:57.508185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:04:57.508185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:04:57.508185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:04:57.508185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:57.508185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:57.509871 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 348/681] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:57.510833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebe6d9-a85d-4cbb-8e19-69d159675bae None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:57.541727 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48524d33-59a4-469d-8b77-8ba868436b2e None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:57.580714 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b235f-652b-4a44-8b42-567b81e150e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:57.581476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b235f-652b-4a44-8b42-567b81e150e2 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:57.581759 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b235f-652b-4a44-8b42-567b81e150e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:57.582184 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b235f-652b-4a44-8b42-567b81e150e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:57.583024 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b235f-652b-4a44-8b42-567b81e150e2 None admin] RBAC: Adding query filter params (role.id=6540af5baf2c4ff78d0fedfc4bea4e46, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=5d25aebc2bbc47b5adb7200275c98d90) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:57.583342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b235f-652b-4a44-8b42-567b81e150e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:57.584927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b235f-652b-4a44-8b42-567b81e150e2 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:57.598928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 334/682] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:04:57 2022] GET /identity/v3/role_assignments?user.id=5d25aebc2bbc47b5adb7200275c98d90&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=6540af5baf2c4ff78d0fedfc4bea4e46 => generated 610 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:57.598928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b041a4-cd54-4f71-803a-9673ead1a7b7 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:57.598928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b041a4-cd54-4f71-803a-9673ead1a7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:57.598928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b041a4-cd54-4f71-803a-9673ead1a7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:57.614320 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e8b041a4-cd54-4f71-803a-9673ead1a7b7 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:57.615616 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e8b041a4-cd54-4f71-803a-9673ead1a7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:57.629539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebe6d9-a85d-4cbb-8e19-69d159675bae None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:57.682899 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6cd39-05b1-4277-8fd9-9cab35894905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:57.683444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6cd39-05b1-4277-8fd9-9cab35894905 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:57.683725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6cd39-05b1-4277-8fd9-9cab35894905 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:57.683997 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6cd39-05b1-4277-8fd9-9cab35894905 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:57.684831 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6cd39-05b1-4277-8fd9-9cab35894905 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:57.685146 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6cd39-05b1-4277-8fd9-9cab35894905 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:57.686599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6cd39-05b1-4277-8fd9-9cab35894905 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:57.708691 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 335/683] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:57.708691 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b041a4-cd54-4f71-803a-9673ead1a7b7 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:57.724063 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 349/684] 10.222.0.141 () {56 vars in 1140 bytes} [Tue Jul 26 16:04:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:57.729147 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6cd39-05b1-4277-8fd9-9cab35894905 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:57.736388 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:57.747057 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:57.847402 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b041a4-cd54-4f71-803a-9673ead1a7b7 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:57.862042 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6cd39-05b1-4277-8fd9-9cab35894905 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:57.903417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524d8f7-d07a-4c8b-b573-1f13f60769ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:57.904058 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d18f6-194d-4f02-a973-c32407d0a914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:57.904182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524d8f7-d07a-4c8b-b573-1f13f60769ea None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:57.904351 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524d8f7-d07a-4c8b-b573-1f13f60769ea None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:57.904611 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524d8f7-d07a-4c8b-b573-1f13f60769ea None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:57.904730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d18f6-194d-4f02-a973-c32407d0a914 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:57.904990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d18f6-194d-4f02-a973-c32407d0a914 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:57.905260 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d18f6-194d-4f02-a973-c32407d0a914 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:57.905434 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524d8f7-d07a-4c8b-b573-1f13f60769ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:57.905710 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524d8f7-d07a-4c8b-b573-1f13f60769ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:57.907150 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524d8f7-d07a-4c8b-b573-1f13f60769ea None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:57.927164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 336/685] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:04:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:57.928016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524d8f7-d07a-4c8b-b573-1f13f60769ea None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:57.997478 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d18f6-194d-4f02-a973-c32407d0a914 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:58.000121 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d18f6-194d-4f02-a973-c32407d0a914 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:58.022059 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:58.047034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524d8f7-d07a-4c8b-b573-1f13f60769ea None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:58.095030 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc10e85-d437-450e-bd5d-dc75ef43ef2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:58.096061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc10e85-d437-450e-bd5d-dc75ef43ef2b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:58.096529 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc10e85-d437-450e-bd5d-dc75ef43ef2b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:58.097058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc10e85-d437-450e-bd5d-dc75ef43ef2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:58.109760 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc10e85-d437-450e-bd5d-dc75ef43ef2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:04:58.116264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-4fc10e85-d437-450e-bd5d-dc75ef43ef2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:04:58.116264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:58.116264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:58.116264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:58.116264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:58.116264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:58.116264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:58.116264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:58.116264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:58.116264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:58.116264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:58.116264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:58.116264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:04:58.116264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:04:58.116264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:04:58.116264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:04:58.117267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:04:58.117267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:04:58.117267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:04:58.117267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:04:58.117267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:58.117267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:58.117267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:58.117267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:58.117267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:58.117267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:58.117267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:58.117267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:58.117267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:58.117267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:58.117267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:58.117267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:58.118078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:58.118078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:58.118078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:58.118078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:58.118078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:04:58.118078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:04:58.118078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:04:58.118078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:04:58.118078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:04:58.118078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:04:58.118078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:04:58.118078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:58.120922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 337/686] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:04:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:58.122132 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc10e85-d437-450e-bd5d-dc75ef43ef2b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:58.148847 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:58.247230 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 350/687] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:57 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 16:04:58.248565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d18f6-194d-4f02-a973-c32407d0a914 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:58.258751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc10e85-d437-450e-bd5d-dc75ef43ef2b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:58.293950 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fb079-6c54-4356-8cc6-54f2ee791e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:58.294564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fb079-6c54-4356-8cc6-54f2ee791e99 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:58.294840 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fb079-6c54-4356-8cc6-54f2ee791e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:58.295107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fb079-6c54-4356-8cc6-54f2ee791e99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:58.295888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fb079-6c54-4356-8cc6-54f2ee791e99 None admin] RBAC: Adding query filter params (role.id=6540af5baf2c4ff78d0fedfc4bea4e46, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=d1a99faad91b4357973f4bbb6632c724) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:58.296191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fb079-6c54-4356-8cc6-54f2ee791e99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:58.297898 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fb079-6c54-4356-8cc6-54f2ee791e99 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:58.302780 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:58.307645 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 338/688] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:04:58 2022] GET /identity/v3/role_assignments?user.id=d1a99faad91b4357973f4bbb6632c724&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=6540af5baf2c4ff78d0fedfc4bea4e46 => generated 610 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:58.313827 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fb079-6c54-4356-8cc6-54f2ee791e99 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:58.375735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d18f6-194d-4f02-a973-c32407d0a914 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:58.391603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:58.432472 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c02d0-2130-496c-9928-d425ce9f0b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:58.433165 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c02d0-2130-496c-9928-d425ce9f0b8d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:58.433591 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c02d0-2130-496c-9928-d425ce9f0b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:58.434026 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c02d0-2130-496c-9928-d425ce9f0b8d None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:58.434863 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c02d0-2130-496c-9928-d425ce9f0b8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:58.435177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c02d0-2130-496c-9928-d425ce9f0b8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:58.437584 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c02d0-2130-496c-9928-d425ce9f0b8d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:58.445982 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fb079-6c54-4356-8cc6-54f2ee791e99 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:58.453865 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 351/689] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:04:58 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:58.455909 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165a7b3-bc12-48e0-ad02-b2a93a4ea3d5 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:58.456197 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165a7b3-bc12-48e0-ad02-b2a93a4ea3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:58.456987 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165a7b3-bc12-48e0-ad02-b2a93a4ea3d5 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:58.459077 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 352/690] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:58 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:58.460185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165a7b3-bc12-48e0-ad02-b2a93a4ea3d5 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:58.489884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50b56e-734c-41d2-b370-e44a455f96e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:58.490665 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50b56e-734c-41d2-b370-e44a455f96e6 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:58.490949 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50b56e-734c-41d2-b370-e44a455f96e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:58.491223 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50b56e-734c-41d2-b370-e44a455f96e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:58.503395 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50b56e-734c-41d2-b370-e44a455f96e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:58.504975 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50b56e-734c-41d2-b370-e44a455f96e6 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:58.522890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-ec50b56e-734c-41d2-b370-e44a455f96e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:58.522890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:58.522890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:58.522890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:58.522890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:58.522890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:58.522890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:58.522890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:58.522890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:58.522890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:58.522890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:58.522890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:58.522890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:58.522890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:58.522890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:58.523999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:58.523999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:58.523999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:58.523999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:58.523999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:58.523999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:58.523999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:58.523999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:58.523999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:58.523999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:58.523999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:58.523999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:58.523999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:58.523999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:58.523999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:58.523999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:58.523999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:58.525092 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:58.525092 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:58.525092 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:58.525092 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:04:58.525092 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 339/691] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:58.525524 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ad982-8ba8-419f-b209-61b35cf1bb03 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:58.525798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ad982-8ba8-419f-b209-61b35cf1bb03 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:58.526056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ad982-8ba8-419f-b209-61b35cf1bb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:58.546905 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e23ad982-8ba8-419f-b209-61b35cf1bb03 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:58.549539 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e23ad982-8ba8-419f-b209-61b35cf1bb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:04:58.593555 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165a7b3-bc12-48e0-ad02-b2a93a4ea3d5 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:58.608835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:58.629252 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 340/692] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:04:58.630611 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ad982-8ba8-419f-b209-61b35cf1bb03 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:58.630880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8896cc-1bea-4109-acdc-f49e111a6e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:58.631645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8896cc-1bea-4109-acdc-f49e111a6e0a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:58.632001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8896cc-1bea-4109-acdc-f49e111a6e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:58.632353 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8896cc-1bea-4109-acdc-f49e111a6e0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:58.644267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8896cc-1bea-4109-acdc-f49e111a6e0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:58.645844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8896cc-1bea-4109-acdc-f49e111a6e0a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:58.661924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-6d8896cc-1bea-4109-acdc-f49e111a6e0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:58.661924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:58.661924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:58.661924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:58.661924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:58.661924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:58.661924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:58.661924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:58.661924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:58.661924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:58.661924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:58.661924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:58.661924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:04:58.661924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:04:58.661924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:04:58.662951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:04:58.662951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:58.662951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:58.662951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:58.662951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:58.662951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:58.662951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:58.662951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:58.662951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:58.662951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:58.662951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:58.662951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:58.662951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:58.662951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:58.662951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:58.662951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:58.662951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:58.663933 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:04:58.663933 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:04:58.663933 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:04:58.663933 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:58.663933 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 353/693] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:58.664395 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8896cc-1bea-4109-acdc-f49e111a6e0a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:58.692291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:58.749501 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ad982-8ba8-419f-b209-61b35cf1bb03 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:58.772279 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8896cc-1bea-4109-acdc-f49e111a6e0a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:58.787272 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc5a6f-610e-4028-bf96-ea734331cb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:58.788213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc5a6f-610e-4028-bf96-ea734331cb1b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:58.788772 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc5a6f-610e-4028-bf96-ea734331cb1b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:58.789239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc5a6f-610e-4028-bf96-ea734331cb1b None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:58.790188 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc5a6f-610e-4028-bf96-ea734331cb1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:58.790695 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc5a6f-610e-4028-bf96-ea734331cb1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:58.792280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc5a6f-610e-4028-bf96-ea734331cb1b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:58.808988 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 341/694] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:58.810275 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc5a6f-610e-4028-bf96-ea734331cb1b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:58.812467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5164b-1500-4659-acf5-cc0c99f2c5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:58.813248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5164b-1500-4659-acf5-cc0c99f2c5cc None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:58.813665 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5164b-1500-4659-acf5-cc0c99f2c5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:58.814056 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5164b-1500-4659-acf5-cc0c99f2c5cc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:58.815549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5164b-1500-4659-acf5-cc0c99f2c5cc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:58.816261 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5164b-1500-4659-acf5-cc0c99f2c5cc None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:58.827990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-89e5164b-1500-4659-acf5-cc0c99f2c5cc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 16:04:58.827990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:58.827990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:04:58.827990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:04:58.827990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:04:58.827990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:04:58.827990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:04:58.827990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:04:58.827990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 16:04:58.827990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:58.827990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:04:58.827990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:58.827990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:58.827990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:58.827990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:58.827990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:58.829105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:58.829105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:58.829105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:58.829105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:58.829105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:58.829105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:58.829105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:58.829105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:04:58.829105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:04:58.829105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:04:58.829105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:04:58.829105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:58.829105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:58.829105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:58.829105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:58.829105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:58.830452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:58.830452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:58.830452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:58.830452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:58.830452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:58.830452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:58.830452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:58.830452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:58.830452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:58.830452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:58.830452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:58.830452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:04:58.830452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:04:58.830452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 16:04:58.830452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:58.831214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 354/695] 10.222.0.141 () {56 vars in 1134 bytes} [Tue Jul 26 16:04:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:58.832094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5164b-1500-4659-acf5-cc0c99f2c5cc None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:58.865073 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:58.933447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:58.935756 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc5a6f-610e-4028-bf96-ea734331cb1b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:58.947659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5164b-1500-4659-acf5-cc0c99f2c5cc None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:58.972099 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e0857-36cf-405a-a10e-0fb6ffd24f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:58.972889 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e0857-36cf-405a-a10e-0fb6ffd24f6d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:58.973265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e0857-36cf-405a-a10e-0fb6ffd24f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:58.973626 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e0857-36cf-405a-a10e-0fb6ffd24f6d None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:58.974399 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e0857-36cf-405a-a10e-0fb6ffd24f6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:58.974890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e0857-36cf-405a-a10e-0fb6ffd24f6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:58.976396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e0857-36cf-405a-a10e-0fb6ffd24f6d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:58.985500 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba701758-feb2-4511-ae91-603c52e30cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:58.986519 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba701758-feb2-4511-ae91-603c52e30cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:58.987043 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba701758-feb2-4511-ae91-603c52e30cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:58.987496 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba701758-feb2-4511-ae91-603c52e30cb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:58.990215 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 342/696] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:04:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:58.991107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e0857-36cf-405a-a10e-0fb6ffd24f6d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:58.995663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba701758-feb2-4511-ae91-603c52e30cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:58.997440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba701758-feb2-4511-ae91-603c52e30cb3 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:59.011336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-ba701758-feb2-4511-ae91-603c52e30cb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:59.011336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:59.011336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:59.011336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:59.011336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:59.011336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:59.011336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:59.011336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:59.011336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:59.011336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:59.011336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:59.011336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:59.011336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:04:59.011336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:04:59.011336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:04:59.012267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:04:59.012267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:59.012267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:59.012267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:59.012267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:59.012267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:59.012267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:59.012267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:59.012267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:59.012267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:59.012267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:59.012267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:59.012267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:59.012267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:59.012267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:59.012267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:59.012267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:59.013165 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:04:59.013165 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:04:59.013165 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:04:59.013165 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:04:59.013165 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:04:59.013165 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:04:59.013165 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:04:59.013165 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:59.015339 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 355/697] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:04:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:59.016250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba701758-feb2-4511-ae91-603c52e30cb3 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:59.101958 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e0857-36cf-405a-a10e-0fb6ffd24f6d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:59.126424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba701758-feb2-4511-ae91-603c52e30cb3 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:59.126635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:59.137769 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e148964-eee3-464f-bf90-30056397118b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:59.142002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e148964-eee3-464f-bf90-30056397118b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:59.142002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e148964-eee3-464f-bf90-30056397118b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:59.142002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e148964-eee3-464f-bf90-30056397118b None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:59.142002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e148964-eee3-464f-bf90-30056397118b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:59.142002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e148964-eee3-464f-bf90-30056397118b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:59.142002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e148964-eee3-464f-bf90-30056397118b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:59.147133 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 343/698] 10.222.0.141 () {56 vars in 1129 bytes} [Tue Jul 26 16:04:58 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:59.148189 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e148964-eee3-464f-bf90-30056397118b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:59.163170 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed65f1-b545-47f9-b4e8-9855b5053f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:59.163814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed65f1-b545-47f9-b4e8-9855b5053f86 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:59.164096 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed65f1-b545-47f9-b4e8-9855b5053f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:59.164371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed65f1-b545-47f9-b4e8-9855b5053f86 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:59.172044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed65f1-b545-47f9-b4e8-9855b5053f86 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:59.174341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed65f1-b545-47f9-b4e8-9855b5053f86 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:59.186421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-53ed65f1-b545-47f9-b4e8-9855b5053f86 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 16:04:59.186421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:04:59.186421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:04:59.186421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:04:59.186421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:04:59.186421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:04:59.186421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:04:59.186421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:04:59.186421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:04:59.186421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:04:59.186421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:04:59.186421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:04:59.186421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:04:59.186421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:04:59.186421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:04:59.186421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:04:59.187360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:04:59.187360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:04:59.187360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:04:59.187360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:59.187360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:04:59.187360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:04:59.187360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:04:59.187360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:04:59.187360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:04:59.187360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:04:59.187360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:04:59.187360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:04:59.187360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:04:59.187360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:04:59.187360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:04:59.187360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:04:59.187360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:04:59.187360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:04:59.188262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:04:59.188262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:04:59.188262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:04:59.188262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:04:59.188262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:04:59.188262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:04:59.188262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:04:59.188262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:04:59.188262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 16:04:59.188262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:04:59.188262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 356/699] 10.222.0.141 () {56 vars in 1098 bytes} [Tue Jul 26 16:04:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:04:59.188903 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed65f1-b545-47f9-b4e8-9855b5053f86 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:59.200400 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:59.269485 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e148964-eee3-464f-bf90-30056397118b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:59.294461 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed65f1-b545-47f9-b4e8-9855b5053f86 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:59.306594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d3a52-d4d5-4437-b859-f80f31f83c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:59.307216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d3a52-d4d5-4437-b859-f80f31f83c99 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:59.307535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d3a52-d4d5-4437-b859-f80f31f83c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:59.307767 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d3a52-d4d5-4437-b859-f80f31f83c99 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:59.308517 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d3a52-d4d5-4437-b859-f80f31f83c99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:59.308853 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d3a52-d4d5-4437-b859-f80f31f83c99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:59.310455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d3a52-d4d5-4437-b859-f80f31f83c99 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:59.323629 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 344/700] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:04:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:59.324409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d3a52-d4d5-4437-b859-f80f31f83c99 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:59.332352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24538e92-7dc7-4dd3-8aba-01b09ef0aa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:59.333465 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24538e92-7dc7-4dd3-8aba-01b09ef0aa9f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:59.333953 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24538e92-7dc7-4dd3-8aba-01b09ef0aa9f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:59.334574 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24538e92-7dc7-4dd3-8aba-01b09ef0aa9f None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:59.335466 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24538e92-7dc7-4dd3-8aba-01b09ef0aa9f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:59.335986 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24538e92-7dc7-4dd3-8aba-01b09ef0aa9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:59.337657 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24538e92-7dc7-4dd3-8aba-01b09ef0aa9f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:59.343965 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 357/701] 10.222.0.141 () {56 vars in 1129 bytes} [Tue Jul 26 16:04:59 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:59.345015 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24538e92-7dc7-4dd3-8aba-01b09ef0aa9f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:59.356551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:59.439049 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d3a52-d4d5-4437-b859-f80f31f83c99 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:59.477705 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d4aa4-b7ea-45fc-ab50-c71a9b6001a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:59.478333 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d4aa4-b7ea-45fc-ab50-c71a9b6001a0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:59.478619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d4aa4-b7ea-45fc-ab50-c71a9b6001a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:59.478892 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d4aa4-b7ea-45fc-ab50-c71a9b6001a0 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:59.479826 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d4aa4-b7ea-45fc-ab50-c71a9b6001a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:59.480139 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d4aa4-b7ea-45fc-ab50-c71a9b6001a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:59.481747 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d4aa4-b7ea-45fc-ab50-c71a9b6001a0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:59.500998 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:59.503605 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 345/702] 10.222.0.141 () {56 vars in 1138 bytes} [Tue Jul 26 16:04:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:59.509406 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d4aa4-b7ea-45fc-ab50-c71a9b6001a0 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:59.559703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24538e92-7dc7-4dd3-8aba-01b09ef0aa9f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:59.607252 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:59.625701 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d4aa4-b7ea-45fc-ab50-c71a9b6001a0 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:04:59.643003 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d265db2-f59f-41e1-9fb4-e9eb5617d002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:59.643643 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d265db2-f59f-41e1-9fb4-e9eb5617d002 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:59.643927 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d265db2-f59f-41e1-9fb4-e9eb5617d002 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:59.644206 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d265db2-f59f-41e1-9fb4-e9eb5617d002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:59.645029 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d265db2-f59f-41e1-9fb4-e9eb5617d002 None admin] RBAC: Adding query filter params (role.id=6540af5baf2c4ff78d0fedfc4bea4e46, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=6c5f92f21868436a99a5c7aaa1fc40b5) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:04:59.645345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d265db2-f59f-41e1-9fb4-e9eb5617d002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:59.646784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d265db2-f59f-41e1-9fb4-e9eb5617d002 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:59.659928 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 358/703] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:04:59 2022] GET /identity/v3/role_assignments?user.id=6c5f92f21868436a99a5c7aaa1fc40b5&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=6540af5baf2c4ff78d0fedfc4bea4e46 => generated 610 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:04:59.666245 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b6d29-75f4-4627-8822-caf27ffa45ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:04:59.666873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b6d29-75f4-4627-8822-caf27ffa45ea None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:59.667155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b6d29-75f4-4627-8822-caf27ffa45ea None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:59.667430 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b6d29-75f4-4627-8822-caf27ffa45ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:59.746344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b6d29-75f4-4627-8822-caf27ffa45ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:04:59.747816 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b6d29-75f4-4627-8822-caf27ffa45ea None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:04:59.834368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:04:59.856598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 346/704] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:04:59 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:04:59.862912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b6d29-75f4-4627-8822-caf27ffa45ea None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:04:59.863302 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fbe17-8374-4857-9722-d5d7edad6523 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:59.863595 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fbe17-8374-4857-9722-d5d7edad6523 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:59.863875 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fbe17-8374-4857-9722-d5d7edad6523 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:59.865754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 359/705] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:04:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:04:59.871369 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e420e-0ea4-4964-b356-94a3c508c1ab None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:04:59.871655 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e420e-0ea4-4964-b356-94a3c508c1ab None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:04:59.871938 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e420e-0ea4-4964-b356-94a3c508c1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:04:59.915727 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-068e420e-0ea4-4964-b356-94a3c508c1ab None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:04:59.919039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-068e420e-0ea4-4964-b356-94a3c508c1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:00.003260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b6d29-75f4-4627-8822-caf27ffa45ea None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:00.016079 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 360/706] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:04:59 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:05:00.042961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e420e-0ea4-4964-b356-94a3c508c1ab None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:00.046048 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6fb3e-f71a-4dce-b5ba-b4d6bf3bee8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:00.048165 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6fb3e-f71a-4dce-b5ba-b4d6bf3bee8e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:00.049372 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6fb3e-f71a-4dce-b5ba-b4d6bf3bee8e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:00.049851 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6fb3e-f71a-4dce-b5ba-b4d6bf3bee8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:00.063638 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6fb3e-f71a-4dce-b5ba-b4d6bf3bee8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:00.066049 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6fb3e-f71a-4dce-b5ba-b4d6bf3bee8e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:00.086785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-42f6fb3e-f71a-4dce-b5ba-b4d6bf3bee8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:00.086785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:00.086785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:00.086785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:00.086785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:00.086785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:00.086785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:00.086785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:00.086785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:00.086785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:00.086785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:00.086785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:00.086785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:00.086785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:00.086785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:00.087733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:00.087733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:00.087733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:00.087733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:00.087733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:00.087733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:00.087733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:00.087733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:00.087733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:00.087733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:00.087733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:00.087733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:00.087733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:00.087733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:00.087733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:00.087733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:00.087733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:00.088584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:00.088584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:00.088584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:00.088584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:00.091379 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 347/707] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:00.097903 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6fb3e-f71a-4dce-b5ba-b4d6bf3bee8e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:00.126793 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:00.143081 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:00.166538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e420e-0ea4-4964-b356-94a3c508c1ab None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:00.203214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862eab25-7d34-417a-995d-8ce390ff120f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:00.203860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862eab25-7d34-417a-995d-8ce390ff120f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:00.204152 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862eab25-7d34-417a-995d-8ce390ff120f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:00.204417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862eab25-7d34-417a-995d-8ce390ff120f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:00.218210 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862eab25-7d34-417a-995d-8ce390ff120f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:00.219674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862eab25-7d34-417a-995d-8ce390ff120f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:00.227087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6fb3e-f71a-4dce-b5ba-b4d6bf3bee8e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:00.240844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-862eab25-7d34-417a-995d-8ce390ff120f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:00.240844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:00.240844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:00.240844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:00.240844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:00.240844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:00.240844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:00.240844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:00.240844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:00.240844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:00.240844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:00.240844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:00.240844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:00.240844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:00.240844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:00.241783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:00.241783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:00.241783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:00.241783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:00.241783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:00.241783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:00.241783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:00.241783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:00.241783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:00.241783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:00.241783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:00.241783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:00.241783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:00.241783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:00.241783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:00.241783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:00.241783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:00.242643 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:00.242643 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:00.242643 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:00.242643 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:00.242643 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 361/708] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:00.249755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862eab25-7d34-417a-995d-8ce390ff120f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:00.276173 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30820d5-cf49-42e2-aebe-6562cea69c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:00.278101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30820d5-cf49-42e2-aebe-6562cea69c5a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:00.278828 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30820d5-cf49-42e2-aebe-6562cea69c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:00.279317 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30820d5-cf49-42e2-aebe-6562cea69c5a None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:00.280452 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30820d5-cf49-42e2-aebe-6562cea69c5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:00.281318 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30820d5-cf49-42e2-aebe-6562cea69c5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:00.283963 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30820d5-cf49-42e2-aebe-6562cea69c5a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:00.299744 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 348/709] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:00.305582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30820d5-cf49-42e2-aebe-6562cea69c5a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:00.373663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862eab25-7d34-417a-995d-8ce390ff120f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:00.407589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:00.435971 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c31785-db98-4375-82e9-ceea3423da77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:00.436597 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c31785-db98-4375-82e9-ceea3423da77 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:00.436905 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c31785-db98-4375-82e9-ceea3423da77 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:00.437182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c31785-db98-4375-82e9-ceea3423da77 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:00.437885 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c31785-db98-4375-82e9-ceea3423da77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:00.438191 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c31785-db98-4375-82e9-ceea3423da77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:00.440094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c31785-db98-4375-82e9-ceea3423da77 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:00.444813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:00.455429 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30820d5-cf49-42e2-aebe-6562cea69c5a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:00.466460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 362/710] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:00.474410 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c31785-db98-4375-82e9-ceea3423da77 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:00.525519 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba1a2e-4ea2-4f99-a582-0f024efe1131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:00.526052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba1a2e-4ea2-4f99-a582-0f024efe1131 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:00.526332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba1a2e-4ea2-4f99-a582-0f024efe1131 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:00.526606 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba1a2e-4ea2-4f99-a582-0f024efe1131 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:00.542333 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba1a2e-4ea2-4f99-a582-0f024efe1131 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:00.544522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba1a2e-4ea2-4f99-a582-0f024efe1131 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:00.567155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-09ba1a2e-4ea2-4f99-a582-0f024efe1131 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:00.567155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:00.567155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:00.567155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:00.567155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:00.567155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:00.567155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:00.567155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:00.567155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:00.567155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:00.567155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:00.567155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:00.567155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:05:00.567155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:05:00.567155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:05:00.568061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:05:00.568061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:00.568061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:00.568061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:00.568061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:00.568061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:00.568061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:00.568061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:00.568061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:00.568061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:00.568061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:00.568061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:00.568061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:00.568061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:00.568061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:00.568061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:00.568061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:00.568994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:05:00.568994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:05:00.568994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:05:00.568994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:05:00.568994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:05:00.568994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:05:00.568994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:00.568994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:00.568994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 349/711] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:00.574699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba1a2e-4ea2-4f99-a582-0f024efe1131 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:00.621885 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c31785-db98-4375-82e9-ceea3423da77 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:00.660591 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801592d-a529-4267-bb2e-8a00e4409d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:00.661469 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801592d-a529-4267-bb2e-8a00e4409d3a None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:00.662035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801592d-a529-4267-bb2e-8a00e4409d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:00.662320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801592d-a529-4267-bb2e-8a00e4409d3a None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:00.663015 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801592d-a529-4267-bb2e-8a00e4409d3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:00.665066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801592d-a529-4267-bb2e-8a00e4409d3a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:00.683714 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba1a2e-4ea2-4f99-a582-0f024efe1131 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:00.718887 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c7ceb-885a-49f1-bdf7-40f8d8cf2125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:00.719508 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c7ceb-885a-49f1-bdf7-40f8d8cf2125 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:00.719780 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c7ceb-885a-49f1-bdf7-40f8d8cf2125 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:00.720075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c7ceb-885a-49f1-bdf7-40f8d8cf2125 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:00.720843 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c7ceb-885a-49f1-bdf7-40f8d8cf2125 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:00.721150 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c7ceb-885a-49f1-bdf7-40f8d8cf2125 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:00.722576 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c7ceb-885a-49f1-bdf7-40f8d8cf2125 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:00.739970 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 350/712] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:05:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:00.739970 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de245c-227d-4b8f-8d8d-6f2e8b44bc8a None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:00.739970 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de245c-227d-4b8f-8d8d-6f2e8b44bc8a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:00.739970 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de245c-227d-4b8f-8d8d-6f2e8b44bc8a None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:00.739970 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 351/713] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:00.740945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de245c-227d-4b8f-8d8d-6f2e8b44bc8a None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:00.759711 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:00.781581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 363/714] 10.222.0.141 () {60 vars in 1137 bytes} [Tue Jul 26 16:05:00 2022] POST /identity/v3/users => generated 255 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:05:00.783380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fe898-14e8-4d3b-832a-1f000f678ec5 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:00.783892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fe898-14e8-4d3b-832a-1f000f678ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:00.784436 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fe898-14e8-4d3b-832a-1f000f678ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:00.811093 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f48fe898-14e8-4d3b-832a-1f000f678ec5 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:00.813403 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f48fe898-14e8-4d3b-832a-1f000f678ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:00.869158 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:00.895768 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de245c-227d-4b8f-8d8d-6f2e8b44bc8a None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:00.936937 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 364/715] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:05:00.960487 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fe898-14e8-4d3b-832a-1f000f678ec5 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:00.991165 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974f13a-f827-489f-b646-4a09a0f3e6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:00.991886 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974f13a-f827-489f-b646-4a09a0f3e6df None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:00.992320 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974f13a-f827-489f-b646-4a09a0f3e6df None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:00.992692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974f13a-f827-489f-b646-4a09a0f3e6df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:00.993663 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974f13a-f827-489f-b646-4a09a0f3e6df None admin] RBAC: Adding query filter params (role.id=94ecbd6c86a84b75bdb0c57fc27a9a07, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=f7eac931cabf4921b6dbd42f63b9300f) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:00.994043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974f13a-f827-489f-b646-4a09a0f3e6df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:00.995670 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974f13a-f827-489f-b646-4a09a0f3e6df None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:01.003751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 352/716] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:05:00 2022] GET /identity/v3/role_assignments?user.id=f7eac931cabf4921b6dbd42f63b9300f&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 260 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:01.073609 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fe898-14e8-4d3b-832a-1f000f678ec5 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:01.112692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5b6f1-7cd6-4cb6-9255-c8065710951a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:01.113433 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5b6f1-7cd6-4cb6-9255-c8065710951a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:01.113718 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5b6f1-7cd6-4cb6-9255-c8065710951a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:01.113992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5b6f1-7cd6-4cb6-9255-c8065710951a None admin] PATH_INFO: `/v3/services/network` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:01.114625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5b6f1-7cd6-4cb6-9255-c8065710951a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:01.116014 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5b6f1-7cd6-4cb6-9255-c8065710951a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:01.125729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-6da5b6f1-7cd6-4cb6-9255-c8065710951a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 16:05:01.125729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:01.125729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:01.125729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:01.125729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:01.125729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:01.125729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:01.125729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:01.125729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 16:05:01.125729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:01.125729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:01.125729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:01.125729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:01.125729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:01.125729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:01.125729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:01.125729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:01.127446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:01.127446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:01.127446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:01.127446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:01.127446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:01.127446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:01.127446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:01.127446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:01.127446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:01.127446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:01.127446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:01.127446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:01.127446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:01.127446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:01.127446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:01.127446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:01.134204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:01.134204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:01.134204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:01.134204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:01.134204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:01.134204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:01.134204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:01.134204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:01.134204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:01.134204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:01.134204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:01.134204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:01.134204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 16:05:01.134204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:01.134204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 365/717] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:00 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:01.136134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974f13a-f827-489f-b646-4a09a0f3e6df None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:01.234912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:01.254494 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974f13a-f827-489f-b646-4a09a0f3e6df None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:01.289252 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddc4e8-75b1-4f68-9ac5-1f6048f4f64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:01.289883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddc4e8-75b1-4f68-9ac5-1f6048f4f64a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:01.290136 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddc4e8-75b1-4f68-9ac5-1f6048f4f64a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:01.290397 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddc4e8-75b1-4f68-9ac5-1f6048f4f64a None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:01.291065 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddc4e8-75b1-4f68-9ac5-1f6048f4f64a None admin] RBAC: Adding query filter params (name=network) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:01.291364 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddc4e8-75b1-4f68-9ac5-1f6048f4f64a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:01.292749 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddc4e8-75b1-4f68-9ac5-1f6048f4f64a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:01.297699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 353/718] 10.222.0.141 () {56 vars in 1117 bytes} [Tue Jul 26 16:05:01 2022] GET /identity/v3/services?name=network => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:01.303325 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5b6f1-7cd6-4cb6-9255-c8065710951a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:01.336375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:01.436406 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5b6f1-7cd6-4cb6-9255-c8065710951a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:01.484713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699d561-b8e7-40e4-9772-ca7fe59330c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:01.485445 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699d561-b8e7-40e4-9772-ca7fe59330c7 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:01.485702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699d561-b8e7-40e4-9772-ca7fe59330c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:01.485977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699d561-b8e7-40e4-9772-ca7fe59330c7 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:01.486655 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699d561-b8e7-40e4-9772-ca7fe59330c7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:01.486955 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699d561-b8e7-40e4-9772-ca7fe59330c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:01.488378 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699d561-b8e7-40e4-9772-ca7fe59330c7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:01.496548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 366/719] 10.222.0.141 () {56 vars in 1117 bytes} [Tue Jul 26 16:05:01 2022] GET /identity/v3/services?type=network => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:01.957343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf19ccc-0cec-46f8-b87d-b286b165d93f None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:01.957691 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf19ccc-0cec-46f8-b87d-b286b165d93f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:01.957908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf19ccc-0cec-46f8-b87d-b286b165d93f None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:01.959528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 354/720] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:01.964916 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa193af2-1c4b-42ba-9e2d-3412803ce257 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:01.965399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa193af2-1c4b-42ba-9e2d-3412803ce257 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:01.965478 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa193af2-1c4b-42ba-9e2d-3412803ce257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:01.988837 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-fa193af2-1c4b-42ba-9e2d-3412803ce257 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:01.990019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fa193af2-1c4b-42ba-9e2d-3412803ce257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:02.080492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 367/721] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:05:02.105040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf19ccc-0cec-46f8-b87d-b286b165d93f None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:02.241487 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf19ccc-0cec-46f8-b87d-b286b165d93f None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:02.286268 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc9f92-6670-40ac-a8bf-2e699dcaf98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:02.286895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc9f92-6670-40ac-a8bf-2e699dcaf98c None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:02.287169 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc9f92-6670-40ac-a8bf-2e699dcaf98c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:02.287467 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc9f92-6670-40ac-a8bf-2e699dcaf98c None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:02.288142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc9f92-6670-40ac-a8bf-2e699dcaf98c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:02.289553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc9f92-6670-40ac-a8bf-2e699dcaf98c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:02.387491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504654ec-1fa1-4a65-bdbe-94d4b4b69df3 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:02.388162 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504654ec-1fa1-4a65-bdbe-94d4b4b69df3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:02.388687 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504654ec-1fa1-4a65-bdbe-94d4b4b69df3 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:02.390638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 368/722] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:02.396226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a64bfe-6b83-4945-9a37-d74915915392 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:02.396815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a64bfe-6b83-4945-9a37-d74915915392 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:02.397393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a64bfe-6b83-4945-9a37-d74915915392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:02.399646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 355/723] 10.222.0.141 () {60 vars in 1146 bytes} [Tue Jul 26 16:05:02 2022] POST /identity/v3/services => generated 252 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:05:02.424176 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f0a64bfe-6b83-4945-9a37-d74915915392 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:02.425911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f0a64bfe-6b83-4945-9a37-d74915915392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:02.456200 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:02.537728 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 369/724] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:02 2022] POST /identity/v3/auth/tokens => generated 904 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:05:02.562054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc9f92-6670-40ac-a8bf-2e699dcaf98c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:02.567113 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:02.682984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc9f92-6670-40ac-a8bf-2e699dcaf98c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:02.719546 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6d643-d965-4457-bb83-d97fb6409983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:02.721035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6d643-d965-4457-bb83-d97fb6409983 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:02.721523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6d643-d965-4457-bb83-d97fb6409983 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:02.722022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6d643-d965-4457-bb83-d97fb6409983 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:02.736364 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6d643-d965-4457-bb83-d97fb6409983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:05:02.742106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-d0a6d643-d965-4457-bb83-d97fb6409983 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:05:02.742106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:02.742106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:02.742106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:02.742106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:02.742106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:02.742106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:02.742106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:02.742106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:02.742106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:02.742106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:02.742106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:02.742106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:05:02.742106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:05:02.742106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:05:02.742106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:05:02.743038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:05:02.743038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:05:02.743038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:05:02.743038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:05:02.743038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:02.743038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:02.743038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:02.743038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:02.743038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:02.743038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:02.743038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:02.743038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:02.743038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:02.743038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:02.743038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:02.743038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:02.743863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:02.743863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:02.743863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:02.743863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:02.743863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:05:02.743863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:05:02.743863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:05:02.743863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:05:02.743863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:05:02.743863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:05:02.743863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:05:02.743863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:02.746500 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 356/725] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:05:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:02.752800 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a64bfe-6b83-4945-9a37-d74915915392 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:02.856804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a64bfe-6b83-4945-9a37-d74915915392 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:02.892475 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ce5b3-3f61-4a9c-b47b-df83f7cfa018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:02.893456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ce5b3-3f61-4a9c-b47b-df83f7cfa018 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:02.893959 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ce5b3-3f61-4a9c-b47b-df83f7cfa018 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:02.894455 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ce5b3-3f61-4a9c-b47b-df83f7cfa018 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:02.895393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ce5b3-3f61-4a9c-b47b-df83f7cfa018 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:02.895929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ce5b3-3f61-4a9c-b47b-df83f7cfa018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:02.897738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ce5b3-3f61-4a9c-b47b-df83f7cfa018 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:02.911924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 370/726] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:05:02 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:02.922039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6d643-d965-4457-bb83-d97fb6409983 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:03.013475 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:03.063633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6d643-d965-4457-bb83-d97fb6409983 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:03.114593 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15e3f1-cce2-4d46-af08-fd51e91ef718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:03.115175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15e3f1-cce2-4d46-af08-fd51e91ef718 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:03.115458 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15e3f1-cce2-4d46-af08-fd51e91ef718 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:03.115743 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15e3f1-cce2-4d46-af08-fd51e91ef718 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:03.132995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15e3f1-cce2-4d46-af08-fd51e91ef718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:03.134459 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15e3f1-cce2-4d46-af08-fd51e91ef718 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:03.154396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-2a15e3f1-cce2-4d46-af08-fd51e91ef718 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:03.154396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:03.154396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:03.154396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:03.154396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:03.154396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:03.154396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:03.154396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:03.154396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:03.154396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:03.154396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:03.154396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:03.154396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:03.154396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:03.154396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:03.155291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:03.155291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:03.155291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:03.155291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:03.155291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:03.155291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:03.155291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:03.155291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:03.155291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:03.155291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:03.155291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:03.155291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:03.155291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:03.155291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:03.155291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:03.155291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:03.155291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:03.156174 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:03.156174 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:03.156174 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:03.156174 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:03.159185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 357/727] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:03.165118 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ce5b3-3f61-4a9c-b47b-df83f7cfa018 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:03.216299 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:03.332371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ce5b3-3f61-4a9c-b47b-df83f7cfa018 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:03.376146 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9737ba-2578-4140-be6c-1f57c1720f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:03.376828 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9737ba-2578-4140-be6c-1f57c1720f58 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:03.377114 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9737ba-2578-4140-be6c-1f57c1720f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:03.377391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9737ba-2578-4140-be6c-1f57c1720f58 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:03.378085 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9737ba-2578-4140-be6c-1f57c1720f58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:03.378394 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9737ba-2578-4140-be6c-1f57c1720f58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:03.379753 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9737ba-2578-4140-be6c-1f57c1720f58 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:03.391464 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 371/728] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:03.397666 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15e3f1-cce2-4d46-af08-fd51e91ef718 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:03.594764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaf1dd-8328-4b3b-ba37-33bd4a8374c1 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:03.595174 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaf1dd-8328-4b3b-ba37-33bd4a8374c1 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:03.595376 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaf1dd-8328-4b3b-ba37-33bd4a8374c1 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:03.597014 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 372/729] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:03.601857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddc6fd-e91d-4a9b-9d27-afeed3877830 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:03.602142 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddc6fd-e91d-4a9b-9d27-afeed3877830 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:03.602420 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddc6fd-e91d-4a9b-9d27-afeed3877830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:03.617064 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15e3f1-cce2-4d46-af08-fd51e91ef718 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:03.641809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-34ddc6fd-e91d-4a9b-9d27-afeed3877830 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:03.643478 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-34ddc6fd-e91d-4a9b-9d27-afeed3877830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:03.652690 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:03.672098 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb37f1-99ce-4d2a-95e5-f5e46d2d311a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:03.673138 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb37f1-99ce-4d2a-95e5-f5e46d2d311a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:03.673421 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb37f1-99ce-4d2a-95e5-f5e46d2d311a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:03.673692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb37f1-99ce-4d2a-95e5-f5e46d2d311a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:03.689168 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb37f1-99ce-4d2a-95e5-f5e46d2d311a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:03.690640 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb37f1-99ce-4d2a-95e5-f5e46d2d311a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:03.715972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-05fb37f1-99ce-4d2a-95e5-f5e46d2d311a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 16:05:03.715972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:03.715972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:03.715972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:03.715972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:03.715972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:03.715972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:03.715972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:03.715972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:03.715972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:03.715972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:03.715972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:03.715972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:05:03.715972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:05:03.715972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:05:03.715972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:05:03.717021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:03.717021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:03.717021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:05:03.717021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:03.717021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:05:03.717021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:03.717021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:03.717021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:03.717021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:03.717021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:03.717021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:03.717021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:03.717021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:03.717021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:03.717021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:03.717021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:03.717021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:03.717021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:03.717938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:03.717938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:03.717938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:05:03.717938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:05:03.717938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:05:03.717938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:05:03.717938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:05:03.717938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:05:03.717938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 16:05:03.717938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:03.717938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 358/730] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:05:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:03.721794 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bac31c-1387-4cb3-aa2e-f987cc38b762 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:03.721794 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bac31c-1387-4cb3-aa2e-f987cc38b762 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:03.721794 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bac31c-1387-4cb3-aa2e-f987cc38b762 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:03.724738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 359/731] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:03 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:03.725571 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bac31c-1387-4cb3-aa2e-f987cc38b762 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:03.731669 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:03.737374 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 373/732] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:03 2022] POST /identity/v3/auth/tokens => generated 904 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 16:05:03.738971 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0d827-3175-4f70-8607-05cc5c783b9c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:03.739615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0d827-3175-4f70-8607-05cc5c783b9c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:03.740256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0d827-3175-4f70-8607-05cc5c783b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:03.759974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-31f0d827-3175-4f70-8607-05cc5c783b9c None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:03.761528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-31f0d827-3175-4f70-8607-05cc5c783b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:03.836705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 374/733] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:03 2022] POST /identity/v3/auth/tokens => generated 904 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:05:03.836705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0d827-3175-4f70-8607-05cc5c783b9c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:03.853646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bac31c-1387-4cb3-aa2e-f987cc38b762 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:03.916796 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa6f51-a4e3-46a2-a844-dc19348edd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:03.916796 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa6f51-a4e3-46a2-a844-dc19348edd0c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:03.916796 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa6f51-a4e3-46a2-a844-dc19348edd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:03.916796 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa6f51-a4e3-46a2-a844-dc19348edd0c None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:03.917393 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa6f51-a4e3-46a2-a844-dc19348edd0c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:03.917393 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa6f51-a4e3-46a2-a844-dc19348edd0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:03.919178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa6f51-a4e3-46a2-a844-dc19348edd0c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:03.949050 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 360/734] 10.222.0.141 () {56 vars in 1140 bytes} [Tue Jul 26 16:05:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:03.950190 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa6f51-a4e3-46a2-a844-dc19348edd0c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:03.963500 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0d827-3175-4f70-8607-05cc5c783b9c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:03.986361 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:03.998011 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:04.008350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a004130-aad2-42fb-a32c-45c60dcd7e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:04.009810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a004130-aad2-42fb-a32c-45c60dcd7e8f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:04.010553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a004130-aad2-42fb-a32c-45c60dcd7e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:04.011024 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a004130-aad2-42fb-a32c-45c60dcd7e8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:04.025273 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a004130-aad2-42fb-a32c-45c60dcd7e8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:05:04.030944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-6a004130-aad2-42fb-a32c-45c60dcd7e8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:05:04.030944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:04.030944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:04.030944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:04.030944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:04.030944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:04.030944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:04.030944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:04.030944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:04.030944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:04.030944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:04.030944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:04.030944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:05:04.030944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:05:04.030944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:05:04.030944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:05:04.031821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:05:04.031821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:05:04.031821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:05:04.031821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:05:04.031821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:04.031821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:04.031821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:04.031821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:04.031821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:04.031821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:04.031821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:04.031821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:04.031821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:04.031821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:04.031821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:04.031821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:04.032683 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:04.032683 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:04.032683 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:04.032683 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:04.032683 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:05:04.032683 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:05:04.032683 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:05:04.032683 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:05:04.032683 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:05:04.032683 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:05:04.032683 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:05:04.032683 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:04.035403 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 375/735] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:05:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:04.036941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a004130-aad2-42fb-a32c-45c60dcd7e8f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:04.058695 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa6f51-a4e3-46a2-a844-dc19348edd0c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:04.096149 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9436faf-2b18-4d55-92f4-87794d0caf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:04.096820 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9436faf-2b18-4d55-92f4-87794d0caf68 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:04.097109 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9436faf-2b18-4d55-92f4-87794d0caf68 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:04.097387 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9436faf-2b18-4d55-92f4-87794d0caf68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:04.107953 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9436faf-2b18-4d55-92f4-87794d0caf68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:05:04.113620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-a9436faf-2b18-4d55-92f4-87794d0caf68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:05:04.113620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:04.113620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:04.113620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:04.113620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:04.113620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:04.113620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:04.113620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:04.113620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:04.113620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:04.113620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:04.113620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:04.113620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:05:04.113620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:05:04.113620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:05:04.113620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:05:04.114522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:05:04.114522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:05:04.114522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:05:04.114522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:05:04.114522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:04.114522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:04.114522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:04.114522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:04.114522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:04.114522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:04.114522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:04.114522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:04.114522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:04.114522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:04.114522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:04.114522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:04.115337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:04.115337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:04.115337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:04.115337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:04.115337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:05:04.115337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:05:04.115337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:05:04.115337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:05:04.115337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:05:04.115337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:05:04.115337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:05:04.115337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:04.115337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 361/736] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:05:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:04.116081 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9436faf-2b18-4d55-92f4-87794d0caf68 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:04.158222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a004130-aad2-42fb-a32c-45c60dcd7e8f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:04.215268 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392c5e2-10c9-46f1-88f4-de88cebd52c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:04.215938 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392c5e2-10c9-46f1-88f4-de88cebd52c7 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:04.216072 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392c5e2-10c9-46f1-88f4-de88cebd52c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:04.216344 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392c5e2-10c9-46f1-88f4-de88cebd52c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:04.244712 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:04.251368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9436faf-2b18-4d55-92f4-87794d0caf68 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:04.275647 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:04.286433 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392c5e2-10c9-46f1-88f4-de88cebd52c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:04.286913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af0987-7efa-4207-b186-20e956523647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:04.287882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392c5e2-10c9-46f1-88f4-de88cebd52c7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:04.288081 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af0987-7efa-4207-b186-20e956523647 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:04.288350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af0987-7efa-4207-b186-20e956523647 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:04.288626 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af0987-7efa-4207-b186-20e956523647 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:04.289365 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af0987-7efa-4207-b186-20e956523647 None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:04.289670 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af0987-7efa-4207-b186-20e956523647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:04.295790 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af0987-7efa-4207-b186-20e956523647 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:04.304362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 362/737] 10.222.0.141 () {56 vars in 1108 bytes} [Tue Jul 26 16:05:04 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:04.304362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3783f-d985-48d3-a649-affe635a2fac None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:04.304362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3783f-d985-48d3-a649-affe635a2fac None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:04.304362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3783f-d985-48d3-a649-affe635a2fac None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:04.304362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 363/738] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:04 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:04.304362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3783f-d985-48d3-a649-affe635a2fac None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:04.399993 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 376/739] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:05:04 2022] GET /identity/v3/auth/tokens => generated 904 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 16:05:04.399993 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392c5e2-10c9-46f1-88f4-de88cebd52c7 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:04.415391 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3783f-d985-48d3-a649-affe635a2fac None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:04.451118 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7d09c-cb0b-4115-91bb-6bc908c82303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:04.451732 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7d09c-cb0b-4115-91bb-6bc908c82303 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:04.452011 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7d09c-cb0b-4115-91bb-6bc908c82303 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:04.452281 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7d09c-cb0b-4115-91bb-6bc908c82303 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:04.453021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7d09c-cb0b-4115-91bb-6bc908c82303 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:04.453326 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7d09c-cb0b-4115-91bb-6bc908c82303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:04.454850 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7d09c-cb0b-4115-91bb-6bc908c82303 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:04.468888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 364/740] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:05:04 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:04.470531 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3094c82-b766-4f09-b863-feeb16f91cd2 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:04.470814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3094c82-b766-4f09-b863-feeb16f91cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:04.471200 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3094c82-b766-4f09-b863-feeb16f91cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:04.494351 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:04.495463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-f3094c82-b766-4f09-b863-feeb16f91cd2 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:04.496683 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f3094c82-b766-4f09-b863-feeb16f91cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:04.504652 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392c5e2-10c9-46f1-88f4-de88cebd52c7 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:04.510957 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:04.541713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d93744-767f-4f41-a670-268182787ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:04.542702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d93744-767f-4f41-a670-268182787ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:04.543194 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d93744-767f-4f41-a670-268182787ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:04.543662 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d93744-767f-4f41-a670-268182787ab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:04.555352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d93744-767f-4f41-a670-268182787ab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:04.557022 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d93744-767f-4f41-a670-268182787ab7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:04.565642 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 365/741] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:04 2022] POST /identity/v3/auth/tokens => generated 904 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 16:05:04.566478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3094c82-b766-4f09-b863-feeb16f91cd2 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:04.584447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-b3d93744-767f-4f41-a670-268182787ab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:04.584447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:04.584447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:04.584447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:04.584447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:04.584447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:04.584447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:04.584447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:04.584447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:04.584447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:04.584447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:04.584447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:04.584447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:04.584447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:04.584447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:04.585383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:04.585383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:04.585383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:04.585383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:04.585383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:04.585383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:04.585383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:04.585383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:04.585383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:04.585383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:04.585383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:04.585383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:04.585383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:04.585383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:04.585383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:04.585383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:04.585383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:04.586255 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:04.586255 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:04.586255 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:04.586255 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:04.590287 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 377/742] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:04.591208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d93744-767f-4f41-a670-268182787ab7 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:04.683268 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3094c82-b766-4f09-b863-feeb16f91cd2 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:04.692964 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d93744-767f-4f41-a670-268182787ab7 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:04.721442 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d88e22-f0e7-4304-9c55-236d0fa5b036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:04.722007 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d88e22-f0e7-4304-9c55-236d0fa5b036 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:04.722289 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d88e22-f0e7-4304-9c55-236d0fa5b036 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:04.722560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d88e22-f0e7-4304-9c55-236d0fa5b036 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:04.728501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3d34f-7e0c-4b56-8098-fc88da5a6a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:04.729451 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3d34f-7e0c-4b56-8098-fc88da5a6a51 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:04.729451 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3d34f-7e0c-4b56-8098-fc88da5a6a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:04.729702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3d34f-7e0c-4b56-8098-fc88da5a6a51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:04.733433 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d88e22-f0e7-4304-9c55-236d0fa5b036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:04.734879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d88e22-f0e7-4304-9c55-236d0fa5b036 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:04.740549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3d34f-7e0c-4b56-8098-fc88da5a6a51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:04.741997 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3d34f-7e0c-4b56-8098-fc88da5a6a51 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:04.743870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:04.744384 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:04.750551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-70d88e22-f0e7-4304-9c55-236d0fa5b036 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:04.750551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:04.750551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:04.750551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:04.750551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:04.750551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:04.750551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:04.750551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:04.750551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:04.750551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:04.750551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:04.750551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:04.750551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:04.750551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:04.750551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:04.751441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:04.751441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:04.751441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:04.751441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:04.751441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:04.751441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:04.751441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:04.751441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:04.751441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:04.751441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:04.751441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:04.751441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:04.751441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:04.751441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:04.751441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:04.751441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:04.751441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:04.752338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:04.752338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:04.752338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:04.752338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:04.752338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 366/743] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:04.752624 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d88e22-f0e7-4304-9c55-236d0fa5b036 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:04.762646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-2ec3d34f-7e0c-4b56-8098-fc88da5a6a51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:04.762646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:04.762646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:04.762646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:04.762646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:04.762646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:04.762646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:04.762646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:04.762646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:04.762646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:04.762646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:04.762646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:04.762646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:04.762646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:04.762646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:04.763615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:04.763615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:04.763615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:04.763615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:04.763615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:04.763615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:04.763615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:04.763615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:04.763615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:04.763615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:04.763615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:04.763615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:04.763615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:04.763615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:04.763615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:04.763615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:04.763615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:04.764495 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:04.764495 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:04.764495 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:04.764495 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:04.764495 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 378/744] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:04.764797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3d34f-7e0c-4b56-8098-fc88da5a6a51 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:04.864234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d88e22-f0e7-4304-9c55-236d0fa5b036 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:04.867493 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3d34f-7e0c-4b56-8098-fc88da5a6a51 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:04.898826 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769af6fb-ffd3-45fa-9dc1-f71b88a2e225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:04.899401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769af6fb-ffd3-45fa-9dc1-f71b88a2e225 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:04.899681 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769af6fb-ffd3-45fa-9dc1-f71b88a2e225 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:04.899950 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769af6fb-ffd3-45fa-9dc1-f71b88a2e225 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:04.900644 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769af6fb-ffd3-45fa-9dc1-f71b88a2e225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:04.900955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769af6fb-ffd3-45fa-9dc1-f71b88a2e225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:04.902311 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769af6fb-ffd3-45fa-9dc1-f71b88a2e225 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:04.902558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d523b-919e-4bd8-a4b6-073e8f2cbc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:04.903175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d523b-919e-4bd8-a4b6-073e8f2cbc64 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:04.903455 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d523b-919e-4bd8-a4b6-073e8f2cbc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:04.903728 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d523b-919e-4bd8-a4b6-073e8f2cbc64 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:04.904408 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d523b-919e-4bd8-a4b6-073e8f2cbc64 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:04.905787 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d523b-919e-4bd8-a4b6-073e8f2cbc64 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:04.917673 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 367/745] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:04.918336 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769af6fb-ffd3-45fa-9dc1-f71b88a2e225 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:04.978723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:04.995791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 379/746] 10.222.0.141 () {60 vars in 1146 bytes} [Tue Jul 26 16:05:04 2022] POST /identity/v3/services => generated 241 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:05:04.996934 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d523b-919e-4bd8-a4b6-073e8f2cbc64 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:05.031026 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769af6fb-ffd3-45fa-9dc1-f71b88a2e225 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:05.077675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbe27f-af99-4d17-ae0b-6cb5e889ea2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:05.078313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbe27f-af99-4d17-ae0b-6cb5e889ea2c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:05.078594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbe27f-af99-4d17-ae0b-6cb5e889ea2c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:05.078864 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbe27f-af99-4d17-ae0b-6cb5e889ea2c None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:05.080239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbe27f-af99-4d17-ae0b-6cb5e889ea2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:05.080905 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbe27f-af99-4d17-ae0b-6cb5e889ea2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:05.082315 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbe27f-af99-4d17-ae0b-6cb5e889ea2c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:05.082799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:05.095125 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 368/747] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:05.100511 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbe27f-af99-4d17-ae0b-6cb5e889ea2c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:05.139608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d523b-919e-4bd8-a4b6-073e8f2cbc64 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:05.179568 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e2aa5-b9ca-46a5-8a3f-91ca81e88082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:05.180195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e2aa5-b9ca-46a5-8a3f-91ca81e88082 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:05.180480 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e2aa5-b9ca-46a5-8a3f-91ca81e88082 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:05.180791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e2aa5-b9ca-46a5-8a3f-91ca81e88082 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:05.181952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e2aa5-b9ca-46a5-8a3f-91ca81e88082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:05.181952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e2aa5-b9ca-46a5-8a3f-91ca81e88082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:05.183151 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e2aa5-b9ca-46a5-8a3f-91ca81e88082 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:05.198272 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 380/748] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:05.199699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d47fd-2503-45fc-b0a2-98a8b3a73b5f None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:05.199997 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d47fd-2503-45fc-b0a2-98a8b3a73b5f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:05.200276 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d47fd-2503-45fc-b0a2-98a8b3a73b5f None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:05.201806 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 381/749] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:05.202516 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d47fd-2503-45fc-b0a2-98a8b3a73b5f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:05.215282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbe27f-af99-4d17-ae0b-6cb5e889ea2c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:05.231734 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:05.249515 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f64d32-6f48-4817-aa3c-312930a69e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:05.250155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f64d32-6f48-4817-aa3c-312930a69e8f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:05.250479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f64d32-6f48-4817-aa3c-312930a69e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:05.250757 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f64d32-6f48-4817-aa3c-312930a69e8f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:05.259008 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f64d32-6f48-4817-aa3c-312930a69e8f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:05.260452 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f64d32-6f48-4817-aa3c-312930a69e8f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:05.272955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-78f64d32-6f48-4817-aa3c-312930a69e8f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 16:05:05.272955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:05.272955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:05.272955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:05.272955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:05.272955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:05.272955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:05.272955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:05.272955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:05.272955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:05.272955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:05.272955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:05.272955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:05:05.272955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:05:05.272955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:05:05.272955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:05:05.273909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:05.273909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:05.273909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:05:05.273909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:05.273909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:05:05.273909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:05.273909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:05.273909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:05.273909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:05.273909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:05.273909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:05.273909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:05.273909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:05.273909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:05.273909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:05.273909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:05.273909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:05.273909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:05.274835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:05.274835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:05.274835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:05:05.274835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:05:05.274835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:05:05.274835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:05:05.274835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:05:05.274835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:05:05.274835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 16:05:05.274835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:05.274835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 369/750] 10.222.0.141 () {56 vars in 1122 bytes} [Tue Jul 26 16:05:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:05.274835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f64d32-6f48-4817-aa3c-312930a69e8f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:05.316130 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d47fd-2503-45fc-b0a2-98a8b3a73b5f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:05.330821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:05.353009 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db72c3-99ff-415c-a8ca-54b879bd57a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:05.353655 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db72c3-99ff-415c-a8ca-54b879bd57a1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:05.354275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db72c3-99ff-415c-a8ca-54b879bd57a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:05.354595 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db72c3-99ff-415c-a8ca-54b879bd57a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:05.362269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db72c3-99ff-415c-a8ca-54b879bd57a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:05.363921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db72c3-99ff-415c-a8ca-54b879bd57a1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:05.377040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-59db72c3-99ff-415c-a8ca-54b879bd57a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:05.377040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:05.377040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:05.377040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:05.377040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:05.377040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:05.377040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:05.377040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:05.377040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:05.377040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:05.377040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:05.377040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:05.377040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:05:05.377040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:05:05.377040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:05:05.377946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:05:05.377946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:05.377946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:05.377946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:05.377946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:05.377946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:05.377946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:05.377946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:05.377946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:05.377946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:05.377946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:05.377946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:05.377946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:05.377946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:05.377946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:05.377946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:05.377946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:05.383594 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:05:05.383594 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:05:05.383594 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:05:05.383594 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:05:05.383594 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:05:05.383594 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:05:05.383594 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:05.383594 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:05.384056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f64d32-6f48-4817-aa3c-312930a69e8f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:05.384143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 382/751] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:05.384143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b9cf0-80ec-4737-bd77-d3da8f6f96af None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:05.384143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b9cf0-80ec-4737-bd77-d3da8f6f96af None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:05.384143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b9cf0-80ec-4737-bd77-d3da8f6f96af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:05.398066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-169b9cf0-80ec-4737-bd77-d3da8f6f96af None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:05.399233 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-169b9cf0-80ec-4737-bd77-d3da8f6f96af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:05.418411 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7b394-a204-456e-a277-a65007d60cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:05.419049 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7b394-a204-456e-a277-a65007d60cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:05.419331 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7b394-a204-456e-a277-a65007d60cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:05.419597 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7b394-a204-456e-a277-a65007d60cb7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:05.428261 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7b394-a204-456e-a277-a65007d60cb7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:05.429754 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7b394-a204-456e-a277-a65007d60cb7 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:05.441777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-76b7b394-a204-456e-a277-a65007d60cb7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 16:05:05.441777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:05.441777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:05.441777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:05.441777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:05.441777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:05.441777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:05.441777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:05.441777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:05.441777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:05.441777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:05.441777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:05.441777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:05:05.441777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:05:05.441777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:05:05.441777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:05:05.442700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:05.442700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:05.442700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:05:05.442700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:05.442700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:05:05.442700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:05.442700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:05.442700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:05.442700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:05.442700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:05.442700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:05.442700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:05.442700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:05.442700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:05.442700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:05.442700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:05.442700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:05.442700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:05.443650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:05.443650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:05.443650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:05:05.443650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:05:05.443650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:05:05.443650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:05:05.443650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:05:05.443650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:05:05.443650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 16:05:05.443650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:05.447545 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 370/752] 10.222.0.141 () {56 vars in 1098 bytes} [Tue Jul 26 16:05:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:05.448306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7b394-a204-456e-a277-a65007d60cb7 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:05.476858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 383/753] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:05 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:05.476858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b9cf0-80ec-4737-bd77-d3da8f6f96af None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:05.489586 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:05.555991 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7b394-a204-456e-a277-a65007d60cb7 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:05.585788 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b9cf0-80ec-4737-bd77-d3da8f6f96af None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:05.588424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:05.590047 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73f460-c19e-4e64-bb4c-412eeca88fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:05.590751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73f460-c19e-4e64-bb4c-412eeca88fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:05.591037 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73f460-c19e-4e64-bb4c-412eeca88fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:05.591310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73f460-c19e-4e64-bb4c-412eeca88fc7 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:05.592105 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73f460-c19e-4e64-bb4c-412eeca88fc7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:05.592413 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73f460-c19e-4e64-bb4c-412eeca88fc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:05.593879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73f460-c19e-4e64-bb4c-412eeca88fc7 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:05.612468 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 371/754] 10.222.0.141 () {56 vars in 1154 bytes} [Tue Jul 26 16:05:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:05.613307 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73f460-c19e-4e64-bb4c-412eeca88fc7 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:05.629465 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e0b7a-8387-42bf-9b70-746845619198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:05.630390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e0b7a-8387-42bf-9b70-746845619198 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:05.630921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e0b7a-8387-42bf-9b70-746845619198 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:05.631298 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e0b7a-8387-42bf-9b70-746845619198 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:05.632125 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e0b7a-8387-42bf-9b70-746845619198 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:05.632360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e0b7a-8387-42bf-9b70-746845619198 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:05.633833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e0b7a-8387-42bf-9b70-746845619198 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:05.650757 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 384/755] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:05:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:05.651627 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e0b7a-8387-42bf-9b70-746845619198 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:05.712840 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:05.719740 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73f460-c19e-4e64-bb4c-412eeca88fc7 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:05.757509 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e0b7a-8387-42bf-9b70-746845619198 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:05.759282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1b4d3-ec3e-49fd-b5be-f012ff63ee2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:05.760561 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1b4d3-ec3e-49fd-b5be-f012ff63ee2e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:05.760561 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1b4d3-ec3e-49fd-b5be-f012ff63ee2e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:05.760561 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1b4d3-ec3e-49fd-b5be-f012ff63ee2e None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:05.761253 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1b4d3-ec3e-49fd-b5be-f012ff63ee2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:05.761561 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1b4d3-ec3e-49fd-b5be-f012ff63ee2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:05.763058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1b4d3-ec3e-49fd-b5be-f012ff63ee2e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:05.781421 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 372/756] 10.222.0.141 () {56 vars in 1138 bytes} [Tue Jul 26 16:05:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:05.783019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1b4d3-ec3e-49fd-b5be-f012ff63ee2e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:05.799396 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600193f-8be6-41f4-bee6-6d4d8d904a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:05.800118 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600193f-8be6-41f4-bee6-6d4d8d904a20 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:05.800323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600193f-8be6-41f4-bee6-6d4d8d904a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:05.800585 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600193f-8be6-41f4-bee6-6d4d8d904a20 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:05.801259 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600193f-8be6-41f4-bee6-6d4d8d904a20 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:05.802619 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600193f-8be6-41f4-bee6-6d4d8d904a20 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:05.811918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-b600193f-8be6-41f4-bee6-6d4d8d904a20 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 16:05:05.811918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:05.811918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:05.811918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:05.811918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:05.811918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:05.811918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:05.811918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:05.811918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 16:05:05.811918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:05.811918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:05.811918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:05.811918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:05.811918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:05.811918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:05.811918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:05.812901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:05.812901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:05.812901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:05.812901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:05.812901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:05.812901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:05.812901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:05.812901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:05.812901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:05.812901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:05.812901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:05.812901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:05.812901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:05.812901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:05.812901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:05.812901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:05.814320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:05.814320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:05.814320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:05.814320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:05.814320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:05.814320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:05.814320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:05.814320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:05.814320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:05.814320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:05.814320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:05.814320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:05.814320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:05.814320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 16:05:05.814320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:05.814320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 385/757] 10.222.0.141 () {56 vars in 1134 bytes} [Tue Jul 26 16:05:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:05.819204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600193f-8be6-41f4-bee6-6d4d8d904a20 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:05.850242 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:05.896079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1b4d3-ec3e-49fd-b5be-f012ff63ee2e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:05.928372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600193f-8be6-41f4-bee6-6d4d8d904a20 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:05.940818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35765b8-e966-46ef-ad38-4f6b2b288ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:05.941439 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35765b8-e966-46ef-ad38-4f6b2b288ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:05.941724 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35765b8-e966-46ef-ad38-4f6b2b288ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:05.942000 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35765b8-e966-46ef-ad38-4f6b2b288ea5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:05.964197 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b420b9-d7cc-4709-9eac-98380ddf3200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:05.964853 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b420b9-d7cc-4709-9eac-98380ddf3200 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:05.965134 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b420b9-d7cc-4709-9eac-98380ddf3200 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:05.965408 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b420b9-d7cc-4709-9eac-98380ddf3200 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:05.965508 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:05.966195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b420b9-d7cc-4709-9eac-98380ddf3200 None admin] RBAC: Adding query filter params (role.id=94ecbd6c86a84b75bdb0c57fc27a9a07, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=6c5f92f21868436a99a5c7aaa1fc40b5) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:05.966507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b420b9-d7cc-4709-9eac-98380ddf3200 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:05.967942 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b420b9-d7cc-4709-9eac-98380ddf3200 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:05.975544 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 386/758] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:05:05 2022] GET /identity/v3/role_assignments?user.id=6c5f92f21868436a99a5c7aaa1fc40b5&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:05.975544 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b420b9-d7cc-4709-9eac-98380ddf3200 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:06.041001 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35765b8-e966-46ef-ad38-4f6b2b288ea5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:06.042426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35765b8-e966-46ef-ad38-4f6b2b288ea5 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:06.088646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:06.098451 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b420b9-d7cc-4709-9eac-98380ddf3200 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:06.140520 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cb206-7fa9-4d46-9820-993adcae4000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:06.141474 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cb206-7fa9-4d46-9820-993adcae4000 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:06.142460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cb206-7fa9-4d46-9820-993adcae4000 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:06.142905 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cb206-7fa9-4d46-9820-993adcae4000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:06.158713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cb206-7fa9-4d46-9820-993adcae4000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:06.160514 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cb206-7fa9-4d46-9820-993adcae4000 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:06.169998 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 373/759] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:05:05 2022] GET /identity/v3/auth/tokens => generated 1003 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 16:05:06.170961 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35765b8-e966-46ef-ad38-4f6b2b288ea5 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:06.178452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-185cb206-7fa9-4d46-9820-993adcae4000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:06.178452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:06.178452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:06.178452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:06.178452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:06.178452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:06.178452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:06.178452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:06.178452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:06.178452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:06.178452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:06.178452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:06.178452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:06.178452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:06.178452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:06.179354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:06.179354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:06.179354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:06.179354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:06.179354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:06.179354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:06.179354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:06.179354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:06.179354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:06.179354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:06.179354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:06.179354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:06.179354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:06.179354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:06.179354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:06.179354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:06.179354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:06.180223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:06.180223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:06.180223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:06.180223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:06.182142 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 387/760] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:06.183143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cb206-7fa9-4d46-9820-993adcae4000 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:06.230003 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:06.285625 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35765b8-e966-46ef-ad38-4f6b2b288ea5 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:06.314689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cb206-7fa9-4d46-9820-993adcae4000 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:06.322006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378ece4-21d4-4e9b-a04e-954479e561c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:06.322883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378ece4-21d4-4e9b-a04e-954479e561c7 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:06.323276 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378ece4-21d4-4e9b-a04e-954479e561c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:06.323650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378ece4-21d4-4e9b-a04e-954479e561c7 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:06.324423 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378ece4-21d4-4e9b-a04e-954479e561c7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:06.324880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378ece4-21d4-4e9b-a04e-954479e561c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:06.326338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378ece4-21d4-4e9b-a04e-954479e561c7 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:06.336751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 374/761] 10.222.0.141 () {56 vars in 1129 bytes} [Tue Jul 26 16:05:06 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:06.337733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378ece4-21d4-4e9b-a04e-954479e561c7 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:06.358778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c310b5d-a2f4-4397-b4cc-48da8e1cbec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:06.359995 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c310b5d-a2f4-4397-b4cc-48da8e1cbec0 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:06.360447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c310b5d-a2f4-4397-b4cc-48da8e1cbec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:06.360921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c310b5d-a2f4-4397-b4cc-48da8e1cbec0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:06.376841 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c310b5d-a2f4-4397-b4cc-48da8e1cbec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:06.378521 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c310b5d-a2f4-4397-b4cc-48da8e1cbec0 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:06.381875 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:06.399417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-3c310b5d-a2f4-4397-b4cc-48da8e1cbec0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:06.399417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:06.399417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:06.399417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:06.399417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:06.399417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:06.399417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:06.399417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:06.399417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:06.399417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:06.399417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:06.399417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:06.399417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:06.399417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:06.399417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:06.400492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:06.400492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:06.400492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:06.400492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:06.400492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:06.400492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:06.400492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:06.400492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:06.400492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:06.400492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:06.400492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:06.400492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:06.400492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:06.400492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:06.400492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:06.400492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:06.400492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:06.401629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:06.401629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:06.401629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:06.401629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:06.403510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 388/762] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:06.405267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c310b5d-a2f4-4397-b4cc-48da8e1cbec0 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:06.457196 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378ece4-21d4-4e9b-a04e-954479e561c7 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:06.476306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:06.503323 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44017dc2-a713-490c-a60a-a078b1efae95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:06.504129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44017dc2-a713-490c-a60a-a078b1efae95 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:06.504522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44017dc2-a713-490c-a60a-a078b1efae95 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:06.504969 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44017dc2-a713-490c-a60a-a078b1efae95 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:06.505769 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44017dc2-a713-490c-a60a-a078b1efae95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:06.506263 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44017dc2-a713-490c-a60a-a078b1efae95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:06.508414 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44017dc2-a713-490c-a60a-a078b1efae95 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:06.526182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 375/763] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:06.527548 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44017dc2-a713-490c-a60a-a078b1efae95 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:06.533414 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c310b5d-a2f4-4397-b4cc-48da8e1cbec0 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:06.571225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd427fa-9b85-4e67-b1cb-72909632f1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:06.572102 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd427fa-9b85-4e67-b1cb-72909632f1bf None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:06.572537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd427fa-9b85-4e67-b1cb-72909632f1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:06.572986 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd427fa-9b85-4e67-b1cb-72909632f1bf None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:06.573834 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd427fa-9b85-4e67-b1cb-72909632f1bf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:06.574288 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd427fa-9b85-4e67-b1cb-72909632f1bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:06.575798 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd427fa-9b85-4e67-b1cb-72909632f1bf None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:06.583666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 389/764] 10.222.0.141 () {56 vars in 1129 bytes} [Tue Jul 26 16:05:06 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:06.584793 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd427fa-9b85-4e67-b1cb-72909632f1bf None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:06.658028 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44017dc2-a713-490c-a60a-a078b1efae95 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:06.673317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:06.706440 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6dd597-c178-4459-adff-0e333a592d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:06.707263 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dd597-c178-4459-adff-0e333a592d81 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:06.707804 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dd597-c178-4459-adff-0e333a592d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:06.708184 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dd597-c178-4459-adff-0e333a592d81 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:06.709329 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6dd597-c178-4459-adff-0e333a592d81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:06.710013 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6dd597-c178-4459-adff-0e333a592d81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:06.711665 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6dd597-c178-4459-adff-0e333a592d81 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:06.714911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd427fa-9b85-4e67-b1cb-72909632f1bf None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:06.726170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 376/765] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:06.727474 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6dd597-c178-4459-adff-0e333a592d81 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:06.752538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a84bed-dc17-4d7a-9a94-45a65601d00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:06.753583 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a84bed-dc17-4d7a-9a94-45a65601d00d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:06.754099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a84bed-dc17-4d7a-9a94-45a65601d00d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:06.755014 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a84bed-dc17-4d7a-9a94-45a65601d00d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:06.767360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a84bed-dc17-4d7a-9a94-45a65601d00d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:06.769243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a84bed-dc17-4d7a-9a94-45a65601d00d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:06.770406 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:06.782587 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-c9a84bed-dc17-4d7a-9a94-45a65601d00d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:06.782587 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:06.782587 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:06.782587 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:06.782587 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:06.782587 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:06.782587 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:06.782587 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:06.782587 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:06.782587 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:06.782587 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:06.782587 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:06.782587 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:05:06.782587 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:05:06.782587 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:05:06.783505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:05:06.783505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:06.783505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:06.783505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:06.783505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:06.783505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:06.783505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:06.783505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:06.783505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:06.783505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:06.783505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:06.783505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:06.783505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:06.783505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:06.783505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:06.783505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:06.783505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:06.784390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:05:06.784390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:05:06.784390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:05:06.784390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:05:06.784390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:05:06.784390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:05:06.784390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:06.784390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:06.791374 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 390/766] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:06.792546 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a84bed-dc17-4d7a-9a94-45a65601d00d None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:06.853015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6dd597-c178-4459-adff-0e333a592d81 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:06.897711 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fae66-5040-4b05-bb31-43b1a4559601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:06.898324 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fae66-5040-4b05-bb31-43b1a4559601 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:06.898607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fae66-5040-4b05-bb31-43b1a4559601 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:06.898886 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fae66-5040-4b05-bb31-43b1a4559601 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:06.899804 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fae66-5040-4b05-bb31-43b1a4559601 None admin] RBAC: Adding query filter params (interface=public, service_id=750a9845772b4c03ad8179700f637bef, region_id=RegionOne) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:06.900119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fae66-5040-4b05-bb31-43b1a4559601 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:06.902123 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fae66-5040-4b05-bb31-43b1a4559601 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:06.903788 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a84bed-dc17-4d7a-9a94-45a65601d00d None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:06.911411 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 377/767] 10.222.0.141 () {56 vars in 1256 bytes} [Tue Jul 26 16:05:06 2022] GET /identity/v3/endpoints?service_id=750a9845772b4c03ad8179700f637bef&interface=public®ion_id=RegionOne => generated 195 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:06.915052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fae66-5040-4b05-bb31-43b1a4559601 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:06.930073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:06.949857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c59eda-25db-43fe-b6b7-c43ec7bf5791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:06.950774 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c59eda-25db-43fe-b6b7-c43ec7bf5791 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:06.951268 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c59eda-25db-43fe-b6b7-c43ec7bf5791 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:06.951706 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c59eda-25db-43fe-b6b7-c43ec7bf5791 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:06.959058 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c59eda-25db-43fe-b6b7-c43ec7bf5791 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:06.960797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c59eda-25db-43fe-b6b7-c43ec7bf5791 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:06.973660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-43c59eda-25db-43fe-b6b7-c43ec7bf5791 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:06.973660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:06.973660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:06.973660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:06.973660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:06.973660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:06.973660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:06.973660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:06.973660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:06.973660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:06.973660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:06.973660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:06.973660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:05:06.973660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:05:06.973660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:05:06.974533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:05:06.974533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:06.974533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:06.974533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:06.974533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:06.974533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:06.974533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:06.974533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:06.974533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:06.974533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:06.974533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:06.974533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:06.974533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:06.974533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:06.974533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:06.974533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:06.974533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:06.975467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:05:06.975467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:05:06.975467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:05:06.975467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:05:06.975467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:05:06.975467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:05:06.975467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:06.975467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:06.977936 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 391/768] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:06.978978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c59eda-25db-43fe-b6b7-c43ec7bf5791 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:07.041297 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:07.045833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fae66-5040-4b05-bb31-43b1a4559601 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:07.087739 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c59eda-25db-43fe-b6b7-c43ec7bf5791 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:07.092997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5f060-a873-4965-adda-56ea9151524a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:07.092997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5f060-a873-4965-adda-56ea9151524a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:07.092997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5f060-a873-4965-adda-56ea9151524a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:07.092997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5f060-a873-4965-adda-56ea9151524a None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:07.093460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5f060-a873-4965-adda-56ea9151524a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:07.093460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5f060-a873-4965-adda-56ea9151524a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:07.093460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5f060-a873-4965-adda-56ea9151524a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:07.105704 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 378/769] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:05:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:07.106765 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5f060-a873-4965-adda-56ea9151524a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:07.131565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3d40c-43f1-4a0b-9f7e-1f6f3598c0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:07.132488 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3d40c-43f1-4a0b-9f7e-1f6f3598c0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:07.132885 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3d40c-43f1-4a0b-9f7e-1f6f3598c0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:07.133166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3d40c-43f1-4a0b-9f7e-1f6f3598c0e9 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:07.133819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3d40c-43f1-4a0b-9f7e-1f6f3598c0e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:07.135269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3d40c-43f1-4a0b-9f7e-1f6f3598c0e9 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:07.141122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 392/770] 10.222.0.141 () {56 vars in 1092 bytes} [Tue Jul 26 16:05:06 2022] GET /identity/v3/services => generated 776 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:07.142117 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9423a96-09a1-40a7-8031-756d429e1a4f None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:07.142491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9423a96-09a1-40a7-8031-756d429e1a4f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:07.142952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9423a96-09a1-40a7-8031-756d429e1a4f None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:07.147876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 393/771] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:07.147876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9423a96-09a1-40a7-8031-756d429e1a4f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:07.209020 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:07.250315 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5f060-a873-4965-adda-56ea9151524a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:07.288644 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da201ff-3943-441d-9d11-897321e05415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:07.289381 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da201ff-3943-441d-9d11-897321e05415 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:07.289592 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da201ff-3943-441d-9d11-897321e05415 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:07.289860 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da201ff-3943-441d-9d11-897321e05415 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:07.290624 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da201ff-3943-441d-9d11-897321e05415 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:07.290933 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da201ff-3943-441d-9d11-897321e05415 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:07.292381 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da201ff-3943-441d-9d11-897321e05415 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:07.293680 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9423a96-09a1-40a7-8031-756d429e1a4f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:07.307270 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 379/772] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:05:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:07.310010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d466a2-5b2c-4b85-b02e-e97f6ca77d91 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:07.310301 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d466a2-5b2c-4b85-b02e-e97f6ca77d91 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:07.310578 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d466a2-5b2c-4b85-b02e-e97f6ca77d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:07.332354 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-49d466a2-5b2c-4b85-b02e-e97f6ca77d91 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:07.333833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-49d466a2-5b2c-4b85-b02e-e97f6ca77d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:07.341457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9931c6-313e-4bba-9569-b9013be0bc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:07.342287 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9931c6-313e-4bba-9569-b9013be0bc71 None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:07.342576 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9931c6-313e-4bba-9569-b9013be0bc71 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:07.342903 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9931c6-313e-4bba-9569-b9013be0bc71 None admin] PATH_INFO: `/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/f7eac931cabf4921b6dbd42f63b9300f/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:07.345790 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9931c6-313e-4bba-9569-b9013be0bc71 None admin] RBAC: Authorizing `identity:create_grant(project_id=3747e176cdf2495d9b31a1afae618f68, user_id=f7eac931cabf4921b6dbd42f63b9300f, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:07.347275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9931c6-313e-4bba-9569-b9013be0bc71 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:07.349298 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:07.408686 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 380/773] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:07 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:07.408686 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d466a2-5b2c-4b85-b02e-e97f6ca77d91 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:07.455781 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 394/774] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:05:07 2022] PUT /identity/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/f7eac931cabf4921b6dbd42f63b9300f/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:05:07.456981 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9931c6-313e-4bba-9569-b9013be0bc71 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:07.610915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d466a2-5b2c-4b85-b02e-e97f6ca77d91 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:07.659214 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0d432-d7c9-4b2c-aa10-3d689b274406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:07.660095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0d432-d7c9-4b2c-aa10-3d689b274406 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:07.660377 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0d432-d7c9-4b2c-aa10-3d689b274406 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:07.660649 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0d432-d7c9-4b2c-aa10-3d689b274406 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:07.661470 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0d432-d7c9-4b2c-aa10-3d689b274406 None admin] RBAC: Adding query filter params (role.id=6540af5baf2c4ff78d0fedfc4bea4e46, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=02af03095e48472d96a995a530e78035) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:07.661781 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0d432-d7c9-4b2c-aa10-3d689b274406 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:07.663179 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9931c6-313e-4bba-9569-b9013be0bc71 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:07.663287 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0d432-d7c9-4b2c-aa10-3d689b274406 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:07.668167 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:07.670488 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 381/775] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:05:07 2022] GET /identity/v3/role_assignments?user.id=02af03095e48472d96a995a530e78035&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=6540af5baf2c4ff78d0fedfc4bea4e46 => generated 260 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:07.708425 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31983749-8862-45b9-8174-ff0947dbce85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:07.709144 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31983749-8862-45b9-8174-ff0947dbce85 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:07.709465 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31983749-8862-45b9-8174-ff0947dbce85 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:07.709748 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31983749-8862-45b9-8174-ff0947dbce85 None admin] PATH_INFO: `/v3/services/network` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:07.710394 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31983749-8862-45b9-8174-ff0947dbce85 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:07.711980 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31983749-8862-45b9-8174-ff0947dbce85 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:07.722065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-31983749-8862-45b9-8174-ff0947dbce85 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 16:05:07.722065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:07.722065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:07.722065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:07.722065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:07.722065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:07.722065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:07.722065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:07.722065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 16:05:07.722065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:07.722065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:07.722065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:07.722065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:07.722065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:07.722065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:07.722065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:07.722065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:07.723040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:07.723040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:07.723040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:07.723040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:07.723040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:07.723040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:07.723040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:07.723040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:07.723040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:07.723040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:07.723040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:07.723040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:07.723040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:07.723040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:07.723040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:07.723040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:07.723850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:07.723850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:07.723850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:07.723850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:07.723850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:07.723850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:07.723850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:07.723850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:07.723850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:07.723850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:07.723850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:07.723850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:07.723850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 16:05:07.723850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:07.723850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 395/776] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:07 2022] GET /identity/v3/services/network => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:07.729437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0d432-d7c9-4b2c-aa10-3d689b274406 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:07.748412 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:07.842011 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0d432-d7c9-4b2c-aa10-3d689b274406 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:07.879398 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481d7b7-db0b-4cc1-b137-dedfa54dce12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:07.880024 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481d7b7-db0b-4cc1-b137-dedfa54dce12 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:07.880309 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481d7b7-db0b-4cc1-b137-dedfa54dce12 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:07.880586 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481d7b7-db0b-4cc1-b137-dedfa54dce12 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:07.881301 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481d7b7-db0b-4cc1-b137-dedfa54dce12 None admin] RBAC: Adding query filter params (name=network) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:07.881609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481d7b7-db0b-4cc1-b137-dedfa54dce12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:07.883005 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481d7b7-db0b-4cc1-b137-dedfa54dce12 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:07.888676 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 382/777] 10.222.0.141 () {56 vars in 1117 bytes} [Tue Jul 26 16:05:07 2022] GET /identity/v3/services?name=network => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:07.894006 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31983749-8862-45b9-8174-ff0947dbce85 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:08.020056 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31983749-8862-45b9-8174-ff0947dbce85 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:08.060852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59db8c-beed-4749-8d2b-ac8fff5517ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:08.061478 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59db8c-beed-4749-8d2b-ac8fff5517ba None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:08.061763 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59db8c-beed-4749-8d2b-ac8fff5517ba None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:08.062039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59db8c-beed-4749-8d2b-ac8fff5517ba None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:08.062716 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59db8c-beed-4749-8d2b-ac8fff5517ba None admin] RBAC: Adding query filter params (type=network) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:08.063021 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59db8c-beed-4749-8d2b-ac8fff5517ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:08.064469 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59db8c-beed-4749-8d2b-ac8fff5517ba None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:08.072563 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 396/778] 10.222.0.141 () {56 vars in 1117 bytes} [Tue Jul 26 16:05:07 2022] GET /identity/v3/services?type=network => generated 352 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:08.078429 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481d7b7-db0b-4cc1-b137-dedfa54dce12 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:08.158010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351bf14-811e-4a07-880b-9da58a7aeb06 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:08.158639 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351bf14-811e-4a07-880b-9da58a7aeb06 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:08.159301 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351bf14-811e-4a07-880b-9da58a7aeb06 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:08.161221 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 397/779] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:08 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:05:08.166614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920d79e-07ab-4751-aabc-2b0f61a3380d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:08.167146 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920d79e-07ab-4751-aabc-2b0f61a3380d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:08.167635 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920d79e-07ab-4751-aabc-2b0f61a3380d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:08.170914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:08.188296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-b920d79e-07ab-4751-aabc-2b0f61a3380d None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:08.189889 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b920d79e-07ab-4751-aabc-2b0f61a3380d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:08.193979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481d7b7-db0b-4cc1-b137-dedfa54dce12 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:08.223643 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:08.269303 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdb3c9-9cbf-40ee-a792-7d176f544237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:08.269782 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdb3c9-9cbf-40ee-a792-7d176f544237 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:08.270071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdb3c9-9cbf-40ee-a792-7d176f544237 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:08.270348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdb3c9-9cbf-40ee-a792-7d176f544237 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:08.271152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdb3c9-9cbf-40ee-a792-7d176f544237 None admin] RBAC: Adding query filter params (interface=public, service_id=24ba0d6c75b3460d81d3937c904b6eae, region_id=RegionOne) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:08.271425 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdb3c9-9cbf-40ee-a792-7d176f544237 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:08.272827 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdb3c9-9cbf-40ee-a792-7d176f544237 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:08.275963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 398/780] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:08 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 16:05:08.284337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 383/781] 10.222.0.141 () {56 vars in 1256 bytes} [Tue Jul 26 16:05:08 2022] GET /identity/v3/endpoints?service_id=24ba0d6c75b3460d81d3937c904b6eae&interface=public®ion_id=RegionOne => generated 195 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:08.288687 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920d79e-07ab-4751-aabc-2b0f61a3380d None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:08.326930 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdb3c9-9cbf-40ee-a792-7d176f544237 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:08.463122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920d79e-07ab-4751-aabc-2b0f61a3380d None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:08.487996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdb3c9-9cbf-40ee-a792-7d176f544237 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:08.522839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa8f6b-d955-4e2f-b19d-fd4dcb05fe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:08.523487 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa8f6b-d955-4e2f-b19d-fd4dcb05fe17 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:08.523770 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa8f6b-d955-4e2f-b19d-fd4dcb05fe17 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:08.524043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa8f6b-d955-4e2f-b19d-fd4dcb05fe17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:08.534348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa8f6b-d955-4e2f-b19d-fd4dcb05fe17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:05:08.540444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-c3fa8f6b-d955-4e2f-b19d-fd4dcb05fe17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:05:08.540444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:08.540444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:08.540444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:08.540444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:08.540444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:08.540444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:08.540444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:08.540444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:08.540444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:08.540444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:08.540444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:08.540444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:05:08.540444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:05:08.540444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:05:08.540444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:05:08.541345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:05:08.541345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:05:08.541345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:05:08.541345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:05:08.541345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:08.541345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:08.541345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:08.541345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:08.541345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:08.541345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:08.541345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:08.541345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:08.541345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:08.541345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:08.541345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:08.541345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:08.542154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:08.542154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:08.542154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:08.542154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:08.542154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:05:08.542154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:05:08.542154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:05:08.542154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:05:08.542154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:05:08.542154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:05:08.542154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:05:08.542154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:08.542154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 384/782] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:05:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:08.550683 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa8f6b-d955-4e2f-b19d-fd4dcb05fe17 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:08.559749 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:08.560308 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd80f2-46ff-4912-a6b8-869ee4d0c82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:08.560979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd80f2-46ff-4912-a6b8-869ee4d0c82b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:08.561250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd80f2-46ff-4912-a6b8-869ee4d0c82b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:08.561524 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd80f2-46ff-4912-a6b8-869ee4d0c82b None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:08.562182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd80f2-46ff-4912-a6b8-869ee4d0c82b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:08.564179 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd80f2-46ff-4912-a6b8-869ee4d0c82b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:08.577676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 399/783] 10.222.0.141 () {56 vars in 1092 bytes} [Tue Jul 26 16:05:08 2022] GET /identity/v3/services => generated 776 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:08.677728 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa8f6b-d955-4e2f-b19d-fd4dcb05fe17 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:08.715997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb3252-fb3d-405e-b10e-90a93d334620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:08.716546 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb3252-fb3d-405e-b10e-90a93d334620 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:08.716859 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb3252-fb3d-405e-b10e-90a93d334620 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:08.717138 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb3252-fb3d-405e-b10e-90a93d334620 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:08.717862 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb3252-fb3d-405e-b10e-90a93d334620 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:08.718170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb3252-fb3d-405e-b10e-90a93d334620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:08.719573 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb3252-fb3d-405e-b10e-90a93d334620 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:08.729875 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 385/784] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:05:08 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:08.737813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd80f2-46ff-4912-a6b8-869ee4d0c82b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:08.781649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:08.871063 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd80f2-46ff-4912-a6b8-869ee4d0c82b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:08.907063 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96550d2-14c6-4062-987d-22dc1c4fcca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:08.908272 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96550d2-14c6-4062-987d-22dc1c4fcca8 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:08.908556 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96550d2-14c6-4062-987d-22dc1c4fcca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:08.908874 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96550d2-14c6-4062-987d-22dc1c4fcca8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:08.923406 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96550d2-14c6-4062-987d-22dc1c4fcca8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:08.924843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96550d2-14c6-4062-987d-22dc1c4fcca8 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:08.940572 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-a96550d2-14c6-4062-987d-22dc1c4fcca8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:08.940572 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:08.940572 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:08.940572 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:08.940572 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:08.940572 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:08.940572 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:08.940572 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:08.940572 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:08.940572 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:08.940572 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:08.940572 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:08.940572 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:08.940572 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:08.940572 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:08.941440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:08.941440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:08.941440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:08.941440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:08.941440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:08.941440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:08.941440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:08.941440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:08.941440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:08.941440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:08.941440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:08.941440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:08.941440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:08.941440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:08.941440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:08.941440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:08.941440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:08.942305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:08.942305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:08.942305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:08.942305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:08.942305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 400/785] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:08.947408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb3252-fb3d-405e-b10e-90a93d334620 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:09.015106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:09.057569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb3252-fb3d-405e-b10e-90a93d334620 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:09.105419 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1904d4b-daaf-4c2b-b27f-9d143eb072ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:09.106048 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1904d4b-daaf-4c2b-b27f-9d143eb072ee None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:09.106332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1904d4b-daaf-4c2b-b27f-9d143eb072ee None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:09.106607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1904d4b-daaf-4c2b-b27f-9d143eb072ee None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:09.107298 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1904d4b-daaf-4c2b-b27f-9d143eb072ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:09.107603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1904d4b-daaf-4c2b-b27f-9d143eb072ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:09.108994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1904d4b-daaf-4c2b-b27f-9d143eb072ee None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:09.123785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 386/786] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:09.128941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96550d2-14c6-4062-987d-22dc1c4fcca8 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:09.238431 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:09.272060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96550d2-14c6-4062-987d-22dc1c4fcca8 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:09.311917 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26842f-7e62-4124-8c87-8a6d87fe8ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:09.312581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26842f-7e62-4124-8c87-8a6d87fe8ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:09.312901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26842f-7e62-4124-8c87-8a6d87fe8ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:09.313183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26842f-7e62-4124-8c87-8a6d87fe8ee9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:09.321961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26842f-7e62-4124-8c87-8a6d87fe8ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:09.323420 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26842f-7e62-4124-8c87-8a6d87fe8ee9 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:09.335941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-3b26842f-7e62-4124-8c87-8a6d87fe8ee9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 16:05:09.335941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:09.335941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:09.335941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:09.335941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:09.335941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:09.335941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:09.335941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:09.335941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:09.335941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:09.335941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:09.335941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:09.335941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:05:09.335941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:05:09.335941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:05:09.335941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:05:09.336911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:09.336911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:09.336911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:05:09.336911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:09.336911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:05:09.336911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:09.336911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:09.336911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:09.336911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:09.336911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:09.336911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:09.336911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:09.336911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:09.336911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:09.336911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:09.336911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:09.336911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:09.336911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:09.337848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:09.337848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:09.337848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:05:09.337848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:05:09.337848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:05:09.337848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:05:09.337848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:05:09.337848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:05:09.337848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 16:05:09.337848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:09.337848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 401/787] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:05:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:09.346246 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1904d4b-daaf-4c2b-b27f-9d143eb072ee None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:09.492605 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1904d4b-daaf-4c2b-b27f-9d143eb072ee None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:09.524248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:09.541352 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24615a83-71be-46cd-8579-ac4c2d9ad535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:09.541969 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24615a83-71be-46cd-8579-ac4c2d9ad535 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:09.542248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24615a83-71be-46cd-8579-ac4c2d9ad535 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:09.542518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24615a83-71be-46cd-8579-ac4c2d9ad535 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:09.543344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24615a83-71be-46cd-8579-ac4c2d9ad535 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:09.549984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24615a83-71be-46cd-8579-ac4c2d9ad535 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:09.549984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24615a83-71be-46cd-8579-ac4c2d9ad535 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:09.572248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 387/788] 10.222.0.141 () {56 vars in 1140 bytes} [Tue Jul 26 16:05:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:09.574869 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f67017-5228-4a48-8ec1-d33cf61fc4a2 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:09.575699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f67017-5228-4a48-8ec1-d33cf61fc4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:09.576195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f67017-5228-4a48-8ec1-d33cf61fc4a2 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:09.577593 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24615a83-71be-46cd-8579-ac4c2d9ad535 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:09.578242 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 402/789] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:09.585013 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec07e6-4a7e-4e00-8a57-dee10848fa2f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:09.585549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec07e6-4a7e-4e00-8a57-dee10848fa2f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:09.586047 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec07e6-4a7e-4e00-8a57-dee10848fa2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:09.609200 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-daec07e6-4a7e-4e00-8a57-dee10848fa2f None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:09.610330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-daec07e6-4a7e-4e00-8a57-dee10848fa2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:09.702950 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24615a83-71be-46cd-8579-ac4c2d9ad535 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:09.742051 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 403/790] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:09 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:09.742609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55667ae-3fe2-41c6-9ac4-dde8f86c3a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:09.743296 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55667ae-3fe2-41c6-9ac4-dde8f86c3a67 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:09.743612 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55667ae-3fe2-41c6-9ac4-dde8f86c3a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:09.743848 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55667ae-3fe2-41c6-9ac4-dde8f86c3a67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:09.755062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55667ae-3fe2-41c6-9ac4-dde8f86c3a67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:09.756564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55667ae-3fe2-41c6-9ac4-dde8f86c3a67 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:09.772054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-e55667ae-3fe2-41c6-9ac4-dde8f86c3a67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:09.772054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:09.772054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:09.772054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:09.772054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:09.772054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:09.772054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:09.772054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:09.772054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:09.772054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:09.772054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:09.772054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:09.772054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:09.772054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:09.772054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:09.772995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:09.772995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:09.772995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:09.772995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:09.772995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:09.772995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:09.772995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:09.772995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:09.772995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:09.772995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:09.772995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:09.772995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:09.772995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:09.772995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:09.772995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:09.772995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:09.772995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:09.773878 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:09.773878 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:09.773878 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:09.773878 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:09.773878 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 388/791] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:09.779176 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec07e6-4a7e-4e00-8a57-dee10848fa2f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:09.782145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55667ae-3fe2-41c6-9ac4-dde8f86c3a67 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:09.847402 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:09.909029 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:09.916388 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55667ae-3fe2-41c6-9ac4-dde8f86c3a67 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:09.946063 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec07e6-4a7e-4e00-8a57-dee10848fa2f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:09.952902 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d012a-6969-438e-884d-944245f3d91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:09.953544 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d012a-6969-438e-884d-944245f3d91c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:09.953826 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d012a-6969-438e-884d-944245f3d91c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:09.954632 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d012a-6969-438e-884d-944245f3d91c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:09.955255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d012a-6969-438e-884d-944245f3d91c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:09.956617 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d012a-6969-438e-884d-944245f3d91c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:09.967884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-8d4d012a-6969-438e-884d-944245f3d91c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 16:05:09.967884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:09.967884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:09.967884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:09.967884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:09.967884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:09.967884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:09.967884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:09.967884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 16:05:09.967884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:09.967884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:09.967884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:09.967884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:09.967884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:09.967884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:09.967884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:09.968854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:09.968854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:09.968854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:09.968854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:09.968854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:09.968854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:09.968854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:09.968854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:09.968854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:09.968854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:09.968854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:09.968854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:09.968854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:09.968854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:09.968854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:09.968854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:09.970332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:09.970332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:09.970332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:09.970332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:09.970332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:09.970332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:09.970332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:09.970332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:09.970332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:09.970332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:09.970332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:09.970332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:09.970332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:09.970332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 16:05:09.970332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:09.970332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 389/792] 10.222.0.141 () {56 vars in 1134 bytes} [Tue Jul 26 16:05:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:09.979380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d012a-6969-438e-884d-944245f3d91c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:09.993863 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060d4be-875c-4061-888c-48ca4a95fe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:09.994498 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060d4be-875c-4061-888c-48ca4a95fe40 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:09.994778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060d4be-875c-4061-888c-48ca4a95fe40 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:09.995053 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060d4be-875c-4061-888c-48ca4a95fe40 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:09.995750 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060d4be-875c-4061-888c-48ca4a95fe40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:09.996056 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060d4be-875c-4061-888c-48ca4a95fe40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:09.997448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060d4be-875c-4061-888c-48ca4a95fe40 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:10.016343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 404/793] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:10.022356 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060d4be-875c-4061-888c-48ca4a95fe40 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:10.143749 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:10.151351 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060d4be-875c-4061-888c-48ca4a95fe40 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:10.152616 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d012a-6969-438e-884d-944245f3d91c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:10.181640 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:10.190638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc60b0d-976d-4f94-a336-30f1b909244e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:10.191546 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc60b0d-976d-4f94-a336-30f1b909244e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:10.192097 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc60b0d-976d-4f94-a336-30f1b909244e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:10.192579 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc60b0d-976d-4f94-a336-30f1b909244e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:10.199807 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc60b0d-976d-4f94-a336-30f1b909244e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:10.200479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3bcc2-e48e-412e-91cc-00f2fc0e1615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:10.201126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3bcc2-e48e-412e-91cc-00f2fc0e1615 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:10.201404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3bcc2-e48e-412e-91cc-00f2fc0e1615 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:10.201673 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3bcc2-e48e-412e-91cc-00f2fc0e1615 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:10.202340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3bcc2-e48e-412e-91cc-00f2fc0e1615 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:10.202639 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3bcc2-e48e-412e-91cc-00f2fc0e1615 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:10.202884 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc60b0d-976d-4f94-a336-30f1b909244e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:10.204970 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3bcc2-e48e-412e-91cc-00f2fc0e1615 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:10.210201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 390/794] 10.222.0.141 () {56 vars in 1129 bytes} [Tue Jul 26 16:05:09 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:10.211452 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173400c-db5c-4d71-89a4-e5dacefd9875 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:10.211734 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173400c-db5c-4d71-89a4-e5dacefd9875 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:10.212006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173400c-db5c-4d71-89a4-e5dacefd9875 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:10.217991 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 391/795] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:10.219159 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173400c-db5c-4d71-89a4-e5dacefd9875 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:10.219523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-cdc60b0d-976d-4f94-a336-30f1b909244e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:10.219523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:10.219523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:10.219523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:10.219523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:10.219523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:10.219523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:10.219523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:10.219523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:10.219523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:10.219523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:10.219523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:10.219523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:05:10.219523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:05:10.219523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:05:10.220390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:05:10.220390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:10.220390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:10.220390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:10.220390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:10.220390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:10.220390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:10.220390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:10.220390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:10.220390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:10.220390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:10.220390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:10.220390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:10.220390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:10.220390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:10.220390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:10.220390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:10.221309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:05:10.221309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:05:10.221309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:05:10.221309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:05:10.221309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:05:10.221309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:05:10.221309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:10.221309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:10.228184 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 405/796] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:10.229780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13a9e9-69e8-4403-b612-3c36c2d33939 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:10.230343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13a9e9-69e8-4403-b612-3c36c2d33939 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:10.230834 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13a9e9-69e8-4403-b612-3c36c2d33939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:10.250420 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-3a13a9e9-69e8-4403-b612-3c36c2d33939 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:10.252610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3a13a9e9-69e8-4403-b612-3c36c2d33939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:10.332745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 406/797] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:10 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:10.333956 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13a9e9-69e8-4403-b612-3c36c2d33939 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:10.355094 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173400c-db5c-4d71-89a4-e5dacefd9875 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:10.395215 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c731425-d74d-4669-a6e8-b35ed3a8692d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:10.396138 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c731425-d74d-4669-a6e8-b35ed3a8692d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:10.396423 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c731425-d74d-4669-a6e8-b35ed3a8692d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:10.396745 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c731425-d74d-4669-a6e8-b35ed3a8692d None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:10.397721 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c731425-d74d-4669-a6e8-b35ed3a8692d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:10.397836 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c731425-d74d-4669-a6e8-b35ed3a8692d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:10.399104 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c731425-d74d-4669-a6e8-b35ed3a8692d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:10.405073 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 392/798] 10.222.0.141 () {56 vars in 1129 bytes} [Tue Jul 26 16:05:10 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:10.405776 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c731425-d74d-4669-a6e8-b35ed3a8692d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:10.436403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:10.455476 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13a9e9-69e8-4403-b612-3c36c2d33939 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:10.473862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:10.494396 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be0ca2-5ffd-4fc9-8308-e275b0a37612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:10.495137 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be0ca2-5ffd-4fc9-8308-e275b0a37612 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:10.495323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be0ca2-5ffd-4fc9-8308-e275b0a37612 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:10.495594 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be0ca2-5ffd-4fc9-8308-e275b0a37612 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:10.496333 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be0ca2-5ffd-4fc9-8308-e275b0a37612 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:10.496681 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be0ca2-5ffd-4fc9-8308-e275b0a37612 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:10.501724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be0ca2-5ffd-4fc9-8308-e275b0a37612 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:10.510496 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 407/799] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:05:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:10.511517 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c64938-fcb8-4055-9348-284ea0857db2 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:10.511801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c64938-fcb8-4055-9348-284ea0857db2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:10.512073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c64938-fcb8-4055-9348-284ea0857db2 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:10.517239 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 408/800] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:10 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:10.517239 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c64938-fcb8-4055-9348-284ea0857db2 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:10.517474 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c731425-d74d-4669-a6e8-b35ed3a8692d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:10.553112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86223f8d-e15a-4bf3-95d5-10fc2ca29f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:10.553757 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86223f8d-e15a-4bf3-95d5-10fc2ca29f7d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:10.554043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86223f8d-e15a-4bf3-95d5-10fc2ca29f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:10.554317 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86223f8d-e15a-4bf3-95d5-10fc2ca29f7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:10.566337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86223f8d-e15a-4bf3-95d5-10fc2ca29f7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:05:10.571346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-86223f8d-e15a-4bf3-95d5-10fc2ca29f7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:05:10.571346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:10.571346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:10.571346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:10.571346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:10.571346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:10.571346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:10.571346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:10.571346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:10.571346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:10.571346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:10.571346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:10.571346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:05:10.571346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:05:10.571346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:05:10.571346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:05:10.572335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:05:10.572335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:05:10.572335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:05:10.572335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:05:10.572335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:10.572335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:10.572335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:10.572335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:10.572335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:10.572335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:10.572335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:10.572335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:10.572335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:10.572335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:10.572335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:10.572335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:10.573182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:10.573182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:10.573182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:10.573182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:10.573182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:05:10.573182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:05:10.573182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:05:10.573182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:05:10.573182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:05:10.573182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:05:10.573182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:05:10.573182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:10.573182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 393/801] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:05:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:10.574658 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06a006-7327-459d-91c7-d8252fd999b0 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:10.574943 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06a006-7327-459d-91c7-d8252fd999b0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:10.575221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06a006-7327-459d-91c7-d8252fd999b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:10.597287 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-cb06a006-7327-459d-91c7-d8252fd999b0 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:10.598483 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-cb06a006-7327-459d-91c7-d8252fd999b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:10.627599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c64938-fcb8-4055-9348-284ea0857db2 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:10.662026 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ebec1-6d8d-4ccb-ad4d-a7d2db07ba70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:10.662568 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ebec1-6d8d-4ccb-ad4d-a7d2db07ba70 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:10.662851 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ebec1-6d8d-4ccb-ad4d-a7d2db07ba70 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:10.663126 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ebec1-6d8d-4ccb-ad4d-a7d2db07ba70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:10.663824 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ebec1-6d8d-4ccb-ad4d-a7d2db07ba70 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:10.665231 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ebec1-6d8d-4ccb-ad4d-a7d2db07ba70 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:10.677099 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 394/802] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:10 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:10.678018 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06a006-7327-459d-91c7-d8252fd999b0 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:10.702418 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:10.782165 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06a006-7327-459d-91c7-d8252fd999b0 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:10.793002 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 409/803] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:05:10 2022] POST /identity/v3/endpoints => generated 348 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:05:10.793002 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ebec1-6d8d-4ccb-ad4d-a7d2db07ba70 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:10.833648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:10.847335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a37d2-d885-49c3-9792-c14f90c74bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:10.848213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a37d2-d885-49c3-9792-c14f90c74bda None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:10.848499 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a37d2-d885-49c3-9792-c14f90c74bda None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:10.848804 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a37d2-d885-49c3-9792-c14f90c74bda None admin] PATH_INFO: `/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/6c5f92f21868436a99a5c7aaa1fc40b5/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:10.851870 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a37d2-d885-49c3-9792-c14f90c74bda None admin] RBAC: Authorizing `identity:create_grant(project_id=3747e176cdf2495d9b31a1afae618f68, user_id=6c5f92f21868436a99a5c7aaa1fc40b5, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:10.853771 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a37d2-d885-49c3-9792-c14f90c74bda None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:10.909622 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ebec1-6d8d-4ccb-ad4d-a7d2db07ba70 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:10.933210 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 395/804] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:05:10 2022] PUT /identity/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/6c5f92f21868436a99a5c7aaa1fc40b5/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:05:10.934155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a37d2-d885-49c3-9792-c14f90c74bda None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:10.978169 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87145c8-5db2-4288-b1ec-c8930897e512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:10.978805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87145c8-5db2-4288-b1ec-c8930897e512 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:10.979084 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87145c8-5db2-4288-b1ec-c8930897e512 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:10.979357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87145c8-5db2-4288-b1ec-c8930897e512 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:10.980119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87145c8-5db2-4288-b1ec-c8930897e512 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:10.980383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87145c8-5db2-4288-b1ec-c8930897e512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:10.981875 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87145c8-5db2-4288-b1ec-c8930897e512 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:10.992308 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 410/805] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:05:10 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:10.997946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87145c8-5db2-4288-b1ec-c8930897e512 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:11.029781 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:11.071554 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a37d2-d885-49c3-9792-c14f90c74bda None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:11.111455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f59ec-2fbe-4043-b0cb-abb164f7df3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:11.112171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f59ec-2fbe-4043-b0cb-abb164f7df3c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:11.112453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f59ec-2fbe-4043-b0cb-abb164f7df3c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:11.112755 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f59ec-2fbe-4043-b0cb-abb164f7df3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:11.126194 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:11.127034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f59ec-2fbe-4043-b0cb-abb164f7df3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:05:11.137598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-186f59ec-2fbe-4043-b0cb-abb164f7df3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:05:11.137598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:11.137598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:11.137598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:11.137598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:11.137598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:11.137598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:11.137598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:11.137598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:11.137598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:11.137598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:11.137598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:11.137598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:05:11.137598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:05:11.137598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:05:11.137598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:05:11.138478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:05:11.138478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:05:11.138478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:05:11.138478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:05:11.138478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:11.138478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:11.138478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:11.138478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:11.138478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:11.138478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:11.138478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:11.138478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:11.138478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:11.138478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:11.138478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:11.138478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:11.139334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:11.139334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:11.139334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:11.139334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:11.139334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:05:11.139334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:05:11.139334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:05:11.139334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:05:11.139334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:05:11.139334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:05:11.139334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:05:11.139334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:11.139951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87145c8-5db2-4288-b1ec-c8930897e512 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:11.140023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 396/806] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:05:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:11.140023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314dda3-23ac-486e-b6c7-d4ac851c468c None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:11.140023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314dda3-23ac-486e-b6c7-d4ac851c468c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:11.140023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314dda3-23ac-486e-b6c7-d4ac851c468c None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:11.140023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 397/807] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:11.141860 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314dda3-23ac-486e-b6c7-d4ac851c468c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:11.189103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955bdc4-eb3e-4cac-858d-b0480ccc8c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:11.189816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955bdc4-eb3e-4cac-858d-b0480ccc8c49 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:11.190094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955bdc4-eb3e-4cac-858d-b0480ccc8c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:11.190365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955bdc4-eb3e-4cac-858d-b0480ccc8c49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:11.204480 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955bdc4-eb3e-4cac-858d-b0480ccc8c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:11.206236 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955bdc4-eb3e-4cac-858d-b0480ccc8c49 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:11.221780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-4955bdc4-eb3e-4cac-858d-b0480ccc8c49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:11.221780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:11.221780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:11.221780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:11.221780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:11.221780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:11.221780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:11.221780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:11.221780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:11.221780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:11.221780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:11.221780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:11.221780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:11.221780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:11.221780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:11.222689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:11.222689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:11.222689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:11.222689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:11.222689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:11.222689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:11.222689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:11.222689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:11.222689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:11.222689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:11.222689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:11.222689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:11.222689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:11.222689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:11.222689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:11.222689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:11.222689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:11.223552 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:11.223552 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:11.223552 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:11.223552 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:11.223552 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 411/808] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:11.224419 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93f130-cf65-415d-8fa7-01113e97b700 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:11.228757 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93f130-cf65-415d-8fa7-01113e97b700 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:11.229340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93f130-cf65-415d-8fa7-01113e97b700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:11.250214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-ba93f130-cf65-415d-8fa7-01113e97b700 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:11.251764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ba93f130-cf65-415d-8fa7-01113e97b700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:11.271908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314dda3-23ac-486e-b6c7-d4ac851c468c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:11.309936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:11.316566 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da281c00-8452-4e03-8f7c-fffe0ccc9d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:11.317528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281c00-8452-4e03-8f7c-fffe0ccc9d97 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:11.317813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281c00-8452-4e03-8f7c-fffe0ccc9d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:11.318088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281c00-8452-4e03-8f7c-fffe0ccc9d97 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:11.319220 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da281c00-8452-4e03-8f7c-fffe0ccc9d97 None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:11.319567 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da281c00-8452-4e03-8f7c-fffe0ccc9d97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:11.321519 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da281c00-8452-4e03-8f7c-fffe0ccc9d97 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:11.326522 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 412/809] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:11 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:11.327721 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93f130-cf65-415d-8fa7-01113e97b700 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:11.340437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 398/810] 10.222.0.141 () {56 vars in 1108 bytes} [Tue Jul 26 16:05:11 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:11.346850 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da281c00-8452-4e03-8f7c-fffe0ccc9d97 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:11.452793 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93f130-cf65-415d-8fa7-01113e97b700 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:11.453385 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da281c00-8452-4e03-8f7c-fffe0ccc9d97 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:11.461124 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:11.489718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6663461-81c5-4566-93bc-9ba1fc3679c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:11.489954 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad372600-a122-45e7-af85-7647196f79ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:11.490374 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6663461-81c5-4566-93bc-9ba1fc3679c4 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:11.490480 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad372600-a122-45e7-af85-7647196f79ca None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:11.490668 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6663461-81c5-4566-93bc-9ba1fc3679c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:11.490802 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad372600-a122-45e7-af85-7647196f79ca None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:11.490991 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6663461-81c5-4566-93bc-9ba1fc3679c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:11.491087 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad372600-a122-45e7-af85-7647196f79ca None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:11.491797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad372600-a122-45e7-af85-7647196f79ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:11.492113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad372600-a122-45e7-af85-7647196f79ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:11.493726 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad372600-a122-45e7-af85-7647196f79ca None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:11.501641 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6663461-81c5-4566-93bc-9ba1fc3679c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:11.503089 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6663461-81c5-4566-93bc-9ba1fc3679c4 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:11.510367 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 413/811] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:11.511246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad372600-a122-45e7-af85-7647196f79ca None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:11.519108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-b6663461-81c5-4566-93bc-9ba1fc3679c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:11.519108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:11.519108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:11.519108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:11.519108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:11.519108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:11.519108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:11.519108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:11.519108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:11.519108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:11.519108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:11.519108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:11.519108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:11.519108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:11.519108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:11.519974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:11.519974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:11.519974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:11.519974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:11.519974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:11.519974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:11.519974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:11.519974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:11.519974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:11.519974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:11.519974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:11.519974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:11.519974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:11.519974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:11.519974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:11.519974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:11.519974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:11.520953 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:11.520953 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:11.520953 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:11.520953 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:11.524775 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 399/812] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:11.525637 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6663461-81c5-4566-93bc-9ba1fc3679c4 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:11.577689 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:11.625096 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad372600-a122-45e7-af85-7647196f79ca None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:11.633470 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6663461-81c5-4566-93bc-9ba1fc3679c4 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:11.663560 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0522ba4-9ca7-4251-a5e9-601a9db74325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:11.664229 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0522ba4-9ca7-4251-a5e9-601a9db74325 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:11.664487 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0522ba4-9ca7-4251-a5e9-601a9db74325 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:11.664796 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0522ba4-9ca7-4251-a5e9-601a9db74325 None admin] PATH_INFO: `/v3/services/network` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:11.665429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0522ba4-9ca7-4251-a5e9-601a9db74325 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:11.666797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0522ba4-9ca7-4251-a5e9-601a9db74325 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:11.672444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699ea89-045d-43cb-9724-f86248600638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:11.673413 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699ea89-045d-43cb-9724-f86248600638 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:11.673917 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699ea89-045d-43cb-9724-f86248600638 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:11.674388 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699ea89-045d-43cb-9724-f86248600638 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:11.676122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-d0522ba4-9ca7-4251-a5e9-601a9db74325 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 16:05:11.676122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:11.676122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:11.676122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:11.676122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:11.676122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:11.676122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:11.676122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:11.676122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 16:05:11.676122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:11.676122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:11.676122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:11.676122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:11.676122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:11.676122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:11.676122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:11.676122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:11.677123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:11.677123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:11.677123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:11.677123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:11.677123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:11.677123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:11.677123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:11.677123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:11.677123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:11.677123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:11.677123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:11.677123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:11.677123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:11.677123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:11.677123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:11.677123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:11.677947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:11.677947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:11.677947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:11.677947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:11.677947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:11.677947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:11.677947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:11.677947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:11.677947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:11.677947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:11.677947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:11.677947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:11.677947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 16:05:11.677947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:11.684242 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 414/813] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:11 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:11.684242 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0522ba4-9ca7-4251-a5e9-601a9db74325 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:11.693012 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:11.694095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699ea89-045d-43cb-9724-f86248600638 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:11.696355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699ea89-045d-43cb-9724-f86248600638 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:11.710404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-d699ea89-045d-43cb-9724-f86248600638 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 16:05:11.710404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:11.710404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:11.710404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:11.710404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:11.710404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:11.710404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:11.710404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:11.710404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:11.710404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:11.710404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:11.710404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:11.710404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:05:11.710404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:05:11.710404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:05:11.710404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:05:11.711357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:11.711357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:11.711357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:05:11.711357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:11.711357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:05:11.711357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:11.711357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:11.711357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:11.711357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:11.711357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:11.711357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:11.711357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:11.711357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:11.711357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:11.711357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:11.711357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:11.711357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:11.711357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:11.712290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:11.712290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:11.712290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:05:11.712290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:05:11.712290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:05:11.712290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:05:11.712290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:05:11.712290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:05:11.712290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 16:05:11.712290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:11.714566 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 400/814] 10.222.0.141 () {56 vars in 1098 bytes} [Tue Jul 26 16:05:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:11.715530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699ea89-045d-43cb-9724-f86248600638 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:11.806233 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0522ba4-9ca7-4251-a5e9-601a9db74325 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:11.838627 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699ea89-045d-43cb-9724-f86248600638 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:11.846125 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b526f3-2f35-4941-afcb-74546a65b97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:11.847407 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:11.847518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b526f3-2f35-4941-afcb-74546a65b97d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:11.848289 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b526f3-2f35-4941-afcb-74546a65b97d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:11.848419 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b526f3-2f35-4941-afcb-74546a65b97d None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:11.849441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b526f3-2f35-4941-afcb-74546a65b97d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:11.849816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b526f3-2f35-4941-afcb-74546a65b97d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:11.851264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b526f3-2f35-4941-afcb-74546a65b97d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:11.868760 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 415/815] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:11.869858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b526f3-2f35-4941-afcb-74546a65b97d None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:11.886512 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501e024-1c20-41a1-ac25-541c202ec3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:11.887224 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501e024-1c20-41a1-ac25-541c202ec3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:11.887567 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501e024-1c20-41a1-ac25-541c202ec3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:11.888160 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501e024-1c20-41a1-ac25-541c202ec3c7 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:11.888944 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501e024-1c20-41a1-ac25-541c202ec3c7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:11.889775 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501e024-1c20-41a1-ac25-541c202ec3c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:11.892027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501e024-1c20-41a1-ac25-541c202ec3c7 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:11.902294 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 401/816] 10.222.0.141 () {56 vars in 1117 bytes} [Tue Jul 26 16:05:11 2022] GET /identity/v3/services?name=network => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:11.902294 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501e024-1c20-41a1-ac25-541c202ec3c7 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:11.950898 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:11.991196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b526f3-2f35-4941-afcb-74546a65b97d None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:12.015957 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501e024-1c20-41a1-ac25-541c202ec3c7 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:12.029927 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179bf23-d8e5-487c-98b2-952f1b060075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:12.031051 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179bf23-d8e5-487c-98b2-952f1b060075 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:12.031540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179bf23-d8e5-487c-98b2-952f1b060075 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:12.032400 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179bf23-d8e5-487c-98b2-952f1b060075 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:12.033716 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179bf23-d8e5-487c-98b2-952f1b060075 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:12.034409 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179bf23-d8e5-487c-98b2-952f1b060075 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:12.036356 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179bf23-d8e5-487c-98b2-952f1b060075 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:12.058200 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b7c5c-8c1a-457f-ab2b-53d3ea068407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:12.058860 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b7c5c-8c1a-457f-ab2b-53d3ea068407 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:12.059142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b7c5c-8c1a-457f-ab2b-53d3ea068407 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:12.059419 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b7c5c-8c1a-457f-ab2b-53d3ea068407 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:12.067658 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 416/817] 10.222.0.141 () {56 vars in 1138 bytes} [Tue Jul 26 16:05:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:12.067658 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179bf23-d8e5-487c-98b2-952f1b060075 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:12.074807 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b7c5c-8c1a-457f-ab2b-53d3ea068407 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:12.075993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b7c5c-8c1a-457f-ab2b-53d3ea068407 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:12.088837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-830b7c5c-8c1a-457f-ab2b-53d3ea068407 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 16:05:12.088837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:12.088837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:12.088837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:12.088837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:12.088837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:12.088837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:12.088837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:12.088837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:12.088837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:12.088837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:12.088837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:12.088837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:05:12.088837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:05:12.088837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:05:12.088837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:05:12.097619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:12.097619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:12.097619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:05:12.097619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:12.097619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:05:12.097619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:12.097619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:12.097619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:12.097619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:12.097619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:12.097619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:12.097619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:12.097619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:12.097619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:12.097619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:12.097619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:12.097619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:12.097619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:12.098560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:12.098560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:12.098560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:05:12.098560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:05:12.098560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:05:12.098560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:05:12.098560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:05:12.098560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:05:12.098560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 16:05:12.098560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:12.098560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 402/818] 10.222.0.141 () {56 vars in 1122 bytes} [Tue Jul 26 16:05:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:12.098560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b7c5c-8c1a-457f-ab2b-53d3ea068407 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:12.128677 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:12.195687 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179bf23-d8e5-487c-98b2-952f1b060075 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:12.202569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b7c5c-8c1a-457f-ab2b-53d3ea068407 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:12.219373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:12.236054 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1cf0d-adc6-443d-8bf7-11c2f4985a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:12.237139 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1cf0d-adc6-443d-8bf7-11c2f4985a4a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:12.237602 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1cf0d-adc6-443d-8bf7-11c2f4985a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:12.238010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7f70a-6c86-4d2b-ae08-53c6107012ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:12.238283 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1cf0d-adc6-443d-8bf7-11c2f4985a4a None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:12.238759 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7f70a-6c86-4d2b-ae08-53c6107012ec None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:12.239111 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7f70a-6c86-4d2b-ae08-53c6107012ec None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:12.239452 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7f70a-6c86-4d2b-ae08-53c6107012ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:12.239745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1cf0d-adc6-443d-8bf7-11c2f4985a4a None admin] RBAC: Adding query filter params (type=network) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:12.240328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1cf0d-adc6-443d-8bf7-11c2f4985a4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:12.241959 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1cf0d-adc6-443d-8bf7-11c2f4985a4a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:12.247513 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 417/819] 10.222.0.141 () {56 vars in 1117 bytes} [Tue Jul 26 16:05:12 2022] GET /identity/v3/services?type=network => generated 352 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:12.248483 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1cf0d-adc6-443d-8bf7-11c2f4985a4a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:12.317883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7f70a-6c86-4d2b-ae08-53c6107012ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:12.319441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7f70a-6c86-4d2b-ae08-53c6107012ec None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:12.351840 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:12.360140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1cf0d-adc6-443d-8bf7-11c2f4985a4a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:12.397303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77695fd5-1615-4c31-aa06-00289df618d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:12.398253 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77695fd5-1615-4c31-aa06-00289df618d6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:12.398895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77695fd5-1615-4c31-aa06-00289df618d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:12.399351 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77695fd5-1615-4c31-aa06-00289df618d6 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:12.400421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77695fd5-1615-4c31-aa06-00289df618d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:12.400941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77695fd5-1615-4c31-aa06-00289df618d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:12.402552 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77695fd5-1615-4c31-aa06-00289df618d6 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:12.422702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 418/820] 10.222.0.141 () {56 vars in 1154 bytes} [Tue Jul 26 16:05:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:12.423767 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77695fd5-1615-4c31-aa06-00289df618d6 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:12.432127 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 403/821] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:05:12 2022] GET /identity/v3/auth/tokens => generated 1003 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 16:05:12.432127 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7f70a-6c86-4d2b-ae08-53c6107012ec None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:12.476005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:12.530843 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7f70a-6c86-4d2b-ae08-53c6107012ec None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:12.539694 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77695fd5-1615-4c31-aa06-00289df618d6 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:12.560716 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:12.567193 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af179ded-0aea-41dd-aa81-11e78847a334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:12.567920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af179ded-0aea-41dd-aa81-11e78847a334 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:12.568294 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af179ded-0aea-41dd-aa81-11e78847a334 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:12.568933 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af179ded-0aea-41dd-aa81-11e78847a334 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:12.580360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf577f-ab78-4c73-ba86-be56b2f578d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:12.580910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af179ded-0aea-41dd-aa81-11e78847a334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:12.581472 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf577f-ab78-4c73-ba86-be56b2f578d5 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:12.581959 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf577f-ab78-4c73-ba86-be56b2f578d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:12.582429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf577f-ab78-4c73-ba86-be56b2f578d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:12.582534 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af179ded-0aea-41dd-aa81-11e78847a334 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:12.583402 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf577f-ab78-4c73-ba86-be56b2f578d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:12.584978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf577f-ab78-4c73-ba86-be56b2f578d5 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:12.598427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-af179ded-0aea-41dd-aa81-11e78847a334 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:12.598427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:12.598427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:12.598427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:12.598427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:12.598427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:12.598427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:12.598427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:12.598427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:12.598427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:12.598427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:12.598427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:12.598427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:12.598427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:12.598427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:12.599389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:12.599389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:12.599389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:12.599389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:12.599389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:12.599389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:12.599389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:12.599389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:12.599389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:12.599389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:12.599389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:12.599389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:12.599389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:12.599389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:12.599389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:12.599389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:12.599389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:12.600703 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:12.600703 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:12.600703 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:12.600703 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:12.600703 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 404/822] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:12.601161 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af179ded-0aea-41dd-aa81-11e78847a334 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:12.701205 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 419/823] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:05:12 2022] POST /identity/v3/endpoints => generated 329 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:05:12.701205 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf577f-ab78-4c73-ba86-be56b2f578d5 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:12.719739 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af179ded-0aea-41dd-aa81-11e78847a334 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:12.822417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df7a89-fff7-408d-bf7d-54bd19c9560e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:12.824111 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df7a89-fff7-408d-bf7d-54bd19c9560e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:12.827901 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df7a89-fff7-408d-bf7d-54bd19c9560e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:12.828526 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df7a89-fff7-408d-bf7d-54bd19c9560e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:12.853876 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df7a89-fff7-408d-bf7d-54bd19c9560e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:12.857180 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df7a89-fff7-408d-bf7d-54bd19c9560e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:12.888954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-14df7a89-fff7-408d-bf7d-54bd19c9560e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:12.888954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:12.888954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:12.888954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:12.888954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:12.888954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:12.888954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:12.888954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:12.888954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:12.888954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:12.888954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:12.888954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:12.888954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:12.888954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:12.888954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:12.889925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:12.889925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:12.889925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:12.889925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:12.889925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:12.889925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:12.889925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:12.889925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:12.889925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:12.889925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:12.889925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:12.889925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:12.889925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:12.889925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:12.889925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:12.889925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:12.889925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:12.890800 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:12.890800 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:12.890800 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:12.890800 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:12.892772 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 405/824] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:12.896099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:12.900731 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df7a89-fff7-408d-bf7d-54bd19c9560e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:12.900878 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf577f-ab78-4c73-ba86-be56b2f578d5 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:12.944032 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:12.954530 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29e7e5-df19-4bb7-990b-0d007358b767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:12.955160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29e7e5-df19-4bb7-990b-0d007358b767 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:12.955439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29e7e5-df19-4bb7-990b-0d007358b767 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:12.955710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29e7e5-df19-4bb7-990b-0d007358b767 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:12.956401 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29e7e5-df19-4bb7-990b-0d007358b767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:12.956730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29e7e5-df19-4bb7-990b-0d007358b767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:12.958101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29e7e5-df19-4bb7-990b-0d007358b767 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:12.974084 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 420/825] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:12.979566 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29e7e5-df19-4bb7-990b-0d007358b767 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:13.036181 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df7a89-fff7-408d-bf7d-54bd19c9560e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:13.081773 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9640c6-e51e-47f4-b5d6-e755c60033d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:13.082363 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9640c6-e51e-47f4-b5d6-e755c60033d0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:13.082645 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9640c6-e51e-47f4-b5d6-e755c60033d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:13.082923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9640c6-e51e-47f4-b5d6-e755c60033d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:13.083618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9640c6-e51e-47f4-b5d6-e755c60033d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:13.083922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9640c6-e51e-47f4-b5d6-e755c60033d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:13.085322 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9640c6-e51e-47f4-b5d6-e755c60033d0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:13.096820 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 406/826] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:13.098149 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c5035-45e4-4612-8b19-0cd6143a73c5 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:13.098444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c5035-45e4-4612-8b19-0cd6143a73c5 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:13.098561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29e7e5-df19-4bb7-990b-0d007358b767 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:13.098729 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c5035-45e4-4612-8b19-0cd6143a73c5 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:13.103994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 407/827] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:13 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:13.105187 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c476231-ba69-4eb3-9002-b99ff9c56612 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:13.105473 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c476231-ba69-4eb3-9002-b99ff9c56612 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:13.105752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c476231-ba69-4eb3-9002-b99ff9c56612 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:13.106965 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 408/828] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:13 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:13.107658 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c476231-ba69-4eb3-9002-b99ff9c56612 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:13.134741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219591b-9d37-47cd-8fb1-7c121acbc1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:13.135375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219591b-9d37-47cd-8fb1-7c121acbc1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:13.135652 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219591b-9d37-47cd-8fb1-7c121acbc1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:13.135925 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219591b-9d37-47cd-8fb1-7c121acbc1b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:13.142514 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219591b-9d37-47cd-8fb1-7c121acbc1b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:13.143940 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219591b-9d37-47cd-8fb1-7c121acbc1b6 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:13.155877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-d219591b-9d37-47cd-8fb1-7c121acbc1b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:13.155877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:13.155877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:13.155877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:13.155877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:13.155877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:13.155877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:13.155877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:13.155877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:13.155877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:13.155877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:13.155877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:13.155877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:05:13.155877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:05:13.155877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:05:13.156799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:05:13.156799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:13.156799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:13.156799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:13.156799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:13.156799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:13.156799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:13.156799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:13.156799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:13.156799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:13.156799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:13.156799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:13.156799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:13.156799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:13.156799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:13.156799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:13.156799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:13.157707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:05:13.157707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:05:13.157707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:05:13.157707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:05:13.157707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:05:13.157707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:05:13.157707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:13.157707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:13.157707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 421/829] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:13.158177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8184c-dcf4-4d51-ba66-9e628ef1b37b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:13.158547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8184c-dcf4-4d51-ba66-9e628ef1b37b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:13.158788 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8184c-dcf4-4d51-ba66-9e628ef1b37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:13.176454 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-82a8184c-dcf4-4d51-ba66-9e628ef1b37b None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:13.177671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-82a8184c-dcf4-4d51-ba66-9e628ef1b37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:13.191418 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:13.203254 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:13.213439 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c476231-ba69-4eb3-9002-b99ff9c56612 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:13.244338 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 422/830] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:13 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:13.245591 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594e1f5-720c-4762-8bc1-d0667b8c8fbb None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:13.245878 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594e1f5-720c-4762-8bc1-d0667b8c8fbb None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:13.246149 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594e1f5-720c-4762-8bc1-d0667b8c8fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:13.251883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2a19c-9d4c-4aab-baa6-d73522f7238e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:13.252882 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2a19c-9d4c-4aab-baa6-d73522f7238e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:13.253722 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2a19c-9d4c-4aab-baa6-d73522f7238e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:13.254000 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2a19c-9d4c-4aab-baa6-d73522f7238e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:13.261720 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2a19c-9d4c-4aab-baa6-d73522f7238e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:13.263262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2a19c-9d4c-4aab-baa6-d73522f7238e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:13.264127 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-9594e1f5-720c-4762-8bc1-d0667b8c8fbb None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:13.265336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9594e1f5-720c-4762-8bc1-d0667b8c8fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:13.275278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-5cb2a19c-9d4c-4aab-baa6-d73522f7238e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:13.275278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:13.275278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:13.275278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:13.275278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:13.275278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:13.275278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:13.275278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:13.275278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:13.275278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:13.275278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:13.275278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:13.275278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:05:13.275278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:05:13.275278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:05:13.276239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:05:13.276239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:13.276239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:13.276239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:13.276239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:13.276239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:13.276239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:13.276239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:13.276239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:13.276239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:13.276239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:13.276239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:13.276239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:13.276239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:13.276239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:13.276239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:13.276239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:13.277621 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:05:13.277621 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:05:13.277621 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:05:13.277621 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:05:13.277621 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:05:13.277621 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:05:13.277621 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:13.277621 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:13.277621 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 409/831] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:13.277621 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2a19c-9d4c-4aab-baa6-d73522f7238e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:13.335965 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 423/832] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:13 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:13.336753 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594e1f5-720c-4762-8bc1-d0667b8c8fbb None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:13.379538 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2a19c-9d4c-4aab-baa6-d73522f7238e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:13.412432 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd420e1-635b-4f67-be88-47d44ca2bfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:13.412622 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:13.413069 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd420e1-635b-4f67-be88-47d44ca2bfb5 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:13.413353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd420e1-635b-4f67-be88-47d44ca2bfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:13.413629 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd420e1-635b-4f67-be88-47d44ca2bfb5 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:13.414367 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd420e1-635b-4f67-be88-47d44ca2bfb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:13.414675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd420e1-635b-4f67-be88-47d44ca2bfb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:13.416102 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd420e1-635b-4f67-be88-47d44ca2bfb5 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:13.427503 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 410/833] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:05:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:13.428293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd420e1-635b-4f67-be88-47d44ca2bfb5 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:13.434175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594e1f5-720c-4762-8bc1-d0667b8c8fbb None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:13.442957 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:13.469273 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6af53-8663-405e-901d-31f9e956e7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:13.470183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6af53-8663-405e-901d-31f9e956e7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:13.470458 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6af53-8663-405e-901d-31f9e956e7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:13.470730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6af53-8663-405e-901d-31f9e956e7d5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:13.471356 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6af53-8663-405e-901d-31f9e956e7d5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:13.472726 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6af53-8663-405e-901d-31f9e956e7d5 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:13.481350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-acb6af53-8663-405e-901d-31f9e956e7d5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 16:05:13.481350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:13.481350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:13.481350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:13.481350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:13.481350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:13.481350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:13.481350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:13.481350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 16:05:13.481350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:13.481350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:13.481350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:13.481350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:13.481350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:13.481350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:13.481350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:13.481350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:13.482507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:13.482507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:13.482507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:13.482507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:13.482507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:13.482507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:13.482507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:13.482507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:13.482507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:13.482507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:13.482507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:13.482507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:13.482507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:13.482507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:13.482507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:13.482507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:13.483814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:13.483814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:13.483814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:13.483814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:13.483814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:13.483814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:13.483814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:13.483814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:13.483814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:13.483814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:13.483814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:13.483814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:13.483814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 16:05:13.483814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:13.483814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 424/834] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:05:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:13.486161 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6af53-8663-405e-901d-31f9e956e7d5 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:13.528101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd420e1-635b-4f67-be88-47d44ca2bfb5 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:13.560390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c27754-f133-4361-a7d2-dcabdce4ceba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:13.561026 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c27754-f133-4361-a7d2-dcabdce4ceba None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:13.561307 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c27754-f133-4361-a7d2-dcabdce4ceba None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:13.561589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c27754-f133-4361-a7d2-dcabdce4ceba None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:13.562333 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c27754-f133-4361-a7d2-dcabdce4ceba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:13.562639 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c27754-f133-4361-a7d2-dcabdce4ceba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:13.564596 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c27754-f133-4361-a7d2-dcabdce4ceba None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:13.576188 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 411/835] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:05:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:13.576959 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c27754-f133-4361-a7d2-dcabdce4ceba None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:13.586167 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6af53-8663-405e-901d-31f9e956e7d5 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:13.619324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c36864-407a-4277-bcdd-2019dc98fdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:13.619949 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c36864-407a-4277-bcdd-2019dc98fdf1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:13.620228 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c36864-407a-4277-bcdd-2019dc98fdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:13.620502 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c36864-407a-4277-bcdd-2019dc98fdf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:13.630874 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c36864-407a-4277-bcdd-2019dc98fdf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:05:13.636113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-b4c36864-407a-4277-bcdd-2019dc98fdf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:05:13.636113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:13.636113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:13.636113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:13.636113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:13.636113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:13.636113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:13.636113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:13.636113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:13.636113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:13.636113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:13.636113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:13.636113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:05:13.636113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:05:13.636113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:05:13.636113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:05:13.637160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:05:13.637160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:05:13.637160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:05:13.637160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:05:13.637160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:13.637160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:13.637160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:13.637160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:13.637160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:13.637160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:13.637160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:13.637160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:13.637160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:13.637160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:13.637160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:13.637160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:13.637991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:13.637991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:13.637991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:13.637991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:13.637991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:05:13.637991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:05:13.637991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:05:13.637991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:05:13.637991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:05:13.637991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:05:13.637991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:05:13.637991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:13.637991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 425/836] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:05:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:13.637991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c36864-407a-4277-bcdd-2019dc98fdf1 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:13.640381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:13.651512 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:13.681367 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c27754-f133-4361-a7d2-dcabdce4ceba None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:13.715576 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec312f58-689e-45e4-a72c-49bd1b1c0bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:13.716231 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec312f58-689e-45e4-a72c-49bd1b1c0bbb None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:13.716511 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec312f58-689e-45e4-a72c-49bd1b1c0bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:13.716816 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec312f58-689e-45e4-a72c-49bd1b1c0bbb None admin] PATH_INFO: `/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/02af03095e48472d96a995a530e78035/roles/6540af5baf2c4ff78d0fedfc4bea4e46` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:13.730744 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec312f58-689e-45e4-a72c-49bd1b1c0bbb None admin] RBAC: Authorizing `identity:create_grant(project_id=3747e176cdf2495d9b31a1afae618f68, user_id=02af03095e48472d96a995a530e78035, role_id=6540af5baf2c4ff78d0fedfc4bea4e46)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:13.732174 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec312f58-689e-45e4-a72c-49bd1b1c0bbb None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:13.735916 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c36864-407a-4277-bcdd-2019dc98fdf1 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:13.768586 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bca526-1499-4ff6-b1c6-7dc746b454a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:13.769224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bca526-1499-4ff6-b1c6-7dc746b454a2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:13.769502 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bca526-1499-4ff6-b1c6-7dc746b454a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:13.769773 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bca526-1499-4ff6-b1c6-7dc746b454a2 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:13.770468 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bca526-1499-4ff6-b1c6-7dc746b454a2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:13.770764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bca526-1499-4ff6-b1c6-7dc746b454a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:13.772099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bca526-1499-4ff6-b1c6-7dc746b454a2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:13.776391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 426/837] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:05:13 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:13.778324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bca526-1499-4ff6-b1c6-7dc746b454a2 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:13.805323 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 412/838] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:05:13 2022] PUT /identity/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/02af03095e48472d96a995a530e78035/roles/6540af5baf2c4ff78d0fedfc4bea4e46 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:05:13.806149 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec312f58-689e-45e4-a72c-49bd1b1c0bbb None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:13.864897 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:13.913671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bca526-1499-4ff6-b1c6-7dc746b454a2 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:13.930209 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec312f58-689e-45e4-a72c-49bd1b1c0bbb None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:13.954052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:13.966408 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04e3df-9cae-4017-bb5c-42b1e06c8a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:13.967028 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04e3df-9cae-4017-bb5c-42b1e06c8a12 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:13.967309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04e3df-9cae-4017-bb5c-42b1e06c8a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:13.971862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04e3df-9cae-4017-bb5c-42b1e06c8a12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:13.971862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04e3df-9cae-4017-bb5c-42b1e06c8a12 None admin] RBAC: Adding query filter params (role.id=94ecbd6c86a84b75bdb0c57fc27a9a07, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=f7eac931cabf4921b6dbd42f63b9300f) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:13.971862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04e3df-9cae-4017-bb5c-42b1e06c8a12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:13.971862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04e3df-9cae-4017-bb5c-42b1e06c8a12 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:13.972937 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ce157-7056-498f-836a-1c75ed9b3b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:13.973600 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ce157-7056-498f-836a-1c75ed9b3b34 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:13.973888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ce157-7056-498f-836a-1c75ed9b3b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:13.974160 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ce157-7056-498f-836a-1c75ed9b3b34 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:13.974893 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ce157-7056-498f-836a-1c75ed9b3b34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:13.975197 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ce157-7056-498f-836a-1c75ed9b3b34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:13.976630 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ce157-7056-498f-836a-1c75ed9b3b34 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:13.977401 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 427/839] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:05:13 2022] GET /identity/v3/role_assignments?user.id=f7eac931cabf4921b6dbd42f63b9300f&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 610 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:13.977996 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04e3df-9cae-4017-bb5c-42b1e06c8a12 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:13.986563 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 413/840] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:05:13 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:13.992555 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ce157-7056-498f-836a-1c75ed9b3b34 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:14.121287 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04e3df-9cae-4017-bb5c-42b1e06c8a12 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:14.123996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ce157-7056-498f-836a-1c75ed9b3b34 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:14.159016 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:14.166621 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1ceb6-faa4-442a-8ba6-f487359cfff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:14.167249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1ceb6-faa4-442a-8ba6-f487359cfff6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:14.173387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1ceb6-faa4-442a-8ba6-f487359cfff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:14.173387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1ceb6-faa4-442a-8ba6-f487359cfff6 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:14.173566 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72569ad0-f500-4156-b10a-31665e8099aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:14.173655 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1ceb6-faa4-442a-8ba6-f487359cfff6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:14.173655 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1ceb6-faa4-442a-8ba6-f487359cfff6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:14.173805 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72569ad0-f500-4156-b10a-31665e8099aa None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:14.173805 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72569ad0-f500-4156-b10a-31665e8099aa None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:14.173805 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72569ad0-f500-4156-b10a-31665e8099aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:14.174021 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1ceb6-faa4-442a-8ba6-f487359cfff6 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:14.175996 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 428/841] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:05:13 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:14.186446 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72569ad0-f500-4156-b10a-31665e8099aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:14.188338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72569ad0-f500-4156-b10a-31665e8099aa None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:14.207738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-72569ad0-f500-4156-b10a-31665e8099aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:14.207738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:14.207738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:14.207738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:14.207738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:14.207738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:14.207738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:14.207738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:14.207738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:14.207738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:14.207738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:14.207738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:14.207738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:14.207738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:14.207738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:14.208791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:14.208791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:14.208791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:14.208791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:14.208791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:14.208791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:14.208791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:14.208791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:14.208791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:14.208791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:14.208791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:14.208791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:14.208791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:14.208791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:14.208791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:14.208791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:14.208791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:14.209680 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:14.209680 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:14.209680 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:14.209680 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:14.209680 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 414/842] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:14.215182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1ceb6-faa4-442a-8ba6-f487359cfff6 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:14.332843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1ceb6-faa4-442a-8ba6-f487359cfff6 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:14.369637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f228b9d-f343-4c3c-8256-07115c42b84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:14.370261 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f228b9d-f343-4c3c-8256-07115c42b84a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:14.370544 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f228b9d-f343-4c3c-8256-07115c42b84a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:14.370820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f228b9d-f343-4c3c-8256-07115c42b84a None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:14.371564 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f228b9d-f343-4c3c-8256-07115c42b84a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:14.371815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f228b9d-f343-4c3c-8256-07115c42b84a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:14.373230 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f228b9d-f343-4c3c-8256-07115c42b84a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:14.387595 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 429/843] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:14.392648 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72569ad0-f500-4156-b10a-31665e8099aa None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:14.428317 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:14.500384 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72569ad0-f500-4156-b10a-31665e8099aa None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:14.537100 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2008b-218e-41de-b247-bbae71f8c777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:14.537741 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2008b-218e-41de-b247-bbae71f8c777 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:14.538023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2008b-218e-41de-b247-bbae71f8c777 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:14.538295 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2008b-218e-41de-b247-bbae71f8c777 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:14.546485 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2008b-218e-41de-b247-bbae71f8c777 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:14.548230 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2008b-218e-41de-b247-bbae71f8c777 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:14.562185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-8cb2008b-218e-41de-b247-bbae71f8c777 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 16:05:14.562185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:14.562185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:14.562185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:14.562185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:14.562185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:14.562185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:14.562185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:14.562185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:14.562185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:14.562185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:14.562185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:14.562185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:05:14.562185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:05:14.562185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:05:14.562185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:05:14.563339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:14.563339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:14.563339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:05:14.563339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:14.563339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:05:14.563339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:14.563339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:14.563339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:14.563339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:14.563339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:14.563339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:14.563339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:14.563339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:14.563339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:14.563339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:14.563339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:14.563339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:14.563339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:14.564264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:14.564264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:14.564264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:05:14.564264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:05:14.564264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:05:14.564264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:05:14.564264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:05:14.564264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:05:14.564264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 16:05:14.564264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:14.564264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 415/844] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:05:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:14.569516 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f228b9d-f343-4c3c-8256-07115c42b84a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:14.631317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:14.677016 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f228b9d-f343-4c3c-8256-07115c42b84a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:14.718315 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed888711-2500-4796-aa10-d3680eecb47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:14.718930 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed888711-2500-4796-aa10-d3680eecb47c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:14.719210 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed888711-2500-4796-aa10-d3680eecb47c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:14.719515 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed888711-2500-4796-aa10-d3680eecb47c None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:14.720298 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed888711-2500-4796-aa10-d3680eecb47c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:14.720602 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed888711-2500-4796-aa10-d3680eecb47c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:14.722047 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed888711-2500-4796-aa10-d3680eecb47c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:14.739829 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 430/845] 10.222.0.141 () {56 vars in 1140 bytes} [Tue Jul 26 16:05:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:14.745335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2008b-218e-41de-b247-bbae71f8c777 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:14.839637 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:14.846393 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2008b-218e-41de-b247-bbae71f8c777 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:14.885896 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7fcf5-4102-4e0c-9637-e0c9924516da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:14.886436 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7fcf5-4102-4e0c-9637-e0c9924516da None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:14.886715 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7fcf5-4102-4e0c-9637-e0c9924516da None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:14.886990 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7fcf5-4102-4e0c-9637-e0c9924516da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:14.959727 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7fcf5-4102-4e0c-9637-e0c9924516da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:14.961209 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7fcf5-4102-4e0c-9637-e0c9924516da None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:15.061065 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:15.064766 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 416/846] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:05:14 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 16:05:15.069948 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed888711-2500-4796-aa10-d3680eecb47c None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:15.179672 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed888711-2500-4796-aa10-d3680eecb47c None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:15.193489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:15.214842 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d43276-55d8-4983-8438-7fcc38a3d090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:15.215483 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d43276-55d8-4983-8438-7fcc38a3d090 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:15.215766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d43276-55d8-4983-8438-7fcc38a3d090 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:15.216044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d43276-55d8-4983-8438-7fcc38a3d090 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:15.227064 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d43276-55d8-4983-8438-7fcc38a3d090 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:15.228801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d43276-55d8-4983-8438-7fcc38a3d090 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:15.245209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-54d43276-55d8-4983-8438-7fcc38a3d090 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:15.245209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:15.245209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:15.245209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:15.245209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:15.245209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:15.245209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:15.245209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:15.245209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:15.245209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:15.245209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:15.245209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:15.245209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:15.245209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:15.245209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:15.246103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:15.246103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:15.246103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:15.246103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:15.246103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:15.246103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:15.246103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:15.246103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:15.246103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:15.246103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:15.246103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:15.246103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:15.246103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:15.246103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:15.246103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:15.246103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:15.246103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:15.246968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:15.246968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:15.246968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:15.246968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:15.246968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 431/847] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:15.252095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7fcf5-4102-4e0c-9637-e0c9924516da None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:15.358549 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7fcf5-4102-4e0c-9637-e0c9924516da None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:15.395705 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79524046-28b8-4164-a7db-baea42874109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:15.396332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79524046-28b8-4164-a7db-baea42874109 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:15.396614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79524046-28b8-4164-a7db-baea42874109 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:15.396915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79524046-28b8-4164-a7db-baea42874109 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:15.397609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79524046-28b8-4164-a7db-baea42874109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:15.397919 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79524046-28b8-4164-a7db-baea42874109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:15.399349 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79524046-28b8-4164-a7db-baea42874109 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:15.411902 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 417/848] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:15.417340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d43276-55d8-4983-8438-7fcc38a3d090 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:15.526524 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d43276-55d8-4983-8438-7fcc38a3d090 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:15.561094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fe36b-8aa4-4d25-8099-be50f77eabe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:15.561734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fe36b-8aa4-4d25-8099-be50f77eabe1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:15.562014 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fe36b-8aa4-4d25-8099-be50f77eabe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:15.562288 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fe36b-8aa4-4d25-8099-be50f77eabe1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:15.569732 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fe36b-8aa4-4d25-8099-be50f77eabe1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:15.571173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fe36b-8aa4-4d25-8099-be50f77eabe1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:15.583107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-159fe36b-8aa4-4d25-8099-be50f77eabe1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:15.583107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:15.583107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:15.583107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:15.583107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:15.583107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:15.583107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:15.583107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:15.583107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:15.583107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:15.583107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:15.583107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:15.583107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:05:15.583107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:05:15.583107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:05:15.583977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:05:15.583977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:15.583977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:15.583977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:15.583977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:15.583977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:15.583977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:15.583977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:15.583977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:15.583977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:15.583977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:15.583977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:15.583977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:15.583977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:15.583977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:15.583977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:15.583977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:15.584883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:05:15.584883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:05:15.584883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:05:15.584883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:05:15.584883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:05:15.584883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:05:15.584883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:15.584883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:15.584883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 432/849] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:15.593750 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79524046-28b8-4164-a7db-baea42874109 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:15.651882 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:15.697626 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79524046-28b8-4164-a7db-baea42874109 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:15.732422 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1065fd-24c9-4022-b3d6-ac6873bd2ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:15.733083 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1065fd-24c9-4022-b3d6-ac6873bd2ebd None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:15.733364 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1065fd-24c9-4022-b3d6-ac6873bd2ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:15.733640 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1065fd-24c9-4022-b3d6-ac6873bd2ebd None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:15.734390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1065fd-24c9-4022-b3d6-ac6873bd2ebd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:15.734697 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1065fd-24c9-4022-b3d6-ac6873bd2ebd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:15.736161 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1065fd-24c9-4022-b3d6-ac6873bd2ebd None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:15.748955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 418/850] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:05:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:15.755273 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fe36b-8aa4-4d25-8099-be50f77eabe1 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:15.783082 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:15.863826 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fe36b-8aa4-4d25-8099-be50f77eabe1 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:15.898983 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f9186-cc97-49b9-a425-4a90e24e9484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:15.899601 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f9186-cc97-49b9-a425-4a90e24e9484 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:15.899882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f9186-cc97-49b9-a425-4a90e24e9484 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:15.900152 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f9186-cc97-49b9-a425-4a90e24e9484 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:15.901050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f9186-cc97-49b9-a425-4a90e24e9484 None admin] RBAC: Adding query filter params (role.id=94ecbd6c86a84b75bdb0c57fc27a9a07, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=6c5f92f21868436a99a5c7aaa1fc40b5) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:15.901359 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f9186-cc97-49b9-a425-4a90e24e9484 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:15.902787 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f9186-cc97-49b9-a425-4a90e24e9484 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:15.909325 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 433/851] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:05:15 2022] GET /identity/v3/role_assignments?user.id=6c5f92f21868436a99a5c7aaa1fc40b5&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 610 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:15.968517 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f206a7-44d3-4426-8ce3-89ff844c0535 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:15.969583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f206a7-44d3-4426-8ce3-89ff844c0535 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:15.970088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f206a7-44d3-4426-8ce3-89ff844c0535 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:15.971956 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 419/852] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:15.978465 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16eaa26-e2fc-463e-b206-a83e5072156d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:15.979096 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16eaa26-e2fc-463e-b206-a83e5072156d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:15.979577 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16eaa26-e2fc-463e-b206-a83e5072156d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:16.001977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c16eaa26-e2fc-463e-b206-a83e5072156d None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:16.003205 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c16eaa26-e2fc-463e-b206-a83e5072156d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:16.079038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 434/853] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:15 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:16.103874 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f206a7-44d3-4426-8ce3-89ff844c0535 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:16.214379 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f206a7-44d3-4426-8ce3-89ff844c0535 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:16.231216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:16.250041 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c3320-d1fe-4cb3-a5d1-dfe8b3f41be5 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:16.251209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c3320-d1fe-4cb3-a5d1-dfe8b3f41be5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:16.251694 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c3320-d1fe-4cb3-a5d1-dfe8b3f41be5 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:16.253530 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 435/854] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:16.257723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da636e8-6562-46fd-a673-01fd291eaf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:16.258374 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da636e8-6562-46fd-a673-01fd291eaf12 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:16.258657 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da636e8-6562-46fd-a673-01fd291eaf12 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:16.258933 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da636e8-6562-46fd-a673-01fd291eaf12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:16.259561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1c84d-47a8-45b4-8918-d05324c3f026 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:16.260045 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1c84d-47a8-45b4-8918-d05324c3f026 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:16.260534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1c84d-47a8-45b4-8918-d05324c3f026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:16.270777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da636e8-6562-46fd-a673-01fd291eaf12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:05:16.275671 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-5da636e8-6562-46fd-a673-01fd291eaf12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:05:16.275671 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:16.275671 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:16.275671 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:16.275671 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:16.275671 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:16.275671 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:16.275671 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:16.275671 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:16.275671 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:16.275671 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:16.275671 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:16.275671 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:05:16.275671 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:05:16.275671 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:05:16.275671 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:05:16.276618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:05:16.276618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:05:16.276618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:05:16.276618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:05:16.276618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:16.276618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:16.276618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:16.276618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:16.276618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:16.276618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:16.276618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:16.276618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:16.276618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:16.276618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:16.276618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:16.276618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:16.277472 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:16.277472 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:16.277472 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:16.277472 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:16.277472 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:05:16.277472 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:05:16.277472 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:05:16.277472 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:05:16.277472 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:05:16.277472 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:05:16.277472 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:05:16.277472 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:16.277472 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 420/855] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:05:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:16.282825 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da636e8-6562-46fd-a673-01fd291eaf12 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:16.284875 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2dd1c84d-47a8-45b4-8918-d05324c3f026 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:16.286404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2dd1c84d-47a8-45b4-8918-d05324c3f026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:16.301814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:16.368715 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 436/856] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:16 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 16:05:16.370405 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3de2c2-1d59-4636-8de4-6e79289cf66f None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:16.370939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3de2c2-1d59-4636-8de4-6e79289cf66f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:16.371216 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3de2c2-1d59-4636-8de4-6e79289cf66f None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:16.373157 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 437/857] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:16.378696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e71169-2f59-4fe1-be9a-bcdba92cef10 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:16.378978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e71169-2f59-4fe1-be9a-bcdba92cef10 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:16.379248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e71169-2f59-4fe1-be9a-bcdba92cef10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:16.393013 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da636e8-6562-46fd-a673-01fd291eaf12 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:16.397293 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-b5e71169-2f59-4fe1-be9a-bcdba92cef10 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:16.398469 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b5e71169-2f59-4fe1-be9a-bcdba92cef10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:16.428936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb646f2-db52-4246-83e9-60883f935e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:16.429550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb646f2-db52-4246-83e9-60883f935e1b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:16.429830 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb646f2-db52-4246-83e9-60883f935e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:16.430098 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb646f2-db52-4246-83e9-60883f935e1b None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:16.430856 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb646f2-db52-4246-83e9-60883f935e1b None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:16.431158 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb646f2-db52-4246-83e9-60883f935e1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:16.432566 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb646f2-db52-4246-83e9-60883f935e1b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:16.445646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 421/858] 10.222.0.141 () {56 vars in 1108 bytes} [Tue Jul 26 16:05:16 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:16.445646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb646f2-db52-4246-83e9-60883f935e1b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:16.479061 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 438/859] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:16 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 16:05:16.479970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e71169-2f59-4fe1-be9a-bcdba92cef10 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:16.503620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:16.562535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:16.570346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb646f2-db52-4246-83e9-60883f935e1b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:16.586828 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e71169-2f59-4fe1-be9a-bcdba92cef10 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:16.605790 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a79342-2e3e-4eda-9bac-0b9c20846c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:16.606437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a79342-2e3e-4eda-9bac-0b9c20846c0a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:16.606721 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a79342-2e3e-4eda-9bac-0b9c20846c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:16.606997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a79342-2e3e-4eda-9bac-0b9c20846c0a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:16.607621 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a79342-2e3e-4eda-9bac-0b9c20846c0a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:16.609023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a79342-2e3e-4eda-9bac-0b9c20846c0a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:16.618376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-e5a79342-2e3e-4eda-9bac-0b9c20846c0a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 16:05:16.618376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:16.618376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:16.618376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:16.618376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:16.618376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:16.618376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:16.618376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:16.618376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 16:05:16.618376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:16.618376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:16.618376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:16.618376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:16.618376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:16.618376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:16.618376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:16.619403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:16.619403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:16.619403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:16.619403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:16.619403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:16.619403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:16.619403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:16.619403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:16.619403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:16.619403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:16.619403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:16.619403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:16.619403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:16.619403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:16.619403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:16.619403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:16.620265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:16.620265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:16.620265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:16.620265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:16.620265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:16.620265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:16.620265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:16.620265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:16.620265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:16.620265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:16.620265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:16.620265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:16.620265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:16.620265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 16:05:16.620265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:16.620265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 422/860] 10.222.0.141 () {56 vars in 1137 bytes} [Tue Jul 26 16:05:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:16.621175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a79342-2e3e-4eda-9bac-0b9c20846c0a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:16.631374 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6699b3b-ae59-4d6a-a7ed-214c8b736031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:16.632279 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6699b3b-ae59-4d6a-a7ed-214c8b736031 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:16.632757 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6699b3b-ae59-4d6a-a7ed-214c8b736031 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:16.633214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6699b3b-ae59-4d6a-a7ed-214c8b736031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:16.645008 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6699b3b-ae59-4d6a-a7ed-214c8b736031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:16.646770 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6699b3b-ae59-4d6a-a7ed-214c8b736031 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:16.663039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-a6699b3b-ae59-4d6a-a7ed-214c8b736031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:16.663039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:16.663039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:16.663039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:16.663039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:16.663039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:16.663039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:16.663039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:16.663039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:16.663039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:16.663039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:16.663039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:16.663039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:16.663039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:16.663039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:16.664128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:16.664128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:16.664128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:16.664128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:16.664128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:16.664128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:16.664128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:16.664128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:16.664128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:16.664128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:16.664128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:16.664128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:16.664128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:16.664128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:16.664128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:16.664128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:16.664128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:16.665051 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:16.665051 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:16.665051 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:16.665051 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:16.665759 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 439/861] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:16.666462 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6699b3b-ae59-4d6a-a7ed-214c8b736031 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:16.728914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:16.732065 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a79342-2e3e-4eda-9bac-0b9c20846c0a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:16.767034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5134f6-97b0-4a96-a4a0-ee78fd7927a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:16.767956 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5134f6-97b0-4a96-a4a0-ee78fd7927a7 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:16.768391 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5134f6-97b0-4a96-a4a0-ee78fd7927a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:16.768688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5134f6-97b0-4a96-a4a0-ee78fd7927a7 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:16.769384 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5134f6-97b0-4a96-a4a0-ee78fd7927a7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:16.770744 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5134f6-97b0-4a96-a4a0-ee78fd7927a7 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:16.773696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6699b3b-ae59-4d6a-a7ed-214c8b736031 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:16.802526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:16.807997 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668e862-e12a-421e-bbc8-312ec14e24e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:16.808602 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668e862-e12a-421e-bbc8-312ec14e24e6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:16.808906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668e862-e12a-421e-bbc8-312ec14e24e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:16.809176 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668e862-e12a-421e-bbc8-312ec14e24e6 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:16.809840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668e862-e12a-421e-bbc8-312ec14e24e6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:16.810193 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668e862-e12a-421e-bbc8-312ec14e24e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:16.811532 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668e862-e12a-421e-bbc8-312ec14e24e6 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:16.816574 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 440/862] 10.222.0.141 () {56 vars in 1131 bytes} [Tue Jul 26 16:05:16 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:16.817206 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668e862-e12a-421e-bbc8-312ec14e24e6 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:16.849588 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 423/863] 10.222.0.141 () {60 vars in 1146 bytes} [Tue Jul 26 16:05:16 2022] POST /identity/v3/services => generated 252 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:05:16.851018 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5134f6-97b0-4a96-a4a0-ee78fd7927a7 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:16.949094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668e862-e12a-421e-bbc8-312ec14e24e6 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:17.001651 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a9aca-9a74-45b9-933c-3de92744e761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:17.002387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a9aca-9a74-45b9-933c-3de92744e761 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:17.002739 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a9aca-9a74-45b9-933c-3de92744e761 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:17.003017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a9aca-9a74-45b9-933c-3de92744e761 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:17.003707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a9aca-9a74-45b9-933c-3de92744e761 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:17.004013 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a9aca-9a74-45b9-933c-3de92744e761 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:17.005405 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a9aca-9a74-45b9-933c-3de92744e761 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:17.015702 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5134f6-97b0-4a96-a4a0-ee78fd7927a7 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:17.023028 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 441/864] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:17.032101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a9aca-9a74-45b9-933c-3de92744e761 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:17.056217 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7d334-ba06-4f3a-baab-3c254686fff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:17.057433 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7d334-ba06-4f3a-baab-3c254686fff2 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:17.057721 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7d334-ba06-4f3a-baab-3c254686fff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:17.057994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7d334-ba06-4f3a-baab-3c254686fff2 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:17.058673 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7d334-ba06-4f3a-baab-3c254686fff2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:17.058977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7d334-ba06-4f3a-baab-3c254686fff2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:17.062041 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7d334-ba06-4f3a-baab-3c254686fff2 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:17.067053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 424/865] 10.222.0.141 () {56 vars in 1131 bytes} [Tue Jul 26 16:05:16 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:17.095689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:17.158037 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a9aca-9a74-45b9-933c-3de92744e761 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:17.197920 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bd47f-0870-41b5-ad6f-a47c011ad014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:17.198501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bd47f-0870-41b5-ad6f-a47c011ad014 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:17.198783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bd47f-0870-41b5-ad6f-a47c011ad014 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:17.199057 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bd47f-0870-41b5-ad6f-a47c011ad014 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:17.208008 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bd47f-0870-41b5-ad6f-a47c011ad014 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:17.209524 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bd47f-0870-41b5-ad6f-a47c011ad014 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:17.222653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-558bd47f-0870-41b5-ad6f-a47c011ad014 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 16:05:17.222653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:17.222653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:17.222653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:17.222653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:17.222653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:17.222653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:17.222653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:17.222653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:17.222653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:17.222653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:17.222653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:17.222653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:05:17.222653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:05:17.222653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:05:17.222653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:05:17.223632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:17.223632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:17.223632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:05:17.223632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:17.223632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:05:17.223632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:17.223632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:17.223632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:17.223632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:17.223632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:17.223632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:17.223632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:17.223632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:17.223632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:17.223632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:17.223632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:17.223632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:17.223632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:17.224632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:17.224632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:17.224632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:05:17.224632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:05:17.224632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:05:17.224632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:05:17.224632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:05:17.224632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:05:17.224632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 16:05:17.224632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:17.224632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 442/866] 10.222.0.141 () {56 vars in 1122 bytes} [Tue Jul 26 16:05:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:17.231799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7d334-ba06-4f3a-baab-3c254686fff2 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:17.263102 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:17.346632 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7d334-ba06-4f3a-baab-3c254686fff2 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:17.381720 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793236fc-2875-40b9-a3b0-f71f36d35eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:17.382726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793236fc-2875-40b9-a3b0-f71f36d35eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:17.383213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793236fc-2875-40b9-a3b0-f71f36d35eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:17.383679 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793236fc-2875-40b9-a3b0-f71f36d35eb2 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:17.384655 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793236fc-2875-40b9-a3b0-f71f36d35eb2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:17.385202 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793236fc-2875-40b9-a3b0-f71f36d35eb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:17.386883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793236fc-2875-40b9-a3b0-f71f36d35eb2 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:17.405170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 425/867] 10.222.0.141 () {56 vars in 1154 bytes} [Tue Jul 26 16:05:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:17.411048 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bd47f-0870-41b5-ad6f-a47c011ad014 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:17.514963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bd47f-0870-41b5-ad6f-a47c011ad014 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:17.526009 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:17.550121 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2670e-3fea-4981-bbfb-65e69bfc2a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:17.550752 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2670e-3fea-4981-bbfb-65e69bfc2a4a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:17.551033 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2670e-3fea-4981-bbfb-65e69bfc2a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:17.551307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2670e-3fea-4981-bbfb-65e69bfc2a4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:17.622320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2670e-3fea-4981-bbfb-65e69bfc2a4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:17.623787 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2670e-3fea-4981-bbfb-65e69bfc2a4a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:17.733920 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 443/868] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:05:17 2022] GET /identity/v3/auth/tokens => generated 1254 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 16:05:17.740618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793236fc-2875-40b9-a3b0-f71f36d35eb2 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:17.825697 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:17.843346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793236fc-2875-40b9-a3b0-f71f36d35eb2 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:17.879583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b684bf-ecae-4023-a02c-ec00b04b1900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:17.880223 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b684bf-ecae-4023-a02c-ec00b04b1900 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:17.880505 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b684bf-ecae-4023-a02c-ec00b04b1900 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:17.880811 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b684bf-ecae-4023-a02c-ec00b04b1900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:17.891496 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b684bf-ecae-4023-a02c-ec00b04b1900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:17.892969 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b684bf-ecae-4023-a02c-ec00b04b1900 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:17.908405 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-91b684bf-ecae-4023-a02c-ec00b04b1900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:17.908405 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:17.908405 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:17.908405 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:17.908405 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:17.908405 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:17.908405 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:17.908405 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:17.908405 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:17.908405 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:17.908405 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:17.908405 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:17.908405 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:17.908405 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:17.908405 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:17.909313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:17.909313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:17.909313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:17.909313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:17.909313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:17.909313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:17.909313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:17.909313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:17.909313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:17.909313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:17.909313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:17.909313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:17.909313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:17.909313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:17.909313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:17.909313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:17.909313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:17.910195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:17.910195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:17.910195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:17.910195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:17.910195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 426/869] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:17.915980 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2670e-3fea-4981-bbfb-65e69bfc2a4a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:17.928907 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:18.020029 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2670e-3fea-4981-bbfb-65e69bfc2a4a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:18.042598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20c46b-324c-4f6b-a9f2-f6d270825376 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:18.043138 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20c46b-324c-4f6b-a9f2-f6d270825376 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:18.043138 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20c46b-324c-4f6b-a9f2-f6d270825376 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:18.045796 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 427/870] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:05:18.050488 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b6e1a-27c5-4ec9-9755-dfd764bf412e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:18.050784 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b6e1a-27c5-4ec9-9755-dfd764bf412e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:18.051058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b6e1a-27c5-4ec9-9755-dfd764bf412e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:18.057713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2146906-0137-40f7-b4f3-e6a569f31b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:18.058532 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2146906-0137-40f7-b4f3-e6a569f31b54 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:18.058959 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2146906-0137-40f7-b4f3-e6a569f31b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:18.059379 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2146906-0137-40f7-b4f3-e6a569f31b54 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:18.060199 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2146906-0137-40f7-b4f3-e6a569f31b54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:18.060643 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2146906-0137-40f7-b4f3-e6a569f31b54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:18.062196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2146906-0137-40f7-b4f3-e6a569f31b54 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:18.070360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-277b6e1a-27c5-4ec9-9755-dfd764bf412e None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:18.072119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-277b6e1a-27c5-4ec9-9755-dfd764bf412e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:18.074719 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 444/871] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:18.081653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2146906-0137-40f7-b4f3-e6a569f31b54 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:18.154407 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 428/872] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:18 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 16:05:18.165143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:18.181241 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b6e1a-27c5-4ec9-9755-dfd764bf412e None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:18.200986 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2146906-0137-40f7-b4f3-e6a569f31b54 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:18.243717 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63567f-a85a-4864-80c8-8b2d333a3c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:18.244362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63567f-a85a-4864-80c8-8b2d333a3c85 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:18.244647 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63567f-a85a-4864-80c8-8b2d333a3c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:18.244950 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63567f-a85a-4864-80c8-8b2d333a3c85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:18.254140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63567f-a85a-4864-80c8-8b2d333a3c85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:18.255251 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:18.255995 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63567f-a85a-4864-80c8-8b2d333a3c85 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:18.269803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-2d63567f-a85a-4864-80c8-8b2d333a3c85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:18.269803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:18.269803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:18.269803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:18.269803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:18.269803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:18.269803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:18.269803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:18.269803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:18.269803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:18.269803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:18.269803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:18.269803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:05:18.269803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:05:18.269803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:05:18.270877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:05:18.270877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:18.270877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:18.270877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:18.270877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:18.270877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:18.270877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:18.270877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:18.270877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:18.270877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:18.270877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:18.270877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:18.270877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:18.270877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:18.270877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:18.270877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:18.270877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:18.271910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:05:18.271910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:05:18.271910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:05:18.271910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:05:18.271910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:05:18.271910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:05:18.271910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:18.271910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:18.278592 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 445/873] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:18.280007 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63567f-a85a-4864-80c8-8b2d333a3c85 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:18.300958 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b6e1a-27c5-4ec9-9755-dfd764bf412e None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:18.338597 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bd4e7-a066-4ccc-af10-8e04d196b880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:18.339174 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bd4e7-a066-4ccc-af10-8e04d196b880 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:18.339458 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bd4e7-a066-4ccc-af10-8e04d196b880 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:18.339734 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bd4e7-a066-4ccc-af10-8e04d196b880 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:18.340375 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bd4e7-a066-4ccc-af10-8e04d196b880 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:18.342164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bd4e7-a066-4ccc-af10-8e04d196b880 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:18.352941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-9d6bd4e7-a066-4ccc-af10-8e04d196b880 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 16:05:18.352941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:18.352941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:18.352941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:18.352941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:18.352941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:18.352941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:18.352941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:18.352941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 16:05:18.352941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:18.352941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:18.352941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:18.352941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:18.352941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:18.352941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:18.352941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:18.352941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:18.354084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:18.354084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:18.354084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:18.354084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:18.354084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:18.354084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:18.354084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:18.354084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:18.354084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:18.354084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:18.354084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:18.354084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:18.354084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:18.354084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:18.354084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:18.354084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:18.354942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:18.354942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:18.354942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:18.354942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:18.354942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:18.354942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:18.354942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:18.354942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:18.354942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:18.354942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:18.354942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:18.354942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:18.354942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 16:05:18.354942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:18.359999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 429/874] 10.222.0.141 () {56 vars in 1131 bytes} [Tue Jul 26 16:05:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:18.360944 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bd4e7-a066-4ccc-af10-8e04d196b880 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:18.397707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63567f-a85a-4864-80c8-8b2d333a3c85 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:18.428912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:18.435600 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4b93b-1ae9-4f09-960a-1d0f091bdbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:18.436477 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4b93b-1ae9-4f09-960a-1d0f091bdbe6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:18.437086 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4b93b-1ae9-4f09-960a-1d0f091bdbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:18.437584 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4b93b-1ae9-4f09-960a-1d0f091bdbe6 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:18.439110 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4b93b-1ae9-4f09-960a-1d0f091bdbe6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:18.439598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4b93b-1ae9-4f09-960a-1d0f091bdbe6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:18.441230 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4b93b-1ae9-4f09-960a-1d0f091bdbe6 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:18.460410 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 446/875] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:05:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:18.462417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4b93b-1ae9-4f09-960a-1d0f091bdbe6 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:18.471614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bd4e7-a066-4ccc-af10-8e04d196b880 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:18.499887 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:18.508561 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c8fb6-7d66-4838-876b-ec6099b3d88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:18.509218 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c8fb6-7d66-4838-876b-ec6099b3d88f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:18.509503 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c8fb6-7d66-4838-876b-ec6099b3d88f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:18.512729 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c8fb6-7d66-4838-876b-ec6099b3d88f None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:18.512729 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c8fb6-7d66-4838-876b-ec6099b3d88f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:18.512729 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c8fb6-7d66-4838-876b-ec6099b3d88f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:18.512729 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c8fb6-7d66-4838-876b-ec6099b3d88f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:18.523457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 430/876] 10.222.0.141 () {56 vars in 1127 bytes} [Tue Jul 26 16:05:18 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:18.524317 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c8fb6-7d66-4838-876b-ec6099b3d88f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:18.589406 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4b93b-1ae9-4f09-960a-1d0f091bdbe6 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:18.641150 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b9b36-50a8-44dc-b009-e61a5cff78e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:18.642417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b9b36-50a8-44dc-b009-e61a5cff78e1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:18.642702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b9b36-50a8-44dc-b009-e61a5cff78e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:18.642978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b9b36-50a8-44dc-b009-e61a5cff78e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:18.643765 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b9b36-50a8-44dc-b009-e61a5cff78e1 None admin] RBAC: Adding query filter params (role.id=6540af5baf2c4ff78d0fedfc4bea4e46, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=02af03095e48472d96a995a530e78035) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:18.644076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b9b36-50a8-44dc-b009-e61a5cff78e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:18.644993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c8fb6-7d66-4838-876b-ec6099b3d88f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:18.645527 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b9b36-50a8-44dc-b009-e61a5cff78e1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:18.660478 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 447/877] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:05:18 2022] GET /identity/v3/role_assignments?user.id=02af03095e48472d96a995a530e78035&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=6540af5baf2c4ff78d0fedfc4bea4e46 => generated 610 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:18.687865 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34082370-8b6e-4873-99c2-715074e0fe61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:18.689073 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34082370-8b6e-4873-99c2-715074e0fe61 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:18.689355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34082370-8b6e-4873-99c2-715074e0fe61 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:18.689630 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34082370-8b6e-4873-99c2-715074e0fe61 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:18.690325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34082370-8b6e-4873-99c2-715074e0fe61 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:18.690631 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34082370-8b6e-4873-99c2-715074e0fe61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:18.692036 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34082370-8b6e-4873-99c2-715074e0fe61 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:18.697956 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 431/878] 10.222.0.141 () {56 vars in 1127 bytes} [Tue Jul 26 16:05:18 2022] GET /identity/v3/services?type=object-store => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:19.064475 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35372c-77a7-4b44-b239-eb2e72d1feab None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:19.065019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35372c-77a7-4b44-b239-eb2e72d1feab None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:19.065096 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35372c-77a7-4b44-b239-eb2e72d1feab None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:19.066651 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 448/879] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:19.071801 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923a735-8fd8-4621-9b4a-44834b578edd None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:19.072225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923a735-8fd8-4621-9b4a-44834b578edd None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:19.072399 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923a735-8fd8-4621-9b4a-44834b578edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:19.091583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b923a735-8fd8-4621-9b4a-44834b578edd None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:19.092805 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b923a735-8fd8-4621-9b4a-44834b578edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:19.147027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:19.168928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 432/880] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:19 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:19.192507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35372c-77a7-4b44-b239-eb2e72d1feab None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:19.252977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:19.300329 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35372c-77a7-4b44-b239-eb2e72d1feab None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:19.311365 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4afc9-a932-46ae-9657-eab4a8802446 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:19.311649 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4afc9-a932-46ae-9657-eab4a8802446 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:19.311927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4afc9-a932-46ae-9657-eab4a8802446 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:19.314482 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 433/881] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:19.323938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec095e6a-7a55-42f7-a518-13d149dec38e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:19.324494 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec095e6a-7a55-42f7-a518-13d149dec38e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:19.325002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec095e6a-7a55-42f7-a518-13d149dec38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:19.342799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6f1cf-3d5b-43b4-bc2f-b30861942bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:19.343725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6f1cf-3d5b-43b4-bc2f-b30861942bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:19.344005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6f1cf-3d5b-43b4-bc2f-b30861942bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:19.344304 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6f1cf-3d5b-43b4-bc2f-b30861942bd2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:19.344961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6f1cf-3d5b-43b4-bc2f-b30861942bd2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:19.346328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6f1cf-3d5b-43b4-bc2f-b30861942bd2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:19.348367 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ec095e6a-7a55-42f7-a518-13d149dec38e None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:19.350446 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ec095e6a-7a55-42f7-a518-13d149dec38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:19.356535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-72f6f1cf-3d5b-43b4-bc2f-b30861942bd2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 16:05:19.356535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:19.356535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:19.356535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:19.356535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:19.356535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:19.356535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:19.356535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:19.356535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 16:05:19.356535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:19.356535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:19.356535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:19.356535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:19.356535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:19.356535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:19.356535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:19.356535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:19.363963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:19.363963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:19.363963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:19.363963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:19.363963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:19.363963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:19.363963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:19.363963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:19.363963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:19.363963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:19.363963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:19.363963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:19.363963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:19.363963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:19.363963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:19.363963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:19.364813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:19.364813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:19.364813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:19.364813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:19.364813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:19.364813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:19.364813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:19.364813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:19.364813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:19.364813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:19.364813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:19.364813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:19.364813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 16:05:19.364813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:19.364813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 449/882] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:05:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:19.365606 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6f1cf-3d5b-43b4-bc2f-b30861942bd2 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:19.440689 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 434/883] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:19 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 16:05:19.457604 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec095e6a-7a55-42f7-a518-13d149dec38e None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:19.486959 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6f1cf-3d5b-43b4-bc2f-b30861942bd2 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:19.506649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:19.525833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ec6f9-88eb-47c4-9009-a211ccbdfaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:19.526784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ec6f9-88eb-47c4-9009-a211ccbdfaff None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:19.527366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ec6f9-88eb-47c4-9009-a211ccbdfaff None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:19.527902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ec6f9-88eb-47c4-9009-a211ccbdfaff None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:19.528887 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ec6f9-88eb-47c4-9009-a211ccbdfaff None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:19.529391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ec6f9-88eb-47c4-9009-a211ccbdfaff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:19.531146 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ec6f9-88eb-47c4-9009-a211ccbdfaff None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:19.541617 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 450/884] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:05:19 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:19.542843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ec6f9-88eb-47c4-9009-a211ccbdfaff None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:19.574622 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec095e6a-7a55-42f7-a518-13d149dec38e None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:19.592338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:19.612609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206a084-1ec9-425a-ad36-e89e640e4e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:19.613330 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206a084-1ec9-425a-ad36-e89e640e4e3e None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:19.613619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206a084-1ec9-425a-ad36-e89e640e4e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:19.613945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206a084-1ec9-425a-ad36-e89e640e4e3e None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:19.614588 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206a084-1ec9-425a-ad36-e89e640e4e3e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:19.616023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206a084-1ec9-425a-ad36-e89e640e4e3e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:19.653755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ec6f9-88eb-47c4-9009-a211ccbdfaff None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:19.689921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c75b2-6dea-478b-9221-28f83277bc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:19.690588 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c75b2-6dea-478b-9221-28f83277bc16 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:19.690855 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c75b2-6dea-478b-9221-28f83277bc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:19.691129 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c75b2-6dea-478b-9221-28f83277bc16 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:19.691790 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c75b2-6dea-478b-9221-28f83277bc16 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:19.692092 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c75b2-6dea-478b-9221-28f83277bc16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:19.693511 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c75b2-6dea-478b-9221-28f83277bc16 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:19.698650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 451/885] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:05:19 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:19.704262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c75b2-6dea-478b-9221-28f83277bc16 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:19.717924 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 435/886] 10.222.0.141 () {60 vars in 1146 bytes} [Tue Jul 26 16:05:19 2022] POST /identity/v3/services => generated 270 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:05:19.771640 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:19.832063 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c75b2-6dea-478b-9221-28f83277bc16 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:19.876644 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c28d91-e357-43a5-8d49-25f45446dc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:19.877303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c28d91-e357-43a5-8d49-25f45446dc07 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:19.877637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c28d91-e357-43a5-8d49-25f45446dc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:19.877915 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c28d91-e357-43a5-8d49-25f45446dc07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:19.879143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c28d91-e357-43a5-8d49-25f45446dc07 None admin] RBAC: Adding query filter params (interface=public, service_id=d03a26c938e34fd88285beec46e3b102, region_id=RegionOne) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:19.879143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c28d91-e357-43a5-8d49-25f45446dc07 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:19.880385 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c28d91-e357-43a5-8d49-25f45446dc07 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:19.890646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 452/887] 10.222.0.141 () {56 vars in 1256 bytes} [Tue Jul 26 16:05:19 2022] GET /identity/v3/endpoints?service_id=d03a26c938e34fd88285beec46e3b102&interface=public®ion_id=RegionOne => generated 195 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:19.896423 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206a084-1ec9-425a-ad36-e89e640e4e3e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:20.003929 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206a084-1ec9-425a-ad36-e89e640e4e3e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:20.038078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b825bd-92e2-49de-a258-eabce2a86dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:20.038692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b825bd-92e2-49de-a258-eabce2a86dcb None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:20.038974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b825bd-92e2-49de-a258-eabce2a86dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:20.039250 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b825bd-92e2-49de-a258-eabce2a86dcb None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:20.039899 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b825bd-92e2-49de-a258-eabce2a86dcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:20.041301 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b825bd-92e2-49de-a258-eabce2a86dcb None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:20.048111 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 436/888] 10.222.0.141 () {56 vars in 1092 bytes} [Tue Jul 26 16:05:19 2022] GET /identity/v3/services => generated 1274 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:05:20.753227 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555aa68-4ca3-408f-8058-193ff7ed5125 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:20.753779 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555aa68-4ca3-408f-8058-193ff7ed5125 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:20.753779 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555aa68-4ca3-408f-8058-193ff7ed5125 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:20.755394 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 453/889] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:20.760838 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ce6e9-b3dd-495a-b648-e89f63eb30d6 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:20.761230 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ce6e9-b3dd-495a-b648-e89f63eb30d6 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:20.761395 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ce6e9-b3dd-495a-b648-e89f63eb30d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:20.779446 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-186ce6e9-b3dd-495a-b648-e89f63eb30d6 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:20.780641 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-186ce6e9-b3dd-495a-b648-e89f63eb30d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:20.819478 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1c651-2820-4c3f-857b-4aba28919596 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:20.819786 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1c651-2820-4c3f-857b-4aba28919596 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:20.820041 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1c651-2820-4c3f-857b-4aba28919596 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:20.821694 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 454/890] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:20.822811 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:20.833161 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec08555-19ed-4b28-bf6f-f1bd7505102d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:20.833620 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec08555-19ed-4b28-bf6f-f1bd7505102d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:20.833962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec08555-19ed-4b28-bf6f-f1bd7505102d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:20.854081 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-cec08555-19ed-4b28-bf6f-f1bd7505102d None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:20.855412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-cec08555-19ed-4b28-bf6f-f1bd7505102d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:20.857474 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 437/891] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:20 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:20.879885 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ce6e9-b3dd-495a-b648-e89f63eb30d6 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:20.954182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 455/892] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:20 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:20.978968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec08555-19ed-4b28-bf6f-f1bd7505102d None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:21.007504 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ce6e9-b3dd-495a-b648-e89f63eb30d6 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:21.017516 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:21.047367 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e9ef5-5d0b-4f55-af24-d2ea4d8e9c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:21.048524 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e9ef5-5d0b-4f55-af24-d2ea4d8e9c13 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:21.048833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e9ef5-5d0b-4f55-af24-d2ea4d8e9c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:21.049113 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e9ef5-5d0b-4f55-af24-d2ea4d8e9c13 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:21.049817 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e9ef5-5d0b-4f55-af24-d2ea4d8e9c13 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:21.051188 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e9ef5-5d0b-4f55-af24-d2ea4d8e9c13 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:21.090315 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec08555-19ed-4b28-bf6f-f1bd7505102d None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:21.117057 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 438/893] 10.222.0.141 () {60 vars in 1146 bytes} [Tue Jul 26 16:05:20 2022] POST /identity/v3/services => generated 242 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:05:21.140589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe0458-4a1e-4bdf-a25c-27f7ede47466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:21.142110 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe0458-4a1e-4bdf-a25c-27f7ede47466 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:21.142570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe0458-4a1e-4bdf-a25c-27f7ede47466 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:21.143071 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe0458-4a1e-4bdf-a25c-27f7ede47466 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:21.157494 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe0458-4a1e-4bdf-a25c-27f7ede47466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:05:21.163473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-8bbe0458-4a1e-4bdf-a25c-27f7ede47466 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 16:05:21.163473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:21.163473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:21.163473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:21.163473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:21.163473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:21.163473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:21.163473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:21.163473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:21.163473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:21.163473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:21.163473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:21.163473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:05:21.163473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:05:21.163473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:05:21.163473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:05:21.164537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:05:21.164537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:05:21.164537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:05:21.164537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:05:21.164537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:21.164537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:21.164537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:21.164537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:21.164537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:21.164537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:21.164537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:21.164537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:21.164537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:21.164537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:21.164537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:21.164537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:21.165460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:21.165460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:21.165460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:21.165460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:21.165460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:05:21.165460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:05:21.165460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:05:21.165460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:05:21.165460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:05:21.165460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:05:21.165460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 16:05:21.165460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:21.172875 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 456/894] 10.222.0.141 () {56 vars in 1125 bytes} [Tue Jul 26 16:05:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:21.175348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e9ef5-5d0b-4f55-af24-d2ea4d8e9c13 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:21.212086 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:21.288799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e9ef5-5d0b-4f55-af24-d2ea4d8e9c13 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:21.325838 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbdb43-1d61-47bd-a6c4-c7d2431d19c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:21.326705 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbdb43-1d61-47bd-a6c4-c7d2431d19c4 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:21.327138 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbdb43-1d61-47bd-a6c4-c7d2431d19c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:21.327587 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbdb43-1d61-47bd-a6c4-c7d2431d19c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:21.328478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbdb43-1d61-47bd-a6c4-c7d2431d19c4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:21.328983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbdb43-1d61-47bd-a6c4-c7d2431d19c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:21.330500 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbdb43-1d61-47bd-a6c4-c7d2431d19c4 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:21.343648 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 439/895] 10.222.0.141 () {56 vars in 1120 bytes} [Tue Jul 26 16:05:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:21.345240 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe0458-4a1e-4bdf-a25c-27f7ede47466 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:21.444500 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:21.453954 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe0458-4a1e-4bdf-a25c-27f7ede47466 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:21.490976 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793e163-58bd-48a2-9da7-2cb3d8c24c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:21.491868 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793e163-58bd-48a2-9da7-2cb3d8c24c90 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:21.492326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793e163-58bd-48a2-9da7-2cb3d8c24c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:21.492791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793e163-58bd-48a2-9da7-2cb3d8c24c90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:21.503995 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793e163-58bd-48a2-9da7-2cb3d8c24c90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:21.505692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793e163-58bd-48a2-9da7-2cb3d8c24c90 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:21.521334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-a793e163-58bd-48a2-9da7-2cb3d8c24c90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:21.521334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:21.521334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:21.521334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:21.521334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:21.521334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:21.521334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:21.521334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:21.521334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:21.521334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:21.521334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:21.521334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:21.521334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:21.521334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:21.521334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:21.522447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:21.522447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:21.522447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:21.522447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:21.522447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:21.522447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:21.522447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:21.522447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:21.522447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:21.522447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:21.522447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:21.522447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:21.522447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:21.522447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:21.522447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:21.522447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:21.522447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:21.523534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:21.523534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:21.523534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:21.523534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:21.528765 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 457/896] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:21.531322 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbdb43-1d61-47bd-a6c4-c7d2431d19c4 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:21.628560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:21.637693 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbdb43-1d61-47bd-a6c4-c7d2431d19c4 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:21.673657 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88867ee1-dc93-4b11-b82a-227a7e335d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:21.674437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88867ee1-dc93-4b11-b82a-227a7e335d18 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:21.674836 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88867ee1-dc93-4b11-b82a-227a7e335d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:21.675208 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88867ee1-dc93-4b11-b82a-227a7e335d18 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:21.675993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88867ee1-dc93-4b11-b82a-227a7e335d18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:21.676394 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88867ee1-dc93-4b11-b82a-227a7e335d18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:21.677897 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88867ee1-dc93-4b11-b82a-227a7e335d18 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:21.690454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 440/897] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:21.696105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793e163-58bd-48a2-9da7-2cb3d8c24c90 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:21.808045 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793e163-58bd-48a2-9da7-2cb3d8c24c90 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:21.845222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3517d-cd4f-4fb1-897e-889cd17014c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:21.846110 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3517d-cd4f-4fb1-897e-889cd17014c1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:21.846540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3517d-cd4f-4fb1-897e-889cd17014c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:21.846962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3517d-cd4f-4fb1-897e-889cd17014c1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:21.855099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3517d-cd4f-4fb1-897e-889cd17014c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:21.856758 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3517d-cd4f-4fb1-897e-889cd17014c1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:21.868692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-8ac3517d-cd4f-4fb1-897e-889cd17014c1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 16:05:21.868692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:21.868692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:21.868692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:21.868692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:21.868692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:21.868692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:21.868692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:21.868692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:21.868692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:21.868692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:21.868692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:21.868692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:05:21.868692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:05:21.868692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:05:21.868692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:05:21.869856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:21.869856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:21.869856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:05:21.869856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:21.869856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:05:21.869856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:21.869856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:21.869856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:21.869856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:21.869856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:21.869856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:21.869856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:21.869856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:21.869856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:21.869856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:21.869856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:21.869856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:21.869856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:21.870978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:21.870978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:21.870978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:05:21.870978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:05:21.870978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:05:21.870978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:05:21.870978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:05:21.870978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:05:21.870978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 16:05:21.870978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:21.876762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 458/898] 10.222.0.141 () {56 vars in 1122 bytes} [Tue Jul 26 16:05:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:21.879308 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88867ee1-dc93-4b11-b82a-227a7e335d18 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:21.945803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e95768-2a13-466a-96bc-e41576a84979 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:21.946096 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e95768-2a13-466a-96bc-e41576a84979 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:21.946380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e95768-2a13-466a-96bc-e41576a84979 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:21.947982 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 459/899] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:05:21.952969 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a808dbe-d165-4fb6-ad8c-66b46e951869 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:21.953256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a808dbe-d165-4fb6-ad8c-66b46e951869 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:21.954072 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a808dbe-d165-4fb6-ad8c-66b46e951869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:21.962251 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:21.974198 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-4a808dbe-d165-4fb6-ad8c-66b46e951869 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:21.975466 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4a808dbe-d165-4fb6-ad8c-66b46e951869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:22.005082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88867ee1-dc93-4b11-b82a-227a7e335d18 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:22.044168 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665268f-bc70-4c62-a411-3b555fd7e34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:22.044904 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665268f-bc70-4c62-a411-3b555fd7e34f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:22.045193 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665268f-bc70-4c62-a411-3b555fd7e34f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:22.045470 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665268f-bc70-4c62-a411-3b555fd7e34f None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:22.046264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665268f-bc70-4c62-a411-3b555fd7e34f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:22.046572 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665268f-bc70-4c62-a411-3b555fd7e34f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:22.049350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665268f-bc70-4c62-a411-3b555fd7e34f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:22.072149 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 441/900] 10.222.0.141 () {56 vars in 1154 bytes} [Tue Jul 26 16:05:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:22.076802 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 460/901] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:21 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 16:05:22.077804 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665268f-bc70-4c62-a411-3b555fd7e34f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:22.085787 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f0536-0e63-4cd0-ba21-441e42c38520 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:22.086362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f0536-0e63-4cd0-ba21-441e42c38520 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:22.086845 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f0536-0e63-4cd0-ba21-441e42c38520 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:22.088921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 461/902] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:22 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:22.094872 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53031dc7-c8fa-4a6d-b528-f776e41efab9 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:22.095422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53031dc7-c8fa-4a6d-b528-f776e41efab9 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:22.095879 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53031dc7-c8fa-4a6d-b528-f776e41efab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:22.097311 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:22.115772 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-53031dc7-c8fa-4a6d-b528-f776e41efab9 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:22.117005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-53031dc7-c8fa-4a6d-b528-f776e41efab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:22.189988 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665268f-bc70-4c62-a411-3b555fd7e34f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:22.204790 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 462/903] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:22 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 16:05:22.206565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53031dc7-c8fa-4a6d-b528-f776e41efab9 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:22.226667 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a88960-d617-46fc-b746-277e2e89ad5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:22.227539 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a88960-d617-46fc-b746-277e2e89ad5f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:22.227975 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a88960-d617-46fc-b746-277e2e89ad5f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:22.228399 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a88960-d617-46fc-b746-277e2e89ad5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:22.273524 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:22.304418 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a88960-d617-46fc-b746-277e2e89ad5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:22.306245 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a88960-d617-46fc-b746-277e2e89ad5f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:22.314751 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53031dc7-c8fa-4a6d-b528-f776e41efab9 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:22.324699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:22.357970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afd720-33c3-4e0e-8868-a6a74d91ae00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:22.358621 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afd720-33c3-4e0e-8868-a6a74d91ae00 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:22.358900 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afd720-33c3-4e0e-8868-a6a74d91ae00 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:22.359174 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afd720-33c3-4e0e-8868-a6a74d91ae00 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:22.360373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afd720-33c3-4e0e-8868-a6a74d91ae00 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:22.361798 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afd720-33c3-4e0e-8868-a6a74d91ae00 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:22.371257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-d7afd720-33c3-4e0e-8868-a6a74d91ae00 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 16:05:22.371257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:22.371257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:22.371257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:22.371257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:22.371257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:22.371257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:22.371257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:22.371257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 16:05:22.371257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:22.371257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:22.371257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:22.371257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:22.371257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:22.371257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:22.371257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:22.372375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:22.372375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:22.372375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:22.372375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:22.372375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:22.372375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:22.372375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:22.372375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:22.372375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:22.372375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:22.372375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:22.372375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:22.372375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:22.372375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:22.372375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:22.372375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:22.373528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:22.373528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:22.373528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:22.373528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:22.373528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:22.373528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:22.373528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:22.373528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:22.373528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:22.373528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:22.373528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:22.373528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:22.373528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:22.373528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 16:05:22.373528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:22.377295 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 463/904] 10.222.0.141 () {56 vars in 1137 bytes} [Tue Jul 26 16:05:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:22.378115 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afd720-33c3-4e0e-8868-a6a74d91ae00 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:22.426986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 442/905] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:05:22 2022] GET /identity/v3/auth/tokens => generated 1466 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 16:05:22.426986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a88960-d617-46fc-b746-277e2e89ad5f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:22.492093 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afd720-33c3-4e0e-8868-a6a74d91ae00 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:22.520554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:22.529030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f16aa-b88d-4a00-bc1e-4555a6a265e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:22.529667 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f16aa-b88d-4a00-bc1e-4555a6a265e5 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:22.529958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f16aa-b88d-4a00-bc1e-4555a6a265e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:22.537583 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f16aa-b88d-4a00-bc1e-4555a6a265e5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:22.537583 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f16aa-b88d-4a00-bc1e-4555a6a265e5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:22.537583 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f16aa-b88d-4a00-bc1e-4555a6a265e5 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:22.537801 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a88960-d617-46fc-b746-277e2e89ad5f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:22.541962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-215f16aa-b88d-4a00-bc1e-4555a6a265e5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 16:05:22.541962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:22.541962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:22.541962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:22.541962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:22.541962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:22.541962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:22.541962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:22.541962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 16:05:22.541962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:22.541962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:22.541962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:22.541962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:22.541962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:22.541962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:22.541962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:22.541962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:22.542895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:22.542895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:22.542895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:22.542895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:22.542895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:22.542895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:22.542895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:22.542895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:22.542895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:22.542895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:22.542895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:22.542895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:22.542895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:22.542895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:22.542895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:22.542895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:22.549782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:22.549782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:22.549782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:22.549782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:22.549782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:22.549782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:22.549782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:22.549782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:22.549782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:22.549782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:22.549782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:22.549782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:22.549782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 16:05:22.549782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:22.549782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 464/906] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:05:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:22.550614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f16aa-b88d-4a00-bc1e-4555a6a265e5 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:22.554585 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:22.578313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccccb07-82bb-4025-84cb-bf55bd5f3e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:22.579549 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccccb07-82bb-4025-84cb-bf55bd5f3e98 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:22.579824 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccccb07-82bb-4025-84cb-bf55bd5f3e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:22.580111 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccccb07-82bb-4025-84cb-bf55bd5f3e98 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:22.580830 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccccb07-82bb-4025-84cb-bf55bd5f3e98 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:22.581132 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccccb07-82bb-4025-84cb-bf55bd5f3e98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:22.582755 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccccb07-82bb-4025-84cb-bf55bd5f3e98 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:22.589043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 443/907] 10.222.0.141 () {56 vars in 1131 bytes} [Tue Jul 26 16:05:22 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:22.590089 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccccb07-82bb-4025-84cb-bf55bd5f3e98 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:22.658502 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f16aa-b88d-4a00-bc1e-4555a6a265e5 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:22.697032 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0e9a9-0254-43cb-b6a6-084c64b78846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:22.697293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccccb07-82bb-4025-84cb-bf55bd5f3e98 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:22.697903 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0e9a9-0254-43cb-b6a6-084c64b78846 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:22.698192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0e9a9-0254-43cb-b6a6-084c64b78846 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:22.698470 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0e9a9-0254-43cb-b6a6-084c64b78846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:22.709130 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0e9a9-0254-43cb-b6a6-084c64b78846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:22.710579 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0e9a9-0254-43cb-b6a6-084c64b78846 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:22.729290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-b6d0e9a9-0254-43cb-b6a6-084c64b78846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:22.729290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:22.729290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:22.729290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:22.729290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:22.729290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:22.729290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:22.729290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:22.729290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:22.729290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:22.729290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:22.729290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:22.729290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:22.729290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:22.729290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:22.730222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:22.730222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:22.730222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:22.730222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:22.730222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:22.730222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:22.730222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:22.730222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:22.730222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:22.730222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:22.730222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:22.730222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:22.730222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:22.730222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:22.730222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:22.730222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:22.730222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:22.731111 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:22.731111 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:22.731111 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:22.731111 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:22.731111 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 465/908] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:22.732167 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0e9a9-0254-43cb-b6a6-084c64b78846 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:22.737528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29b7bb-1cb2-4d64-abe4-326798d8ef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:22.738140 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29b7bb-1cb2-4d64-abe4-326798d8ef48 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:22.738422 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29b7bb-1cb2-4d64-abe4-326798d8ef48 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:22.738709 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29b7bb-1cb2-4d64-abe4-326798d8ef48 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:22.739435 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29b7bb-1cb2-4d64-abe4-326798d8ef48 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:22.739741 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29b7bb-1cb2-4d64-abe4-326798d8ef48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:22.741154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29b7bb-1cb2-4d64-abe4-326798d8ef48 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:22.751599 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 444/909] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:05:22 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:22.752400 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29b7bb-1cb2-4d64-abe4-326798d8ef48 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:22.781581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:22.796173 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:22.838703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0e9a9-0254-43cb-b6a6-084c64b78846 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:22.862603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29b7bb-1cb2-4d64-abe4-326798d8ef48 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:22.874337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85dbd28-a74a-41f1-9c44-386c74447334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:22.874985 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dbd28-a74a-41f1-9c44-386c74447334 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:22.875292 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dbd28-a74a-41f1-9c44-386c74447334 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:22.876150 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dbd28-a74a-41f1-9c44-386c74447334 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:22.876933 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85dbd28-a74a-41f1-9c44-386c74447334 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:22.877241 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85dbd28-a74a-41f1-9c44-386c74447334 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:22.878756 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85dbd28-a74a-41f1-9c44-386c74447334 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:22.888330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 466/910] 10.222.0.141 () {56 vars in 1131 bytes} [Tue Jul 26 16:05:22 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:22.888330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85dbd28-a74a-41f1-9c44-386c74447334 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:22.903695 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a8744-e5da-4c01-8854-8465691b1ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:22.904875 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a8744-e5da-4c01-8854-8465691b1ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:22.905412 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a8744-e5da-4c01-8854-8465691b1ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:22.905685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a8744-e5da-4c01-8854-8465691b1ad5 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:22.906393 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a8744-e5da-4c01-8854-8465691b1ad5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:22.906774 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a8744-e5da-4c01-8854-8465691b1ad5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:22.908146 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a8744-e5da-4c01-8854-8465691b1ad5 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:22.921535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 445/911] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:22.923444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a8744-e5da-4c01-8854-8465691b1ad5 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:22.996793 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85dbd28-a74a-41f1-9c44-386c74447334 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:23.005949 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:23.032438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:23.034666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2532f-8565-477e-977f-6312a08fa58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:23.035298 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2532f-8565-477e-977f-6312a08fa58e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:23.035578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2532f-8565-477e-977f-6312a08fa58e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:23.035851 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2532f-8565-477e-977f-6312a08fa58e None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:23.036306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a8744-e5da-4c01-8854-8465691b1ad5 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:23.036531 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2532f-8565-477e-977f-6312a08fa58e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:23.036875 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2532f-8565-477e-977f-6312a08fa58e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:23.038425 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2532f-8565-477e-977f-6312a08fa58e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:23.050641 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 467/912] 10.222.0.141 () {56 vars in 1119 bytes} [Tue Jul 26 16:05:22 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:23.050641 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2532f-8565-477e-977f-6312a08fa58e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:23.073596 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7968975-4acd-4440-a114-12dac3a1367b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:23.074214 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7968975-4acd-4440-a114-12dac3a1367b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:23.074498 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7968975-4acd-4440-a114-12dac3a1367b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:23.075012 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7968975-4acd-4440-a114-12dac3a1367b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:23.075516 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7968975-4acd-4440-a114-12dac3a1367b None admin] RBAC: Adding query filter params (interface=public, service_id=b062cc04446446748e8ade795643e392, region_id=RegionOne) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:23.075823 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7968975-4acd-4440-a114-12dac3a1367b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:23.077225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7968975-4acd-4440-a114-12dac3a1367b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:23.087181 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 446/913] 10.222.0.141 () {56 vars in 1256 bytes} [Tue Jul 26 16:05:22 2022] GET /identity/v3/endpoints?service_id=b062cc04446446748e8ade795643e392&interface=public®ion_id=RegionOne => generated 195 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:23.087181 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7968975-4acd-4440-a114-12dac3a1367b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:23.156161 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2532f-8565-477e-977f-6312a08fa58e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:23.192757 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb00d17-e09f-4246-853c-507638629b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:23.193397 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb00d17-e09f-4246-853c-507638629b8d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:23.193675 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb00d17-e09f-4246-853c-507638629b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:23.193987 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb00d17-e09f-4246-853c-507638629b8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:23.194703 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7968975-4acd-4440-a114-12dac3a1367b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:23.201601 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb00d17-e09f-4246-853c-507638629b8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:23.203065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb00d17-e09f-4246-853c-507638629b8d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:23.214801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-1cb00d17-e09f-4246-853c-507638629b8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:23.214801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:23.214801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:23.214801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:23.214801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:23.214801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:23.214801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:23.214801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:23.214801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:23.214801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:23.214801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:23.214801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:23.214801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:05:23.214801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:05:23.214801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:05:23.215703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:05:23.215703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:23.215703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:23.215703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:23.215703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:23.215703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:23.215703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:23.215703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:23.215703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:23.215703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:23.215703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:23.215703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:23.215703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:23.215703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:23.215703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:23.215703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:23.215703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:23.216603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:05:23.216603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:05:23.216603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:05:23.216603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:05:23.216603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:05:23.216603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:05:23.216603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:23.216603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:23.216603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 468/914] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:23.217150 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb00d17-e09f-4246-853c-507638629b8d None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:23.236216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980f3cc-132b-4310-bfe0-9dbfb6376763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:23.236881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980f3cc-132b-4310-bfe0-9dbfb6376763 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:23.237171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980f3cc-132b-4310-bfe0-9dbfb6376763 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:23.237448 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980f3cc-132b-4310-bfe0-9dbfb6376763 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:23.238161 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980f3cc-132b-4310-bfe0-9dbfb6376763 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:23.239539 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980f3cc-132b-4310-bfe0-9dbfb6376763 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:23.252403 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:23.316801 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 447/915] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:05:23 2022] POST /identity/v3/endpoints => generated 348 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:05:23.316801 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980f3cc-132b-4310-bfe0-9dbfb6376763 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:23.320075 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb00d17-e09f-4246-853c-507638629b8d None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:23.343296 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:23.372529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c55911-145c-4e64-8693-3a9df2c7304f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:23.373196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c55911-145c-4e64-8693-3a9df2c7304f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:23.373481 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c55911-145c-4e64-8693-3a9df2c7304f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:23.373759 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c55911-145c-4e64-8693-3a9df2c7304f None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:23.374419 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c55911-145c-4e64-8693-3a9df2c7304f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:23.376577 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c55911-145c-4e64-8693-3a9df2c7304f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:23.390782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 469/916] 10.222.0.141 () {56 vars in 1092 bytes} [Tue Jul 26 16:05:23 2022] GET /identity/v3/services => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:05:23.390782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb0b50-dbe5-4405-acd8-c4a76b8254a3 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:23.390782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb0b50-dbe5-4405-acd8-c4a76b8254a3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:23.390782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb0b50-dbe5-4405-acd8-c4a76b8254a3 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:23.390782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 470/917] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:23.396696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252356e-7dce-4ea8-a90c-5f8d518e13dd None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:23.396696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252356e-7dce-4ea8-a90c-5f8d518e13dd None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:23.396696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252356e-7dce-4ea8-a90c-5f8d518e13dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:23.413639 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-7252356e-7dce-4ea8-a90c-5f8d518e13dd None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:23.414904 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7252356e-7dce-4ea8-a90c-5f8d518e13dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:23.465439 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980f3cc-132b-4310-bfe0-9dbfb6376763 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:23.510731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 471/918] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:23 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 16:05:23.524691 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f4b41-0663-4ad0-8f51-2e78a58c2d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:23.525342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f4b41-0663-4ad0-8f51-2e78a58c2d53 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:23.525626 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f4b41-0663-4ad0-8f51-2e78a58c2d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:23.525925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f4b41-0663-4ad0-8f51-2e78a58c2d53 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:23.526689 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f4b41-0663-4ad0-8f51-2e78a58c2d53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:23.526994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f4b41-0663-4ad0-8f51-2e78a58c2d53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:23.528450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f4b41-0663-4ad0-8f51-2e78a58c2d53 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:23.533329 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252356e-7dce-4ea8-a90c-5f8d518e13dd None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:23.545395 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 448/919] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:05:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:23.553354 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f4b41-0663-4ad0-8f51-2e78a58c2d53 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:23.564764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:23.653387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252356e-7dce-4ea8-a90c-5f8d518e13dd None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:23.655649 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:23.684797 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f4b41-0663-4ad0-8f51-2e78a58c2d53 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:23.692791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768aade-4986-41cc-9ed5-16d1c141850e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:23.693439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768aade-4986-41cc-9ed5-16d1c141850e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:23.694819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768aade-4986-41cc-9ed5-16d1c141850e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:23.695097 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768aade-4986-41cc-9ed5-16d1c141850e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:23.695728 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768aade-4986-41cc-9ed5-16d1c141850e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:23.697961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768aade-4986-41cc-9ed5-16d1c141850e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:23.710076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-f768aade-4986-41cc-9ed5-16d1c141850e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 16:05:23.710076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:23.710076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:23.710076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:23.710076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:23.710076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:23.710076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:23.710076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:23.710076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 16:05:23.710076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:23.710076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:23.710076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:23.710076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:23.710076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:23.710076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:23.710076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:23.710076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:23.712645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:23.712645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:23.712645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:23.712645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:23.712645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:23.712645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:23.712645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:23.712645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:23.712645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:23.712645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:23.712645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:23.712645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:23.712645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:23.712645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:23.712645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:23.712645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:23.714682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:23.714682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:23.714682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:23.714682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:23.714682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:23.714682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:23.714682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:23.714682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:23.714682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:23.714682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:23.714682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:23.714682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:23.714682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 16:05:23.714682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:23.714682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 472/920] 10.222.0.141 () {56 vars in 1131 bytes} [Tue Jul 26 16:05:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:23.718048 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768aade-4986-41cc-9ed5-16d1c141850e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:23.733271 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b18e7e-b6a6-4685-bb82-9c2746e71510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:23.733890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b18e7e-b6a6-4685-bb82-9c2746e71510 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:23.734199 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b18e7e-b6a6-4685-bb82-9c2746e71510 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:23.735272 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b18e7e-b6a6-4685-bb82-9c2746e71510 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:23.736107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b18e7e-b6a6-4685-bb82-9c2746e71510 None admin] RBAC: Adding query filter params (role.id=7b1cae16e1ba4a1c8c57b844e944c8a5, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=02af03095e48472d96a995a530e78035) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:23.736987 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b18e7e-b6a6-4685-bb82-9c2746e71510 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:23.738757 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b18e7e-b6a6-4685-bb82-9c2746e71510 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:23.746592 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 449/921] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:05:23 2022] GET /identity/v3/role_assignments?user.id=02af03095e48472d96a995a530e78035&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=7b1cae16e1ba4a1c8c57b844e944c8a5 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:23.822437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:23.839201 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768aade-4986-41cc-9ed5-16d1c141850e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:23.877910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd0d95-8eba-47de-ac59-2aabad54efc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:23.878600 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd0d95-8eba-47de-ac59-2aabad54efc4 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:23.878882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd0d95-8eba-47de-ac59-2aabad54efc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:23.879155 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd0d95-8eba-47de-ac59-2aabad54efc4 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:23.879845 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd0d95-8eba-47de-ac59-2aabad54efc4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:23.880150 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd0d95-8eba-47de-ac59-2aabad54efc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:23.881573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd0d95-8eba-47de-ac59-2aabad54efc4 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:23.887731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 473/922] 10.222.0.141 () {56 vars in 1127 bytes} [Tue Jul 26 16:05:23 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:23.894237 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b18e7e-b6a6-4685-bb82-9c2746e71510 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:24.012378 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b18e7e-b6a6-4685-bb82-9c2746e71510 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:24.047923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407868e9-6b25-44af-9283-7cc51f3cb1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:24.048930 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407868e9-6b25-44af-9283-7cc51f3cb1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:24.049429 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407868e9-6b25-44af-9283-7cc51f3cb1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:24.049893 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407868e9-6b25-44af-9283-7cc51f3cb1a4 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:24.050747 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407868e9-6b25-44af-9283-7cc51f3cb1a4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:24.051242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407868e9-6b25-44af-9283-7cc51f3cb1a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:24.052830 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407868e9-6b25-44af-9283-7cc51f3cb1a4 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:24.058395 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 450/923] 10.222.0.141 () {56 vars in 1127 bytes} [Tue Jul 26 16:05:23 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:24.064904 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd0d95-8eba-47de-ac59-2aabad54efc4 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:24.171659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd0d95-8eba-47de-ac59-2aabad54efc4 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:24.208048 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a7e42-c425-45d5-a164-f76e66735886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:24.208588 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a7e42-c425-45d5-a164-f76e66735886 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:24.208908 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a7e42-c425-45d5-a164-f76e66735886 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:24.209188 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a7e42-c425-45d5-a164-f76e66735886 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:24.209946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a7e42-c425-45d5-a164-f76e66735886 None admin] RBAC: Adding query filter params (interface=public, service_id=9f032b8c4ef24b90a0b32ce560edf454, region_id=RegionOne) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:24.210257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a7e42-c425-45d5-a164-f76e66735886 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:24.211626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a7e42-c425-45d5-a164-f76e66735886 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:24.217224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 474/924] 10.222.0.141 () {56 vars in 1256 bytes} [Tue Jul 26 16:05:24 2022] GET /identity/v3/endpoints?service_id=9f032b8c4ef24b90a0b32ce560edf454&interface=public®ion_id=RegionOne => generated 195 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:24.222596 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407868e9-6b25-44af-9283-7cc51f3cb1a4 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:24.235340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:24.326528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407868e9-6b25-44af-9283-7cc51f3cb1a4 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:24.360426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ed7e2-5d35-40ba-8755-7345ff7abf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:24.361386 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ed7e2-5d35-40ba-8755-7345ff7abf99 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:24.361861 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ed7e2-5d35-40ba-8755-7345ff7abf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:24.362328 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ed7e2-5d35-40ba-8755-7345ff7abf99 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:24.363157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ed7e2-5d35-40ba-8755-7345ff7abf99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:24.364717 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ed7e2-5d35-40ba-8755-7345ff7abf99 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:24.371338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 451/925] 10.222.0.141 () {56 vars in 1092 bytes} [Tue Jul 26 16:05:24 2022] GET /identity/v3/services => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:05:25.465963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47e186-db55-4fbb-86b1-1510a12b91ad None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:25.466483 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47e186-db55-4fbb-86b1-1510a12b91ad None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:25.466561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47e186-db55-4fbb-86b1-1510a12b91ad None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:25.468186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 475/926] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:25.473368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4424b5-930d-4871-8554-999438cecbfd None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:25.473806 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4424b5-930d-4871-8554-999438cecbfd None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:25.473980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4424b5-930d-4871-8554-999438cecbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:25.493087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ee4424b5-930d-4871-8554-999438cecbfd None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:25.494324 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ee4424b5-930d-4871-8554-999438cecbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:25.511721 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ed27e-ca62-478b-b46d-f7eab4ba2913 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:25.512007 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ed27e-ca62-478b-b46d-f7eab4ba2913 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:25.512284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ed27e-ca62-478b-b46d-f7eab4ba2913 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:25.513898 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 476/927] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:05:25.520851 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e29b89-2f07-4ca3-aad2-4d07de2829aa None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:25.521138 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e29b89-2f07-4ca3-aad2-4d07de2829aa None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:25.521418 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e29b89-2f07-4ca3-aad2-4d07de2829aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:25.540635 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-74e29b89-2f07-4ca3-aad2-4d07de2829aa None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:25.541869 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-74e29b89-2f07-4ca3-aad2-4d07de2829aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:25.552988 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:25.572389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:25.587919 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 452/928] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:25 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:25.605500 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4424b5-930d-4871-8554-999438cecbfd None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:25.620171 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 477/929] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:25 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 16:05:25.644222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e29b89-2f07-4ca3-aad2-4d07de2829aa None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:25.736934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4424b5-930d-4871-8554-999438cecbfd None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:25.773326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e29b89-2f07-4ca3-aad2-4d07de2829aa None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:25.776769 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746033b-4d51-4ab0-ad3b-330be24e3119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:25.777394 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746033b-4d51-4ab0-ad3b-330be24e3119 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:25.777676 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746033b-4d51-4ab0-ad3b-330be24e3119 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:25.777951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746033b-4d51-4ab0-ad3b-330be24e3119 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:25.778622 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746033b-4d51-4ab0-ad3b-330be24e3119 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:25.780069 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746033b-4d51-4ab0-ad3b-330be24e3119 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:25.782965 dv-cinder-851042-1-smb devstack@keystone.service[80602]: WARNING keystone.server.flask.common [None req-5746033b-4d51-4ab0-ad3b-330be24e3119 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 26 16:05:25.808301 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0be15-c6af-4f70-9b18-34ca5cba82e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:25.808974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0be15-c6af-4f70-9b18-34ca5cba82e2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:25.816709 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0be15-c6af-4f70-9b18-34ca5cba82e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:25.816709 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0be15-c6af-4f70-9b18-34ca5cba82e2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:25.816709 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0be15-c6af-4f70-9b18-34ca5cba82e2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:25.816709 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0be15-c6af-4f70-9b18-34ca5cba82e2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:25.820816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-a8f0be15-c6af-4f70-9b18-34ca5cba82e2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 16:05:25.820816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:25.820816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:25.820816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:25.820816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:25.820816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:25.820816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:25.820816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:25.820816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 16:05:25.820816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:25.820816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:25.820816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:25.820816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:25.820816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:25.820816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:25.820816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:25.821816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:25.821816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:25.821816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:25.821816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:25.821816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:25.821816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:25.821816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:25.821816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:25.821816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:25.821816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:25.821816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:25.821816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:25.821816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:25.821816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:25.821816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:25.821816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:25.822674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:25.822674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:25.822674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:25.822674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:25.822674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:25.822674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:25.822674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:25.822674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:25.822674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:25.822674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:25.822674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:25.822674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:25.822674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:25.822674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 16:05:25.822674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:25.822674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 478/930] 10.222.0.141 () {56 vars in 1137 bytes} [Tue Jul 26 16:05:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:25.823502 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbae562-8e31-4bd6-a981-fabb1b3d2aae None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:25.823502 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbae562-8e31-4bd6-a981-fabb1b3d2aae None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:25.823929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbae562-8e31-4bd6-a981-fabb1b3d2aae None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:25.828703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 479/931] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:25.828703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbae562-8e31-4bd6-a981-fabb1b3d2aae None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:25.833963 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.sql.core [None req-5746033b-4d51-4ab0-ad3b-330be24e3119 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 16:05:25.833963 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 16:05:25.833963 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [parameters: {'id': 'a3fe71887f624eeaa6ddd5e99352c0de', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 16:05:25.833963 dv-cinder-851042-1-smb devstack@keystone.service[80602]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80602) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 16:05:25.838787 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:25.852255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-5746033b-4d51-4ab0-ad3b-330be24e3119 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a3fe71887f624eeaa6ddd5e99352c0de.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a3fe71887f624eeaa6ddd5e99352c0de. Jul 26 16:05:25.852255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:25.852255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 16:05:25.852255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 16:05:25.852255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 16:05:25.852255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 16:05:25.852255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 16:05:25.852255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 16:05:25.852255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 16:05:25.852255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application conn.query(q) Jul 26 16:05:25.852255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 16:05:25.852255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 16:05:25.852255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 16:05:25.853325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application result.read() Jul 26 16:05:25.853325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 16:05:25.853325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 16:05:25.853325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 16:05:25.853325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 16:05:25.853325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 16:05:25.853325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 16:05:25.853325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 16:05:25.853325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 16:05:25.853325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 16:05:25.853325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:25.853325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 16:05:25.853325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:25.853325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:25.853325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 16:05:25.853325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 16:05:25.853325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 26 16:05:25.853325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 26 16:05:25.854290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 16:05:25.854290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application next(self.gen) Jul 26 16:05:25.854290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 16:05:25.854290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application yield resource Jul 26 16:05:25.854290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 16:05:25.854290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application next(self.gen) Jul 26 16:05:25.854290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 16:05:25.854290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 16:05:25.854290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 16:05:25.854290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 16:05:25.854290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 16:05:25.854290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise self.value Jul 26 16:05:25.854290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 16:05:25.854290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 16:05:25.854290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 16:05:25.854290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application session.commit() Jul 26 16:05:25.854290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 16:05:25.855164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 16:05:25.855164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 16:05:25.855164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 16:05:25.855164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 16:05:25.855164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self.session.flush() Jul 26 16:05:25.855164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 16:05:25.855164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 16:05:25.855164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 16:05:25.855164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 16:05:25.855164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 16:05:25.855164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application compat.raise_( Jul 26 16:05:25.855164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 16:05:25.855164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception Jul 26 16:05:25.855164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 16:05:25.855164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 16:05:25.855164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 16:05:25.855164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 16:05:25.856023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 16:05:25.856023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 16:05:25.856023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 16:05:25.856023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 16:05:25.856023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 16:05:25.856023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 16:05:25.856023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 16:05:25.856023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 16:05:25.856023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 16:05:25.856023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 16:05:25.856023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 16:05:25.856023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 16:05:25.856023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 16:05:25.856023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 16:05:25.856023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 16:05:25.858282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 16:05:25.858282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 16:05:25.858282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception Jul 26 16:05:25.858282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 16:05:25.858282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 16:05:25.858282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 16:05:25.858282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 16:05:25.858282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 16:05:25.858282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 16:05:25.858282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 16:05:25.858282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application conn.query(q) Jul 26 16:05:25.858282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 16:05:25.858282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 16:05:25.858282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 16:05:25.858282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application result.read() Jul 26 16:05:25.858282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 16:05:25.858282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 16:05:25.861201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 16:05:25.861201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 16:05:25.861201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 16:05:25.861201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 16:05:25.861201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 16:05:25.861201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 16:05:25.861201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 16:05:25.861201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 16:05:25.861201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [parameters: {'id': 'a3fe71887f624eeaa6ddd5e99352c0de', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 16:05:25.861201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 16:05:25.861201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:25.861201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:25.861201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:25.861201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:25.861201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 26 16:05:25.862795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 26 16:05:25.862795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 16:05:25.862795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 16:05:25.862795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 26 16:05:25.862795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:25.862795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:25.862795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:25.862795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:25.862795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:25.862795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:25.862795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:25.862795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:25.862795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:25.862795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:25.862795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:25.862795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:25.862795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:25.863918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:25.863918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 26 16:05:25.863918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 26 16:05:25.863918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:25.863918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:25.863918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 26 16:05:25.863918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 26 16:05:25.863918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a3fe71887f624eeaa6ddd5e99352c0de. Jul 26 16:05:25.863918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:25.863918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 453/932] 10.222.0.141 () {60 vars in 1145 bytes} [Tue Jul 26 16:05:25 2022] POST /identity/v3/projects => generated 262 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:25.863918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdc3c7-e474-442e-8b16-d1630e6b9d74 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:25.863918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdc3c7-e474-442e-8b16-d1630e6b9d74 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:25.865650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdc3c7-e474-442e-8b16-d1630e6b9d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:25.878428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e5fdc3c7-e474-442e-8b16-d1630e6b9d74 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:25.880072 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e5fdc3c7-e474-442e-8b16-d1630e6b9d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:25.943780 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:25.955249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbae562-8e31-4bd6-a981-fabb1b3d2aae None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:25.972689 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 454/933] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:25 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:25.972689 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdc3c7-e474-442e-8b16-d1630e6b9d74 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:26.012726 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac387b7-61eb-42db-abf1-18a46d2e0282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:26.013933 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac387b7-61eb-42db-abf1-18a46d2e0282 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:26.014354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac387b7-61eb-42db-abf1-18a46d2e0282 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:26.014635 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac387b7-61eb-42db-abf1-18a46d2e0282 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:26.015565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac387b7-61eb-42db-abf1-18a46d2e0282 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:26.015905 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac387b7-61eb-42db-abf1-18a46d2e0282 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:26.017739 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac387b7-61eb-42db-abf1-18a46d2e0282 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:26.028933 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 480/934] 10.222.0.141 () {56 vars in 1131 bytes} [Tue Jul 26 16:05:25 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:26.028933 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac387b7-61eb-42db-abf1-18a46d2e0282 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:26.068693 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdc3c7-e474-442e-8b16-d1630e6b9d74 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:26.105446 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d968dc-f2c2-45ff-a57a-19af6c7d935d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:26.106095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d968dc-f2c2-45ff-a57a-19af6c7d935d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:26.106375 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d968dc-f2c2-45ff-a57a-19af6c7d935d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:26.106645 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d968dc-f2c2-45ff-a57a-19af6c7d935d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:26.109201 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:26.114700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d968dc-f2c2-45ff-a57a-19af6c7d935d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:26.116371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d968dc-f2c2-45ff-a57a-19af6c7d935d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:26.128097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-59d968dc-f2c2-45ff-a57a-19af6c7d935d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:26.128097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:26.128097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:26.128097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:26.128097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:26.128097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:26.128097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:26.128097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:26.128097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:26.128097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:26.128097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:26.128097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:26.128097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:05:26.128097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:05:26.128097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:05:26.129027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:05:26.129027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:26.129027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:26.129027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:26.129027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:26.129027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:26.129027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:26.129027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:26.129027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:26.129027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:26.129027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:26.129027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:26.129027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:26.129027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:26.129027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:26.129027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:26.129027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:26.134989 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:05:26.134989 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:05:26.134989 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:05:26.134989 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:05:26.134989 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:05:26.134989 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:05:26.134989 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:26.134989 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:26.134989 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 455/935] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:26.134989 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d968dc-f2c2-45ff-a57a-19af6c7d935d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:26.143544 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac387b7-61eb-42db-abf1-18a46d2e0282 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:26.181778 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:26.183620 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c949f82-8d50-46a6-8c0b-2870ee39c45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:26.184254 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c949f82-8d50-46a6-8c0b-2870ee39c45f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:26.184533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c949f82-8d50-46a6-8c0b-2870ee39c45f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:26.184832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c949f82-8d50-46a6-8c0b-2870ee39c45f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:26.195520 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c949f82-8d50-46a6-8c0b-2870ee39c45f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:05:26.200939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-0c949f82-8d50-46a6-8c0b-2870ee39c45f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 16:05:26.200939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:26.200939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:26.200939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:26.200939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:26.200939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:26.200939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:26.200939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:26.200939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:26.200939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:26.200939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:26.200939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:26.200939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:05:26.200939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:05:26.200939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:05:26.200939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:05:26.201843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:05:26.201843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:05:26.201843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:05:26.201843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:05:26.201843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:26.201843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:26.201843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:26.201843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:26.201843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:26.201843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:26.201843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:26.201843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:26.201843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:26.201843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:26.201843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:26.201843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:26.202702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:26.202702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:26.202702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:26.202702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:26.202702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:05:26.202702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:05:26.202702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:05:26.202702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:05:26.202702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:05:26.202702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:05:26.202702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 16:05:26.202702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:26.202702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 481/936] 10.222.0.141 () {56 vars in 1125 bytes} [Tue Jul 26 16:05:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:26.203447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c949f82-8d50-46a6-8c0b-2870ee39c45f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:26.244633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d968dc-f2c2-45ff-a57a-19af6c7d935d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:26.279093 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421ed49-4951-4525-bc35-bf8abd096d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:26.279640 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421ed49-4951-4525-bc35-bf8abd096d92 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:26.279924 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421ed49-4951-4525-bc35-bf8abd096d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:26.280198 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421ed49-4951-4525-bc35-bf8abd096d92 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:26.280908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421ed49-4951-4525-bc35-bf8abd096d92 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:26.281216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421ed49-4951-4525-bc35-bf8abd096d92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:26.283221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421ed49-4951-4525-bc35-bf8abd096d92 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:26.295499 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 456/937] 10.222.0.141 () {56 vars in 1131 bytes} [Tue Jul 26 16:05:26 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:26.295499 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421ed49-4951-4525-bc35-bf8abd096d92 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:26.314368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c949f82-8d50-46a6-8c0b-2870ee39c45f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:26.350187 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:26.355685 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6c375-ce0d-41b2-830c-b57cac6c8f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:26.356585 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6c375-ce0d-41b2-830c-b57cac6c8f56 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:26.356896 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6c375-ce0d-41b2-830c-b57cac6c8f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:26.357174 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6c375-ce0d-41b2-830c-b57cac6c8f56 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:26.358038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6c375-ce0d-41b2-830c-b57cac6c8f56 None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:26.358649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6c375-ce0d-41b2-830c-b57cac6c8f56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:26.360399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6c375-ce0d-41b2-830c-b57cac6c8f56 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:26.390414 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 482/938] 10.222.0.141 () {56 vars in 1117 bytes} [Tue Jul 26 16:05:26 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:26.390414 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6c375-ce0d-41b2-830c-b57cac6c8f56 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:26.413178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421ed49-4951-4525-bc35-bf8abd096d92 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:26.427521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:26.452580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4490185-8590-4005-9ce9-fc9ca567000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:26.453763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4490185-8590-4005-9ce9-fc9ca567000d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:26.454053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4490185-8590-4005-9ce9-fc9ca567000d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:26.454328 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4490185-8590-4005-9ce9-fc9ca567000d None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:26.455057 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4490185-8590-4005-9ce9-fc9ca567000d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:26.455366 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4490185-8590-4005-9ce9-fc9ca567000d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:26.456873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4490185-8590-4005-9ce9-fc9ca567000d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:26.474348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 457/939] 10.222.0.141 () {56 vars in 1120 bytes} [Tue Jul 26 16:05:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:26.474348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca00e1e-7e6b-4e4d-b015-5e3812bfb31b None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:26.474348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca00e1e-7e6b-4e4d-b015-5e3812bfb31b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:26.474348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca00e1e-7e6b-4e4d-b015-5e3812bfb31b None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:26.474348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 458/940] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:26.476063 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a4076-e899-45e6-8773-b9208687bbc6 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:26.476560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a4076-e899-45e6-8773-b9208687bbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:26.476870 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a4076-e899-45e6-8773-b9208687bbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:26.495864 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-233a4076-e899-45e6-8773-b9208687bbc6 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:26.497139 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-233a4076-e899-45e6-8773-b9208687bbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:26.524473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6c375-ce0d-41b2-830c-b57cac6c8f56 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:26.569453 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be603738-3e24-423e-b19b-a8e4baea4c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:26.570001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be603738-3e24-423e-b19b-a8e4baea4c8a None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:26.570279 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be603738-3e24-423e-b19b-a8e4baea4c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:26.570650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be603738-3e24-423e-b19b-a8e4baea4c8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:26.572139 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be603738-3e24-423e-b19b-a8e4baea4c8a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:26.576922 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be603738-3e24-423e-b19b-a8e4baea4c8a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:26.577085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 459/941] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:26 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 16:05:26.577085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a4076-e899-45e6-8773-b9208687bbc6 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:26.675073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 483/942] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:05:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:05:26.676017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be603738-3e24-423e-b19b-a8e4baea4c8a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:26.689780 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a4076-e899-45e6-8773-b9208687bbc6 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:26.692277 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:26.736384 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c83911-6c01-42b8-b8aa-d7e0fd24b84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:26.737466 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c83911-6c01-42b8-b8aa-d7e0fd24b84e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:26.737910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c83911-6c01-42b8-b8aa-d7e0fd24b84e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:26.738189 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c83911-6c01-42b8-b8aa-d7e0fd24b84e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:26.749908 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:26.756940 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c83911-6c01-42b8-b8aa-d7e0fd24b84e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:26.756940 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c83911-6c01-42b8-b8aa-d7e0fd24b84e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:26.769973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-99c83911-6c01-42b8-b8aa-d7e0fd24b84e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:26.769973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:26.769973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:26.769973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:26.769973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:26.769973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:26.769973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:26.769973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:26.769973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:26.769973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:26.769973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:26.769973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:26.769973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:26.769973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:26.769973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:26.771035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:26.771035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:26.771035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:26.771035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:26.771035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:26.771035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:26.771035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:26.771035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:26.771035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:26.771035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:26.771035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:26.771035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:26.771035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:26.771035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:26.771035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:26.771035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:26.771035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:26.772013 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:26.772013 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:26.772013 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:26.772013 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:26.772013 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 460/943] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:26.779992 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c83911-6c01-42b8-b8aa-d7e0fd24b84e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:26.823225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be603738-3e24-423e-b19b-a8e4baea4c8a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:26.864611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601735c-f60b-4153-8fd3-44e38720bee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:26.865286 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601735c-f60b-4153-8fd3-44e38720bee4 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:26.865685 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601735c-f60b-4153-8fd3-44e38720bee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:26.866025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601735c-f60b-4153-8fd3-44e38720bee4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:26.866767 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601735c-f60b-4153-8fd3-44e38720bee4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:26.868165 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601735c-f60b-4153-8fd3-44e38720bee4 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:26.878491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-a601735c-f60b-4153-8fd3-44e38720bee4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 16:05:26.878491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:26.878491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:26.878491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:26.878491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:26.878491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:26.878491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:26.878491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:26.878491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 16:05:26.878491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:26.878491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:26.878491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:26.878491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:26.878491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:26.878491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:26.878491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:26.878491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:26.879794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:26.879794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:26.879794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:26.879794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:26.879794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:26.879794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:26.879794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:26.879794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:26.879794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:26.879794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:26.879794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:26.879794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:26.879794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:26.879794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:26.879794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:26.879794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:26.880912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:26.880912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:26.880912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:26.880912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:26.880912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:26.880912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:26.880912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:26.880912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:26.880912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:26.880912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:26.880912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:26.880912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:26.880912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 16:05:26.880912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:26.880912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 484/944] 10.222.0.141 () {56 vars in 1131 bytes} [Tue Jul 26 16:05:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:26.887168 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601735c-f60b-4153-8fd3-44e38720bee4 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:26.907862 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c83911-6c01-42b8-b8aa-d7e0fd24b84e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:26.957530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad8d26-99fd-4d9a-bdd8-b58fd7df5181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:26.958292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad8d26-99fd-4d9a-bdd8-b58fd7df5181 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:26.958587 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad8d26-99fd-4d9a-bdd8-b58fd7df5181 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:26.958862 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad8d26-99fd-4d9a-bdd8-b58fd7df5181 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:26.960239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad8d26-99fd-4d9a-bdd8-b58fd7df5181 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:26.960560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad8d26-99fd-4d9a-bdd8-b58fd7df5181 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:26.962235 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad8d26-99fd-4d9a-bdd8-b58fd7df5181 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:26.979303 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 461/945] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:26.985222 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad8d26-99fd-4d9a-bdd8-b58fd7df5181 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:27.001675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:27.015160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601735c-f60b-4153-8fd3-44e38720bee4 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:27.033191 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:27.060931 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dda8fd-e3d5-4cd5-b965-a6fd693c7b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:27.062034 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dda8fd-e3d5-4cd5-b965-a6fd693c7b1d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:27.062395 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dda8fd-e3d5-4cd5-b965-a6fd693c7b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:27.063715 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dda8fd-e3d5-4cd5-b965-a6fd693c7b1d None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:27.064743 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dda8fd-e3d5-4cd5-b965-a6fd693c7b1d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:27.065158 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dda8fd-e3d5-4cd5-b965-a6fd693c7b1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:27.067317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dda8fd-e3d5-4cd5-b965-a6fd693c7b1d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:27.073569 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 485/946] 10.222.0.141 () {56 vars in 1127 bytes} [Tue Jul 26 16:05:26 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:27.080787 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dda8fd-e3d5-4cd5-b965-a6fd693c7b1d None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:27.110867 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad8d26-99fd-4d9a-bdd8-b58fd7df5181 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:27.151329 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43503f83-3c77-4998-85dc-b3822f3b6fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:27.151975 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43503f83-3c77-4998-85dc-b3822f3b6fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:27.152252 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43503f83-3c77-4998-85dc-b3822f3b6fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:27.152521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43503f83-3c77-4998-85dc-b3822f3b6fa7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:27.160411 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43503f83-3c77-4998-85dc-b3822f3b6fa7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:27.162047 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43503f83-3c77-4998-85dc-b3822f3b6fa7 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:27.175401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-43503f83-3c77-4998-85dc-b3822f3b6fa7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 16:05:27.175401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:27.175401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:27.175401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:27.175401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:27.175401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:27.175401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:27.175401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:27.175401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:27.175401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:27.175401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:27.175401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:27.175401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:05:27.175401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:05:27.175401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:05:27.175401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:05:27.176574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:27.176574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:27.176574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:05:27.176574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:27.176574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:05:27.176574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:27.176574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:27.176574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:27.176574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:27.176574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:27.176574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:27.176574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:27.176574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:27.176574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:27.176574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:27.176574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:27.176574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:27.176574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:27.177841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:27.177841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:27.177841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:05:27.177841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:05:27.177841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:05:27.177841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:05:27.177841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:05:27.177841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:05:27.177841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 16:05:27.177841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:27.177841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 462/947] 10.222.0.141 () {56 vars in 1122 bytes} [Tue Jul 26 16:05:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:27.184136 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43503f83-3c77-4998-85dc-b3822f3b6fa7 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:27.196325 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dda8fd-e3d5-4cd5-b965-a6fd693c7b1d None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:27.231632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7ed1b-188f-446c-a195-0b16b0004f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:27.232420 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7ed1b-188f-446c-a195-0b16b0004f9d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:27.232829 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7ed1b-188f-446c-a195-0b16b0004f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:27.233206 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7ed1b-188f-446c-a195-0b16b0004f9d None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:27.233980 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7ed1b-188f-446c-a195-0b16b0004f9d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:27.234383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7ed1b-188f-446c-a195-0b16b0004f9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:27.236419 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7ed1b-188f-446c-a195-0b16b0004f9d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:27.247696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 486/948] 10.222.0.141 () {56 vars in 1127 bytes} [Tue Jul 26 16:05:27 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:27.248651 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7ed1b-188f-446c-a195-0b16b0004f9d None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:27.272347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:27.296094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:27.316955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43503f83-3c77-4998-85dc-b3822f3b6fa7 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:27.354132 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6d627-7047-4d47-ad74-7f8dc1af3ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:27.354889 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6d627-7047-4d47-ad74-7f8dc1af3ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:27.355274 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6d627-7047-4d47-ad74-7f8dc1af3ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:27.355644 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6d627-7047-4d47-ad74-7f8dc1af3ba9 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:27.356625 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6d627-7047-4d47-ad74-7f8dc1af3ba9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:27.357065 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6d627-7047-4d47-ad74-7f8dc1af3ba9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:27.358749 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6d627-7047-4d47-ad74-7f8dc1af3ba9 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:27.364428 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7ed1b-188f-446c-a195-0b16b0004f9d None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:27.380107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 463/949] 10.222.0.141 () {56 vars in 1154 bytes} [Tue Jul 26 16:05:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:27.385699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6d627-7047-4d47-ad74-7f8dc1af3ba9 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:27.403857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199ec95-a2c4-4438-86b0-43e335555fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:27.404470 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199ec95-a2c4-4438-86b0-43e335555fa7 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:27.404779 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199ec95-a2c4-4438-86b0-43e335555fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:27.405055 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199ec95-a2c4-4438-86b0-43e335555fa7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:27.406034 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199ec95-a2c4-4438-86b0-43e335555fa7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:27.407435 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199ec95-a2c4-4438-86b0-43e335555fa7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:27.489683 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6d627-7047-4d47-ad74-7f8dc1af3ba9 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:27.501010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 487/950] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:05:27 2022] POST /identity/v3/endpoints => generated 351 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:05:27.525173 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:27.540362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629bca1-c8fa-49f6-b799-1ff376dd0dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:27.541473 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629bca1-c8fa-49f6-b799-1ff376dd0dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:27.541473 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629bca1-c8fa-49f6-b799-1ff376dd0dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:27.541656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629bca1-c8fa-49f6-b799-1ff376dd0dc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:27.554056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629bca1-c8fa-49f6-b799-1ff376dd0dc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:27.555530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629bca1-c8fa-49f6-b799-1ff376dd0dc4 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:27.572915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-c629bca1-c8fa-49f6-b799-1ff376dd0dc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:27.572915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:27.572915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:27.572915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:27.572915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:27.572915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:27.572915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:27.572915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:27.572915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:27.572915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:27.572915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:27.572915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:27.572915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:27.572915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:27.572915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:27.574051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:27.574051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:27.574051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:27.574051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:27.574051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:27.574051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:27.574051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:27.574051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:27.574051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:27.574051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:27.574051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:27.574051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:27.574051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:27.574051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:27.574051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:27.574051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:27.574051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:27.575137 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:27.575137 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:27.575137 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:27.575137 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:27.579143 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 464/951] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:27.580570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199ec95-a2c4-4438-86b0-43e335555fa7 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:27.691616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:27.698614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199ec95-a2c4-4438-86b0-43e335555fa7 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:27.733240 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24829410-efa8-4348-a9f9-b7e5bb0a0af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:27.733899 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24829410-efa8-4348-a9f9-b7e5bb0a0af4 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:27.736111 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24829410-efa8-4348-a9f9-b7e5bb0a0af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:27.736111 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24829410-efa8-4348-a9f9-b7e5bb0a0af4 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:27.736111 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24829410-efa8-4348-a9f9-b7e5bb0a0af4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:27.736373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24829410-efa8-4348-a9f9-b7e5bb0a0af4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:27.737599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24829410-efa8-4348-a9f9-b7e5bb0a0af4 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:27.749869 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 488/952] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:27.755655 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629bca1-c8fa-49f6-b799-1ff376dd0dc4 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:27.863257 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629bca1-c8fa-49f6-b799-1ff376dd0dc4 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:27.898491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11442af5-ce21-494d-b6eb-b3667e356b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:27.899217 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11442af5-ce21-494d-b6eb-b3667e356b70 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:27.899565 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11442af5-ce21-494d-b6eb-b3667e356b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:27.899904 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11442af5-ce21-494d-b6eb-b3667e356b70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:27.907574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11442af5-ce21-494d-b6eb-b3667e356b70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:27.909115 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11442af5-ce21-494d-b6eb-b3667e356b70 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:27.920752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-11442af5-ce21-494d-b6eb-b3667e356b70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:27.920752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:27.920752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:27.920752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:27.920752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:27.920752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:27.920752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:27.920752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:27.920752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:27.920752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:27.920752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:27.920752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:27.920752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:05:27.920752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:05:27.920752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:05:27.921863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:05:27.921863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:27.921863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:27.921863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:27.921863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:27.921863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:27.921863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:27.921863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:27.921863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:27.921863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:27.921863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:27.921863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:27.921863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:27.921863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:27.921863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:27.921863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:27.921863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:27.923261 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:05:27.923261 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:05:27.923261 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:05:27.923261 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:05:27.923261 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:05:27.923261 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:05:27.923261 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:27.923261 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:27.924695 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 465/953] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:27.932760 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24829410-efa8-4348-a9f9-b7e5bb0a0af4 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:28.037899 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24829410-efa8-4348-a9f9-b7e5bb0a0af4 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:28.072996 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c922f02-24ce-48de-9d29-a32b14b0a4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:28.073619 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c922f02-24ce-48de-9d29-a32b14b0a4da None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:28.073904 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c922f02-24ce-48de-9d29-a32b14b0a4da None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:28.074179 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c922f02-24ce-48de-9d29-a32b14b0a4da None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:28.074924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c922f02-24ce-48de-9d29-a32b14b0a4da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:28.075231 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c922f02-24ce-48de-9d29-a32b14b0a4da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:28.076712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c922f02-24ce-48de-9d29-a32b14b0a4da None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:28.094598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 489/954] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:05:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:28.101048 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11442af5-ce21-494d-b6eb-b3667e356b70 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:28.131232 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:28.197709 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11442af5-ce21-494d-b6eb-b3667e356b70 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:28.231972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda83113-f04c-493c-84a8-0f13dd5b2afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:28.232646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda83113-f04c-493c-84a8-0f13dd5b2afc None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:28.232957 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda83113-f04c-493c-84a8-0f13dd5b2afc None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:28.233237 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda83113-f04c-493c-84a8-0f13dd5b2afc None admin] PATH_INFO: `/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/02af03095e48472d96a995a530e78035/roles/7b1cae16e1ba4a1c8c57b844e944c8a5` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:28.235459 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda83113-f04c-493c-84a8-0f13dd5b2afc None admin] RBAC: Authorizing `identity:create_grant(project_id=3747e176cdf2495d9b31a1afae618f68, user_id=02af03095e48472d96a995a530e78035, role_id=7b1cae16e1ba4a1c8c57b844e944c8a5)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:28.236934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda83113-f04c-493c-84a8-0f13dd5b2afc None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:28.308859 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 466/955] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:05:28 2022] PUT /identity/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/02af03095e48472d96a995a530e78035/roles/7b1cae16e1ba4a1c8c57b844e944c8a5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:05:28.524163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37e89f-88e5-4048-9f47-4b2096877ac5 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:28.524535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37e89f-88e5-4048-9f47-4b2096877ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:28.524773 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37e89f-88e5-4048-9f47-4b2096877ac5 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:28.526275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 490/956] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:28.534001 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad203afe-ea55-40b8-b236-093979e06b82 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:28.534868 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad203afe-ea55-40b8-b236-093979e06b82 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:28.535356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad203afe-ea55-40b8-b236-093979e06b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:28.554058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ad203afe-ea55-40b8-b236-093979e06b82 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:28.555574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ad203afe-ea55-40b8-b236-093979e06b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:28.626985 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 467/957] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:28 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:28.651864 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37e89f-88e5-4048-9f47-4b2096877ac5 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:28.671548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:28.758833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37e89f-88e5-4048-9f47-4b2096877ac5 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:28.795284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a227dc-5bc7-4ebe-9e70-27848298ded3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:28.795906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a227dc-5bc7-4ebe-9e70-27848298ded3 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:28.796237 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a227dc-5bc7-4ebe-9e70-27848298ded3 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:28.796521 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a227dc-5bc7-4ebe-9e70-27848298ded3 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:28.797812 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a227dc-5bc7-4ebe-9e70-27848298ded3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:28.799323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a227dc-5bc7-4ebe-9e70-27848298ded3 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:28.801958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: WARNING keystone.server.flask.common [None req-87a227dc-5bc7-4ebe-9e70-27848298ded3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 26 16:05:28.845531 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.sql.core [None req-87a227dc-5bc7-4ebe-9e70-27848298ded3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 16:05:28.845531 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 16:05:28.845531 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [parameters: {'user_id': 'a178a1e64a4849ec80de64829d6372f9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 16:05:28.845531 dv-cinder-851042-1-smb devstack@keystone.service[80601]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80601) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 16:05:28.852836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-87a227dc-5bc7-4ebe-9e70-27848298ded3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 16:05:28.852836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:28.852836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 16:05:28.852836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 16:05:28.852836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 16:05:28.852836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 16:05:28.852836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 16:05:28.852836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 16:05:28.852836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 16:05:28.852836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application conn.query(q) Jul 26 16:05:28.852836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 16:05:28.852836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 16:05:28.852836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 16:05:28.852836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application result.read() Jul 26 16:05:28.852836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 16:05:28.853778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 16:05:28.853778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 16:05:28.853778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 16:05:28.853778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 16:05:28.853778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 16:05:28.853778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 16:05:28.853778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 16:05:28.853778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 16:05:28.853778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:28.853778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 16:05:28.853778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:28.853778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:28.853778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 16:05:28.853778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 16:05:28.853778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 26 16:05:28.853778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 26 16:05:28.853778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 16:05:28.853778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application next(self.gen) Jul 26 16:05:28.854740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 16:05:28.854740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application yield resource Jul 26 16:05:28.854740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 16:05:28.854740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application next(self.gen) Jul 26 16:05:28.854740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 16:05:28.854740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 16:05:28.854740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 16:05:28.854740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 16:05:28.854740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 16:05:28.854740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise self.value Jul 26 16:05:28.854740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 16:05:28.854740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 16:05:28.854740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 16:05:28.854740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application session.commit() Jul 26 16:05:28.854740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 16:05:28.854740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 16:05:28.854740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 16:05:28.855666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 16:05:28.855666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 16:05:28.855666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self.session.flush() Jul 26 16:05:28.855666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 16:05:28.855666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 16:05:28.855666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 16:05:28.855666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 16:05:28.855666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 16:05:28.855666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application compat.raise_( Jul 26 16:05:28.855666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 16:05:28.855666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception Jul 26 16:05:28.855666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 16:05:28.855666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 16:05:28.855666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 16:05:28.855666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 16:05:28.855666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 16:05:28.855666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 16:05:28.856711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 16:05:28.856711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 16:05:28.856711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 16:05:28.856711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 26 16:05:28.856711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 16:05:28.856711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 16:05:28.856711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 16:05:28.856711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 16:05:28.856711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 16:05:28.856711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 16:05:28.856711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 16:05:28.856711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 16:05:28.856711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 16:05:28.856711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 16:05:28.856711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 16:05:28.856711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception Jul 26 16:05:28.857598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 16:05:28.857598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 16:05:28.857598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 16:05:28.857598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 16:05:28.857598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 16:05:28.857598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 16:05:28.857598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 16:05:28.857598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application conn.query(q) Jul 26 16:05:28.857598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 16:05:28.857598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 16:05:28.857598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 16:05:28.857598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application result.read() Jul 26 16:05:28.857598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 16:05:28.857598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 16:05:28.857598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 16:05:28.857598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 16:05:28.858413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 16:05:28.858413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 16:05:28.858413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 16:05:28.858413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 16:05:28.858413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 16:05:28.858413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 16:05:28.858413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a178a1e64a4849ec80de64829d6372f9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 16:05:28.858413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 16:05:28.858413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:28.858413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:28.858413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:28.858413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:28.858413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:28.858413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:28.858413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:28.859215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:28.859215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:28.859215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:28.859215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:28.859215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:28.859215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:28.859215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:28.859215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 26 16:05:28.859215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 26 16:05:28.859215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:28.859215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:28.859215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:05:28.859215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:28.859215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:05:28.859215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:28.859215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 26 16:05:28.859215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 26 16:05:28.861974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 26 16:05:28.861974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 26 16:05:28.861974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 16:05:28.861974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 16:05:28.861974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 16:05:28.861974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:28.861974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 491/958] 10.222.0.141 () {60 vars in 1136 bytes} [Tue Jul 26 16:05:28 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:28.862905 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad203afe-ea55-40b8-b236-093979e06b82 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:28.885302 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917fd34-587b-42c7-b486-268118d19f65 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:28.885665 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917fd34-587b-42c7-b486-268118d19f65 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:28.886073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917fd34-587b-42c7-b486-268118d19f65 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:28.890108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:28.892055 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 492/959] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:28 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:05:28.896758 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ba880-818a-470e-93c0-bbe71ec72842 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:28.901768 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ba880-818a-470e-93c0-bbe71ec72842 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:28.901768 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ba880-818a-470e-93c0-bbe71ec72842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:28.923239 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-101ba880-818a-470e-93c0-bbe71ec72842 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:28.925023 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-101ba880-818a-470e-93c0-bbe71ec72842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:28.992125 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad203afe-ea55-40b8-b236-093979e06b82 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:29.020243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 493/960] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:28 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:29.030399 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ef2e6-3663-4fc3-ab91-2fd417907624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:29.031147 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ef2e6-3663-4fc3-ab91-2fd417907624 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:29.032021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ef2e6-3663-4fc3-ab91-2fd417907624 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:29.032361 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ef2e6-3663-4fc3-ab91-2fd417907624 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:29.039877 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ef2e6-3663-4fc3-ab91-2fd417907624 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:29.041452 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ef2e6-3663-4fc3-ab91-2fd417907624 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:29.041913 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ba880-818a-470e-93c0-bbe71ec72842 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:29.052723 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:29.054015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-c21ef2e6-3663-4fc3-ab91-2fd417907624 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 16:05:29.054015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:29.054015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:29.054015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:29.054015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:29.054015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:29.054015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:29.054015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:29.054015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:29.054015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:29.054015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:29.054015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:29.054015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:05:29.054015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:05:29.054015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:05:29.054015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:05:29.054923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:29.054923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:29.054923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:05:29.054923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:29.054923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:05:29.054923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:29.054923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:29.054923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:29.054923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:29.054923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:29.054923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:29.054923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:29.054923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:29.054923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:29.054923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:29.054923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:29.054923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:29.054923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:29.055869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:29.055869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:29.055869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:05:29.055869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:05:29.055869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:05:29.055869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:05:29.055869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:05:29.055869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:05:29.055869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 16:05:29.055869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:29.055869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 468/961] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:05:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:29.060879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ef2e6-3663-4fc3-ab91-2fd417907624 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:29.151764 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:29.153716 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ba880-818a-470e-93c0-bbe71ec72842 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:29.168261 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ef2e6-3663-4fc3-ab91-2fd417907624 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:29.192449 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469cf73-4aa9-423b-a355-23150a931ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:29.193372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469cf73-4aa9-423b-a355-23150a931ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:29.193819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469cf73-4aa9-423b-a355-23150a931ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:29.194243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469cf73-4aa9-423b-a355-23150a931ac1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:29.195012 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469cf73-4aa9-423b-a355-23150a931ac1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:29.196679 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469cf73-4aa9-423b-a355-23150a931ac1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:29.205858 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56a9d1-33b7-4164-b5f5-c5e72e89bb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:29.206153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-f469cf73-4aa9-423b-a355-23150a931ac1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 16:05:29.206153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:29.206153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:29.206153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:29.206153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:29.206153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:29.206153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:29.206153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:29.206153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 16:05:29.206153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:29.206153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:29.206153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:29.206153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:29.206153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:29.206153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:29.206153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:29.206153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:29.207249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:29.207249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:29.207249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:29.207249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:29.207249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:29.207249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:29.207249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:29.207249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:29.207249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:29.207249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:29.207249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:29.207249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:29.207249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:29.207249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:29.207249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:29.207249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:29.208060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:29.208060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:29.208060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:29.208060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:29.208060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:29.208060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:29.208060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:29.208060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:29.208060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:29.208060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:29.208060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:29.208060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:29.208060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 16:05:29.208060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:29.208813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56a9d1-33b7-4164-b5f5-c5e72e89bb9d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:29.208813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56a9d1-33b7-4164-b5f5-c5e72e89bb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:29.208813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56a9d1-33b7-4164-b5f5-c5e72e89bb9d None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:29.208813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56a9d1-33b7-4164-b5f5-c5e72e89bb9d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:29.208813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56a9d1-33b7-4164-b5f5-c5e72e89bb9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:29.210513 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56a9d1-33b7-4164-b5f5-c5e72e89bb9d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:29.210896 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 494/962] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:29.219603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469cf73-4aa9-423b-a355-23150a931ac1 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:29.251497 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 469/963] 10.222.0.141 () {56 vars in 1106 bytes} [Tue Jul 26 16:05:29 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:29.296525 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:29.332243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469cf73-4aa9-423b-a355-23150a931ac1 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:29.369167 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbca0e-9f83-48ca-8d09-650dba34c98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:29.369802 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbca0e-9f83-48ca-8d09-650dba34c98b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:29.370079 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbca0e-9f83-48ca-8d09-650dba34c98b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:29.370350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbca0e-9f83-48ca-8d09-650dba34c98b None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:29.371046 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbca0e-9f83-48ca-8d09-650dba34c98b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:29.371347 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbca0e-9f83-48ca-8d09-650dba34c98b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:29.372784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbca0e-9f83-48ca-8d09-650dba34c98b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:29.378755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 495/964] 10.222.0.141 () {56 vars in 1117 bytes} [Tue Jul 26 16:05:29 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:29.384379 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56a9d1-33b7-4164-b5f5-c5e72e89bb9d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:29.500392 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56a9d1-33b7-4164-b5f5-c5e72e89bb9d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:29.539655 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dccdfae-184c-4685-8bdf-9a328ae5e0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:29.540274 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccdfae-184c-4685-8bdf-9a328ae5e0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:29.540543 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccdfae-184c-4685-8bdf-9a328ae5e0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:29.540851 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccdfae-184c-4685-8bdf-9a328ae5e0e7 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:29.541521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dccdfae-184c-4685-8bdf-9a328ae5e0e7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:29.541820 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dccdfae-184c-4685-8bdf-9a328ae5e0e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:29.543203 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dccdfae-184c-4685-8bdf-9a328ae5e0e7 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:29.552694 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 470/965] 10.222.0.141 () {56 vars in 1117 bytes} [Tue Jul 26 16:05:29 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:29.698529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a45b9-0e3d-446d-bac7-6d2ab21d5621 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:29.699057 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a45b9-0e3d-446d-bac7-6d2ab21d5621 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:29.699057 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a45b9-0e3d-446d-bac7-6d2ab21d5621 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:29.700564 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 496/966] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:29.705730 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bbf0a-522c-4219-884f-dd5afbf77a6e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:29.706028 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bbf0a-522c-4219-884f-dd5afbf77a6e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:29.706311 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bbf0a-522c-4219-884f-dd5afbf77a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:29.725883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c04bbf0a-522c-4219-884f-dd5afbf77a6e None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:29.727088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c04bbf0a-522c-4219-884f-dd5afbf77a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:29.729298 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:29.801075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 471/967] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:29 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:29.823412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a45b9-0e3d-446d-bac7-6d2ab21d5621 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:29.931817 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a45b9-0e3d-446d-bac7-6d2ab21d5621 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:29.966906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17196143-cc59-403f-af9d-c6419632411e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:29.967546 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17196143-cc59-403f-af9d-c6419632411e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:29.967822 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17196143-cc59-403f-af9d-c6419632411e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:29.968089 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17196143-cc59-403f-af9d-c6419632411e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:29.969224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17196143-cc59-403f-af9d-c6419632411e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:29.970570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17196143-cc59-403f-af9d-c6419632411e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:29.973520 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:29.980232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-17196143-cc59-403f-af9d-c6419632411e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 16:05:29.980232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:29.980232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:29.980232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:29.980232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:29.980232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:29.980232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:29.980232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:29.980232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 16:05:29.980232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:29.980232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:29.980232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:29.980232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:29.980232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:29.980232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:29.980232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:29.980232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:29.981307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:29.981307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:29.981307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:29.981307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:29.981307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:29.981307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:29.981307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:29.981307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:29.981307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:29.981307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:29.981307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:29.981307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:29.981307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:29.981307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:29.981307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:29.981307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:29.982166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:29.982166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:29.982166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:29.982166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:29.982166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:29.982166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:29.982166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:29.982166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:29.982166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:29.982166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:29.982166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:29.982166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:29.982166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 16:05:29.982166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:29.982166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 497/968] 10.222.0.141 () {56 vars in 1131 bytes} [Tue Jul 26 16:05:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:29.989581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bbf0a-522c-4219-884f-dd5afbf77a6e None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:30.094387 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bbf0a-522c-4219-884f-dd5afbf77a6e None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:30.131444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94605ad0-40de-490c-9e20-801eb788029f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:30.132259 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94605ad0-40de-490c-9e20-801eb788029f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:30.132536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94605ad0-40de-490c-9e20-801eb788029f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:30.132918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94605ad0-40de-490c-9e20-801eb788029f None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:30.133607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94605ad0-40de-490c-9e20-801eb788029f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:30.133972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94605ad0-40de-490c-9e20-801eb788029f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:30.135490 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94605ad0-40de-490c-9e20-801eb788029f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:30.146728 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 472/969] 10.222.0.141 () {56 vars in 1127 bytes} [Tue Jul 26 16:05:29 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:30.148064 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17196143-cc59-403f-af9d-c6419632411e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:30.254017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17196143-cc59-403f-af9d-c6419632411e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:30.289116 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ac3a5-d1de-4653-8f9b-1594f6facbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:30.289741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ac3a5-d1de-4653-8f9b-1594f6facbdb None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:30.290022 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ac3a5-d1de-4653-8f9b-1594f6facbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:30.290294 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ac3a5-d1de-4653-8f9b-1594f6facbdb None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:30.290968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ac3a5-d1de-4653-8f9b-1594f6facbdb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:30.291274 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ac3a5-d1de-4653-8f9b-1594f6facbdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:30.292636 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ac3a5-d1de-4653-8f9b-1594f6facbdb None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:30.302983 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 498/970] 10.222.0.141 () {56 vars in 1127 bytes} [Tue Jul 26 16:05:30 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:30.304138 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94605ad0-40de-490c-9e20-801eb788029f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:30.307241 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:30.403758 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94605ad0-40de-490c-9e20-801eb788029f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:30.410340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98494d-eb4c-4472-8b84-ce5e540f0fd1 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:30.410630 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98494d-eb4c-4472-8b84-ce5e540f0fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:30.410909 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98494d-eb4c-4472-8b84-ce5e540f0fd1 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:30.412388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 499/971] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:05:30.417105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541159b2-11e8-4477-a626-76aaa485c64a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:30.417391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541159b2-11e8-4477-a626-76aaa485c64a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:30.417668 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541159b2-11e8-4477-a626-76aaa485c64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:30.435664 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-541159b2-11e8-4477-a626-76aaa485c64a None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:30.436872 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-541159b2-11e8-4477-a626-76aaa485c64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:30.439839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3dfbb3-1add-4442-9661-264e2e8b8703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:30.440462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dfbb3-1add-4442-9661-264e2e8b8703 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:30.440771 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dfbb3-1add-4442-9661-264e2e8b8703 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:30.441052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dfbb3-1add-4442-9661-264e2e8b8703 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:30.441809 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3dfbb3-1add-4442-9661-264e2e8b8703 None admin] RBAC: Adding query filter params (interface=admin, service_id=9f032b8c4ef24b90a0b32ce560edf454, region_id=RegionOne) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:30.442119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3dfbb3-1add-4442-9661-264e2e8b8703 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:30.443481 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3dfbb3-1add-4442-9661-264e2e8b8703 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:30.454066 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 473/972] 10.222.0.141 () {56 vars in 1254 bytes} [Tue Jul 26 16:05:30 2022] GET /identity/v3/endpoints?service_id=9f032b8c4ef24b90a0b32ce560edf454&interface=admin®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:30.455425 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3dfbb3-1add-4442-9661-264e2e8b8703 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:30.503939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:30.512832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 500/973] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:30 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 16:05:30.528112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:30.535612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541159b2-11e8-4477-a626-76aaa485c64a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:30.564747 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3dfbb3-1add-4442-9661-264e2e8b8703 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:30.602256 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463a7e9-b92d-492b-a2ac-d0a0ee15a269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:30.602872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463a7e9-b92d-492b-a2ac-d0a0ee15a269 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:30.603157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463a7e9-b92d-492b-a2ac-d0a0ee15a269 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:30.603432 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463a7e9-b92d-492b-a2ac-d0a0ee15a269 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:30.604076 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463a7e9-b92d-492b-a2ac-d0a0ee15a269 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:30.605616 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463a7e9-b92d-492b-a2ac-d0a0ee15a269 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:30.620700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 474/974] 10.222.0.141 () {56 vars in 1092 bytes} [Tue Jul 26 16:05:30 2022] GET /identity/v3/services => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:05:30.651350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541159b2-11e8-4477-a626-76aaa485c64a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:30.689780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777165b-ce1c-4678-bc44-660c10d0ef71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:30.690356 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777165b-ce1c-4678-bc44-660c10d0ef71 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:30.690635 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777165b-ce1c-4678-bc44-660c10d0ef71 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:30.690909 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777165b-ce1c-4678-bc44-660c10d0ef71 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:30.702870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777165b-ce1c-4678-bc44-660c10d0ef71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:05:30.708650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-0777165b-ce1c-4678-bc44-660c10d0ef71 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 16:05:30.708650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:30.708650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:30.708650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:30.708650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:30.708650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:30.708650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:30.708650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:30.708650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:30.708650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:30.708650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:30.708650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:30.708650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:05:30.708650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:05:30.708650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:05:30.708650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:05:30.709722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:05:30.709722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:05:30.709722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:05:30.709722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:05:30.709722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:30.709722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:30.709722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:30.709722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:30.709722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:30.709722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:30.709722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:30.709722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:30.709722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:30.709722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:30.709722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:30.709722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:30.715992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:30.715992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:30.715992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:30.715992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:30.715992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:05:30.715992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:05:30.715992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:05:30.715992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:05:30.715992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:05:30.715992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:05:30.715992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 16:05:30.715992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:30.715992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 501/975] 10.222.0.141 () {56 vars in 1125 bytes} [Tue Jul 26 16:05:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:30.718613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463a7e9-b92d-492b-a2ac-d0a0ee15a269 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:30.829707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463a7e9-b92d-492b-a2ac-d0a0ee15a269 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:30.859979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:30.866177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dab919-4b51-4a2f-a303-07de068b8737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:30.866799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dab919-4b51-4a2f-a303-07de068b8737 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:30.867084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dab919-4b51-4a2f-a303-07de068b8737 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:30.875622 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dab919-4b51-4a2f-a303-07de068b8737 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:30.875622 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dab919-4b51-4a2f-a303-07de068b8737 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:30.875622 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dab919-4b51-4a2f-a303-07de068b8737 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:30.875622 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dab919-4b51-4a2f-a303-07de068b8737 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:30.883303 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 475/976] 10.222.0.141 () {56 vars in 1120 bytes} [Tue Jul 26 16:05:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:30.884872 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777165b-ce1c-4678-bc44-660c10d0ef71 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:30.948511 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:30.991779 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777165b-ce1c-4678-bc44-660c10d0ef71 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:31.026030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870d8c2-4c88-42b9-b6eb-8f0b3403760f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:31.026727 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870d8c2-4c88-42b9-b6eb-8f0b3403760f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:31.027057 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870d8c2-4c88-42b9-b6eb-8f0b3403760f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:31.027379 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870d8c2-4c88-42b9-b6eb-8f0b3403760f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:31.037871 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870d8c2-4c88-42b9-b6eb-8f0b3403760f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:31.039308 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870d8c2-4c88-42b9-b6eb-8f0b3403760f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:31.054932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-3870d8c2-4c88-42b9-b6eb-8f0b3403760f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:31.054932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:31.054932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:31.054932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:31.054932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:31.054932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:31.054932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:31.054932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:31.054932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:31.054932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:31.054932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:31.054932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:31.054932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:31.054932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:31.054932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:31.055844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:31.055844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:31.055844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:31.055844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:31.055844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:31.055844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:31.055844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:31.055844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:31.055844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:31.055844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:31.055844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:31.055844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:31.055844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:31.055844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:31.055844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:31.055844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:31.055844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:31.057156 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:31.057156 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:31.057156 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:31.057156 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:31.060739 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 502/977] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:31.062094 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dab919-4b51-4a2f-a303-07de068b8737 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:31.167805 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dab919-4b51-4a2f-a303-07de068b8737 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:31.203227 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be10c5-3f57-4625-a30f-f8aa54521d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:31.204114 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be10c5-3f57-4625-a30f-f8aa54521d3f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:31.204590 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be10c5-3f57-4625-a30f-f8aa54521d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:31.205077 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be10c5-3f57-4625-a30f-f8aa54521d3f None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:31.205970 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be10c5-3f57-4625-a30f-f8aa54521d3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:31.206457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be10c5-3f57-4625-a30f-f8aa54521d3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:31.208031 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be10c5-3f57-4625-a30f-f8aa54521d3f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:31.224059 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 476/978] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:31.225812 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870d8c2-4c88-42b9-b6eb-8f0b3403760f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:31.326163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870d8c2-4c88-42b9-b6eb-8f0b3403760f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:31.333683 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:31.361028 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8673fb9-7b50-47ae-9322-7f133981a679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:31.361659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8673fb9-7b50-47ae-9322-7f133981a679 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:31.361934 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8673fb9-7b50-47ae-9322-7f133981a679 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:31.362205 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8673fb9-7b50-47ae-9322-7f133981a679 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:31.370111 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8673fb9-7b50-47ae-9322-7f133981a679 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:31.371582 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8673fb9-7b50-47ae-9322-7f133981a679 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:31.383303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-a8673fb9-7b50-47ae-9322-7f133981a679 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 16:05:31.383303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:31.383303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:31.383303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:31.383303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:31.383303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:31.383303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:31.383303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:31.383303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:31.383303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:31.383303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:31.383303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:31.383303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:05:31.383303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:05:31.383303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:05:31.383303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:05:31.384270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:31.384270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:31.384270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:05:31.384270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:31.384270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:05:31.384270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:31.384270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:31.384270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:31.384270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:31.384270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:31.384270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:31.384270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:31.384270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:31.384270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:31.384270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:31.384270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:31.384270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:31.384270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:31.385637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:31.385637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:31.385637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:05:31.385637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:05:31.385637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:05:31.385637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:05:31.385637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:05:31.385637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:05:31.385637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 16:05:31.385637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:31.388742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 503/979] 10.222.0.141 () {56 vars in 1122 bytes} [Tue Jul 26 16:05:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:31.390588 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be10c5-3f57-4625-a30f-f8aa54521d3f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:31.443828 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:31.492686 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be10c5-3f57-4625-a30f-f8aa54521d3f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:31.526167 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a474ca-76e2-479b-8649-0dcf65990515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:31.526782 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a474ca-76e2-479b-8649-0dcf65990515 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:31.527066 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a474ca-76e2-479b-8649-0dcf65990515 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:31.527340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a474ca-76e2-479b-8649-0dcf65990515 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:31.528126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a474ca-76e2-479b-8649-0dcf65990515 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:31.528434 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a474ca-76e2-479b-8649-0dcf65990515 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:31.529909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a474ca-76e2-479b-8649-0dcf65990515 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:31.548580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 477/980] 10.222.0.141 () {56 vars in 1154 bytes} [Tue Jul 26 16:05:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:31.554004 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8673fb9-7b50-47ae-9322-7f133981a679 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:31.637199 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fa934-4878-4b99-988b-a71224bfc113 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:31.637717 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fa934-4878-4b99-988b-a71224bfc113 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:31.637842 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fa934-4878-4b99-988b-a71224bfc113 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:31.639238 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 478/981] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:31.644571 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b0f6b-3532-492f-9bff-75aa0d59744b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:31.644962 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b0f6b-3532-492f-9bff-75aa0d59744b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:31.645247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b0f6b-3532-492f-9bff-75aa0d59744b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:31.657707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8673fb9-7b50-47ae-9322-7f133981a679 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:31.664892 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c25b0f6b-3532-492f-9bff-75aa0d59744b None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:31.666217 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c25b0f6b-3532-492f-9bff-75aa0d59744b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:31.694116 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca635d62-d49a-427a-a03a-06f4364c4590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:31.694741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca635d62-d49a-427a-a03a-06f4364c4590 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:31.695022 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca635d62-d49a-427a-a03a-06f4364c4590 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:31.695296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca635d62-d49a-427a-a03a-06f4364c4590 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:31.732625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:31.752410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 479/982] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:31 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 16:05:31.767427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b0f6b-3532-492f-9bff-75aa0d59744b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:31.768567 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca635d62-d49a-427a-a03a-06f4364c4590 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:31.771661 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca635d62-d49a-427a-a03a-06f4364c4590 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:31.811274 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:31.874670 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b0f6b-3532-492f-9bff-75aa0d59744b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:31.882099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 504/983] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:05:31 2022] GET /identity/v3/auth/tokens => generated 1466 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 16:05:31.887449 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca635d62-d49a-427a-a03a-06f4364c4590 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:31.911849 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da801a58-df16-4cb2-a3a1-9461507d101c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:31.912469 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da801a58-df16-4cb2-a3a1-9461507d101c None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:31.912789 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da801a58-df16-4cb2-a3a1-9461507d101c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:31.916071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da801a58-df16-4cb2-a3a1-9461507d101c None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:31.916071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da801a58-df16-4cb2-a3a1-9461507d101c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:31.916071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da801a58-df16-4cb2-a3a1-9461507d101c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:31.958981 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:31.983048 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 480/984] 10.222.0.141 () {60 vars in 1146 bytes} [Tue Jul 26 16:05:31 2022] POST /identity/v3/services => generated 243 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:05:31.994640 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca635d62-d49a-427a-a03a-06f4364c4590 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:32.046271 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f533d6-7c1d-4596-ada9-efa35e1e1320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:32.046882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f533d6-7c1d-4596-ada9-efa35e1e1320 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:32.047454 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f533d6-7c1d-4596-ada9-efa35e1e1320 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:32.047732 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f533d6-7c1d-4596-ada9-efa35e1e1320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:32.059855 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f533d6-7c1d-4596-ada9-efa35e1e1320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:32.061491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f533d6-7c1d-4596-ada9-efa35e1e1320 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:32.079939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-24f533d6-7c1d-4596-ada9-efa35e1e1320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:32.079939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:32.079939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:32.079939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:32.079939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:32.079939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:32.079939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:32.079939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:32.079939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:32.079939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:32.079939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:32.079939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:32.079939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:32.079939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:32.079939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:32.080970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:32.080970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:32.080970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:32.080970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:32.080970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:32.080970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:32.080970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:32.080970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:32.080970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:32.080970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:32.080970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:32.080970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:32.080970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:32.080970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:32.080970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:32.080970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:32.080970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:32.081877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:32.081877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:32.081877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:32.081877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:32.085034 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 505/985] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:32.087230 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da801a58-df16-4cb2-a3a1-9461507d101c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:32.195199 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:32.198782 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da801a58-df16-4cb2-a3a1-9461507d101c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:32.233438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa03ef-73c0-454f-a44b-de949c4e14b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:32.234567 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa03ef-73c0-454f-a44b-de949c4e14b9 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:32.235217 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa03ef-73c0-454f-a44b-de949c4e14b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:32.235723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa03ef-73c0-454f-a44b-de949c4e14b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:32.236910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa03ef-73c0-454f-a44b-de949c4e14b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:32.237219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa03ef-73c0-454f-a44b-de949c4e14b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:32.238601 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa03ef-73c0-454f-a44b-de949c4e14b9 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:32.255342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 481/986] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:32.256967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f533d6-7c1d-4596-ada9-efa35e1e1320 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:32.364774 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f533d6-7c1d-4596-ada9-efa35e1e1320 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:32.380151 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:32.399953 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3726e-f9ab-49ef-bf7b-5708e2a85836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:32.400683 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3726e-f9ab-49ef-bf7b-5708e2a85836 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:32.401050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3726e-f9ab-49ef-bf7b-5708e2a85836 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:32.401386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3726e-f9ab-49ef-bf7b-5708e2a85836 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:32.408123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3726e-f9ab-49ef-bf7b-5708e2a85836 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:32.409647 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3726e-f9ab-49ef-bf7b-5708e2a85836 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:32.421616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-24a3726e-f9ab-49ef-bf7b-5708e2a85836 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:32.421616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:32.421616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:32.421616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:32.421616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:32.421616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:32.421616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:32.421616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:32.421616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:32.421616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:32.421616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:32.421616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:32.421616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:05:32.421616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:05:32.421616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:05:32.423417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:05:32.423417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:32.423417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:32.423417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:32.423417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:32.423417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:32.423417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:32.423417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:32.423417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:32.423417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:32.423417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:32.423417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:32.423417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:32.423417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:32.423417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:32.423417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:32.423417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:32.424504 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:05:32.424504 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:05:32.424504 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:05:32.424504 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:05:32.424504 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:05:32.424504 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:05:32.424504 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:32.424504 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:32.426261 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 506/987] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:32.431223 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa03ef-73c0-454f-a44b-de949c4e14b9 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:32.535619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa03ef-73c0-454f-a44b-de949c4e14b9 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:32.569985 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80213436-8375-4fbd-884b-79335f69037a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:32.570765 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80213436-8375-4fbd-884b-79335f69037a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:32.571146 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80213436-8375-4fbd-884b-79335f69037a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:32.571513 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80213436-8375-4fbd-884b-79335f69037a None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:32.572350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80213436-8375-4fbd-884b-79335f69037a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:32.572794 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80213436-8375-4fbd-884b-79335f69037a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:32.574311 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80213436-8375-4fbd-884b-79335f69037a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:32.591091 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 482/988] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:05:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:32.592724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3726e-f9ab-49ef-bf7b-5708e2a85836 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:32.634472 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4211888-8705-44b3-8a33-7c7542e7d6c2 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:32.634771 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4211888-8705-44b3-8a33-7c7542e7d6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:32.635035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4211888-8705-44b3-8a33-7c7542e7d6c2 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:32.636622 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 483/989] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:32.641381 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f586f-d19b-4cbb-953f-127c1c158955 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:32.641934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f586f-d19b-4cbb-953f-127c1c158955 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:32.641934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f586f-d19b-4cbb-953f-127c1c158955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:32.660743 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-3f7f586f-d19b-4cbb-953f-127c1c158955 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:32.661938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3f7f586f-d19b-4cbb-953f-127c1c158955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:32.676947 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:32.698891 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3726e-f9ab-49ef-bf7b-5708e2a85836 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:32.731940 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 484/990] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:32 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 16:05:32.740002 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e349258-5f90-413f-bb4c-8a0872941db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:32.740787 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e349258-5f90-413f-bb4c-8a0872941db4 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:32.741166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e349258-5f90-413f-bb4c-8a0872941db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:32.741535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e349258-5f90-413f-bb4c-8a0872941db4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:32.742413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e349258-5f90-413f-bb4c-8a0872941db4 None admin] RBAC: Adding query filter params (role.id=7b1cae16e1ba4a1c8c57b844e944c8a5, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=02af03095e48472d96a995a530e78035) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:32.742831 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e349258-5f90-413f-bb4c-8a0872941db4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:32.744406 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e349258-5f90-413f-bb4c-8a0872941db4 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:32.750735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 507/991] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:05:32 2022] GET /identity/v3/role_assignments?user.id=02af03095e48472d96a995a530e78035&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=7b1cae16e1ba4a1c8c57b844e944c8a5 => generated 610 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:32.754687 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f586f-d19b-4cbb-953f-127c1c158955 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:32.867105 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f586f-d19b-4cbb-953f-127c1c158955 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:32.905273 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401ac1f-7dc3-4cb3-a4ea-c771ab3c82e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:32.905855 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401ac1f-7dc3-4cb3-a4ea-c771ab3c82e7 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:32.906642 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401ac1f-7dc3-4cb3-a4ea-c771ab3c82e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:32.906914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401ac1f-7dc3-4cb3-a4ea-c771ab3c82e7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:32.907872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401ac1f-7dc3-4cb3-a4ea-c771ab3c82e7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:32.908969 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401ac1f-7dc3-4cb3-a4ea-c771ab3c82e7 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:32.919062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-3401ac1f-7dc3-4cb3-a4ea-c771ab3c82e7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 16:05:32.919062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:32.919062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:32.919062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:32.919062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:32.919062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:32.919062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:32.919062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:32.919062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 16:05:32.919062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:32.919062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:32.919062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:32.919062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:32.919062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:32.919062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:32.919062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:32.919062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:32.920258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:32.920258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:32.920258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:32.920258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:32.920258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:32.920258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:32.920258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:32.920258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:32.920258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:32.920258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:32.920258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:32.920258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:32.920258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:32.920258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:32.920258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:32.920258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:32.921285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:32.921285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:32.921285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:32.921285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:32.921285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:32.921285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:32.921285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:32.921285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:32.921285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:32.921285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:32.921285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:32.921285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:32.921285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 16:05:32.921285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:32.921285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 485/992] 10.222.0.141 () {56 vars in 1131 bytes} [Tue Jul 26 16:05:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:32.928533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e349258-5f90-413f-bb4c-8a0872941db4 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:32.975070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:33.034408 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e349258-5f90-413f-bb4c-8a0872941db4 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:33.067929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616bd16-8122-41b4-a9ca-f870a62fd6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:33.068549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616bd16-8122-41b4-a9ca-f870a62fd6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:33.068866 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616bd16-8122-41b4-a9ca-f870a62fd6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:33.069142 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616bd16-8122-41b4-a9ca-f870a62fd6a1 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:33.069810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616bd16-8122-41b4-a9ca-f870a62fd6a1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:33.070112 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616bd16-8122-41b4-a9ca-f870a62fd6a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:33.071470 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616bd16-8122-41b4-a9ca-f870a62fd6a1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:33.076395 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 508/993] 10.222.0.141 () {56 vars in 1127 bytes} [Tue Jul 26 16:05:32 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:33.082487 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401ac1f-7dc3-4cb3-a4ea-c771ab3c82e7 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:33.099732 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:33.197267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401ac1f-7dc3-4cb3-a4ea-c771ab3c82e7 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:33.233124 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc5cdb-94fb-4db0-a325-38afa6a6f06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:33.233747 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc5cdb-94fb-4db0-a325-38afa6a6f06a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:33.234033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc5cdb-94fb-4db0-a325-38afa6a6f06a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:33.234355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc5cdb-94fb-4db0-a325-38afa6a6f06a None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:33.235113 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc5cdb-94fb-4db0-a325-38afa6a6f06a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:33.235422 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc5cdb-94fb-4db0-a325-38afa6a6f06a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:33.236807 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc5cdb-94fb-4db0-a325-38afa6a6f06a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:33.246508 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 486/994] 10.222.0.141 () {56 vars in 1127 bytes} [Tue Jul 26 16:05:33 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:33.247716 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616bd16-8122-41b4-a9ca-f870a62fd6a1 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:33.348989 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616bd16-8122-41b4-a9ca-f870a62fd6a1 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:33.350642 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:33.381917 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e546cf9-584b-4433-aef2-ad6020aff031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:33.383274 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e546cf9-584b-4433-aef2-ad6020aff031 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:33.383274 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e546cf9-584b-4433-aef2-ad6020aff031 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:33.383274 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e546cf9-584b-4433-aef2-ad6020aff031 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:33.383950 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e546cf9-584b-4433-aef2-ad6020aff031 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:33.385348 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e546cf9-584b-4433-aef2-ad6020aff031 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:33.461808 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 509/995] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:05:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:05:34.045863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab05c41-bddd-43df-af90-a85d20292990 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:34.046387 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab05c41-bddd-43df-af90-a85d20292990 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:34.046387 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab05c41-bddd-43df-af90-a85d20292990 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:34.048776 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 487/996] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:34.054009 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcd6fb-9f9f-4207-9320-4062cfb5ad0b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:34.054437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcd6fb-9f9f-4207-9320-4062cfb5ad0b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:34.054602 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcd6fb-9f9f-4207-9320-4062cfb5ad0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:34.073140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-eefcd6fb-9f9f-4207-9320-4062cfb5ad0b None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:34.074336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-eefcd6fb-9f9f-4207-9320-4062cfb5ad0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:34.149198 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 510/997] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:34 2022] POST /identity/v3/auth/tokens => generated 1710 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:34.171352 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab05c41-bddd-43df-af90-a85d20292990 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:34.253287 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:34.276154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab05c41-bddd-43df-af90-a85d20292990 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:34.310839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d0c60-d31a-4e42-a756-8d87d8893f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:34.311684 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d0c60-d31a-4e42-a756-8d87d8893f9d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:34.312108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d0c60-d31a-4e42-a756-8d87d8893f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:34.313089 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d0c60-d31a-4e42-a756-8d87d8893f9d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:34.313738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d0c60-d31a-4e42-a756-8d87d8893f9d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:34.315120 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d0c60-d31a-4e42-a756-8d87d8893f9d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:34.324071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-941d0c60-d31a-4e42-a756-8d87d8893f9d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 16:05:34.324071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:34.324071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:34.324071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:34.324071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:34.324071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:34.324071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:34.324071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:34.324071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 16:05:34.324071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:34.324071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:34.324071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:34.324071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:34.324071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:34.324071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:34.324071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:34.324071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:34.325103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:34.325103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:34.325103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:34.325103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:34.325103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:34.325103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:34.325103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:34.325103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:34.325103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:34.325103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:34.325103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:34.325103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:34.325103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:34.325103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:34.325103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:34.325103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:34.325923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:34.325923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:34.325923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:34.325923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:34.325923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:34.325923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:34.325923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:34.325923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:34.325923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:34.325923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:34.325923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:34.325923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:34.325923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 16:05:34.325923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:34.327242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 488/998] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:34.331777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcd6fb-9f9f-4207-9320-4062cfb5ad0b None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:34.422707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:34.435035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcd6fb-9f9f-4207-9320-4062cfb5ad0b None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:34.470155 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26811e39-79c9-4f5d-9a33-5f24b3add01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:34.470779 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26811e39-79c9-4f5d-9a33-5f24b3add01b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:34.471104 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26811e39-79c9-4f5d-9a33-5f24b3add01b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:34.471378 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26811e39-79c9-4f5d-9a33-5f24b3add01b None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:34.472092 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26811e39-79c9-4f5d-9a33-5f24b3add01b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:34.472376 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26811e39-79c9-4f5d-9a33-5f24b3add01b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:34.473749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26811e39-79c9-4f5d-9a33-5f24b3add01b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:34.483028 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 511/999] 10.222.0.141 () {56 vars in 1117 bytes} [Tue Jul 26 16:05:34 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:34.484436 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d0c60-d31a-4e42-a756-8d87d8893f9d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:34.591658 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d0c60-d31a-4e42-a756-8d87d8893f9d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:34.626610 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d3f8e-1368-4de8-93b7-0f59915d8397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:34.627231 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d3f8e-1368-4de8-93b7-0f59915d8397 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:34.627516 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d3f8e-1368-4de8-93b7-0f59915d8397 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:34.627793 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d3f8e-1368-4de8-93b7-0f59915d8397 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:34.628468 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d3f8e-1368-4de8-93b7-0f59915d8397 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:34.628806 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d3f8e-1368-4de8-93b7-0f59915d8397 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:34.630598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d3f8e-1368-4de8-93b7-0f59915d8397 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:34.635641 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 489/1000] 10.222.0.141 () {56 vars in 1117 bytes} [Tue Jul 26 16:05:34 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:34.641605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26811e39-79c9-4f5d-9a33-5f24b3add01b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:34.744731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26811e39-79c9-4f5d-9a33-5f24b3add01b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:34.778881 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587f020-7a2f-44b7-922c-bc47e726f0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:34.779544 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587f020-7a2f-44b7-922c-bc47e726f0cb None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:34.779825 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587f020-7a2f-44b7-922c-bc47e726f0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:34.780098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587f020-7a2f-44b7-922c-bc47e726f0cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:34.780870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587f020-7a2f-44b7-922c-bc47e726f0cb None admin] RBAC: Adding query filter params (interface=public, service_id=dbe51c935d684afdbf34c48f549c7449, region_id=RegionOne) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:34.781208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587f020-7a2f-44b7-922c-bc47e726f0cb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:34.782637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587f020-7a2f-44b7-922c-bc47e726f0cb None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:34.791959 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 512/1001] 10.222.0.141 () {56 vars in 1256 bytes} [Tue Jul 26 16:05:34 2022] GET /identity/v3/endpoints?service_id=dbe51c935d684afdbf34c48f549c7449&interface=public®ion_id=RegionOne => generated 195 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:34.793384 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d3f8e-1368-4de8-93b7-0f59915d8397 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:34.795144 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb2c53-22e0-4378-9083-601205f9f55e None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:34.795439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb2c53-22e0-4378-9083-601205f9f55e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:34.795715 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb2c53-22e0-4378-9083-601205f9f55e None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:34.797916 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 513/1002] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:34.802567 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134899f-3503-4208-a3ef-4fc638fa1b6c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:34.802855 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134899f-3503-4208-a3ef-4fc638fa1b6c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:34.803134 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134899f-3503-4208-a3ef-4fc638fa1b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:34.803974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:34.821943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a134899f-3503-4208-a3ef-4fc638fa1b6c None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:34.823141 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a134899f-3503-4208-a3ef-4fc638fa1b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:34.834875 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:34.896823 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 514/1003] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:34 2022] POST /identity/v3/auth/tokens => generated 1710 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 16:05:34.902953 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d3f8e-1368-4de8-93b7-0f59915d8397 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:34.923788 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134899f-3503-4208-a3ef-4fc638fa1b6c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:34.944423 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacae99-4661-4076-8d2f-4169296a0f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:34.945077 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacae99-4661-4076-8d2f-4169296a0f94 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:34.945360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacae99-4661-4076-8d2f-4169296a0f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:34.945635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacae99-4661-4076-8d2f-4169296a0f94 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:34.946289 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eacae99-4661-4076-8d2f-4169296a0f94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:34.947652 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eacae99-4661-4076-8d2f-4169296a0f94 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:34.954339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 490/1004] 10.222.0.141 () {56 vars in 1092 bytes} [Tue Jul 26 16:05:34 2022] GET /identity/v3/services => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:05:35.034322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134899f-3503-4208-a3ef-4fc638fa1b6c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:35.070867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e15fab-8183-4e90-9d0f-a39dd21022b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:35.071551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e15fab-8183-4e90-9d0f-a39dd21022b9 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:35.071795 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e15fab-8183-4e90-9d0f-a39dd21022b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:35.072061 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e15fab-8183-4e90-9d0f-a39dd21022b9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:35.072712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e15fab-8183-4e90-9d0f-a39dd21022b9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:35.074118 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e15fab-8183-4e90-9d0f-a39dd21022b9 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:35.083777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-57e15fab-8183-4e90-9d0f-a39dd21022b9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 16:05:35.083777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:35.083777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:35.083777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:35.083777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:35.083777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:35.083777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:35.083777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:35.083777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 16:05:35.083777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:35.083777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:35.083777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:35.083777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:35.083777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:35.083777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:35.083777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:35.083777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:35.084843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:35.084843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:35.084843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:35.084843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:35.084843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:35.084843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:35.084843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:35.084843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:35.084843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:35.084843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:35.084843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:35.084843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:35.084843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:35.084843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:35.084843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:35.084843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:35.085676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:35.085676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:35.085676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:35.085676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:35.085676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:35.085676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:35.085676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:35.085676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:35.085676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:35.085676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:35.085676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:35.085676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:35.085676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 16:05:35.085676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:35.089051 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 515/1005] 10.222.0.141 () {56 vars in 1110 bytes} [Tue Jul 26 16:05:34 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:35.091213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacae99-4661-4076-8d2f-4169296a0f94 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:35.166372 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:35.197383 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacae99-4661-4076-8d2f-4169296a0f94 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:35.231899 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda26663-762e-4dcf-bd94-8d4da9324b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:35.232545 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda26663-762e-4dcf-bd94-8d4da9324b41 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:35.232855 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda26663-762e-4dcf-bd94-8d4da9324b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:35.233125 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda26663-762e-4dcf-bd94-8d4da9324b41 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:35.233862 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda26663-762e-4dcf-bd94-8d4da9324b41 None admin] RBAC: Adding query filter params (name=image) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:35.234193 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda26663-762e-4dcf-bd94-8d4da9324b41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:35.235617 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda26663-762e-4dcf-bd94-8d4da9324b41 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:35.240703 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 491/1006] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:35 2022] GET /identity/v3/services?name=image => generated 123 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:35.246032 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e15fab-8183-4e90-9d0f-a39dd21022b9 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:35.259676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:35.349065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e15fab-8183-4e90-9d0f-a39dd21022b9 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:35.383583 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07533766-a8e8-499e-8e22-0d8fcf1c9074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:35.384201 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07533766-a8e8-499e-8e22-0d8fcf1c9074 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:35.384481 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07533766-a8e8-499e-8e22-0d8fcf1c9074 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:35.384781 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07533766-a8e8-499e-8e22-0d8fcf1c9074 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:35.385456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07533766-a8e8-499e-8e22-0d8fcf1c9074 None admin] RBAC: Adding query filter params (type=image) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:35.385759 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07533766-a8e8-499e-8e22-0d8fcf1c9074 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:35.387161 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07533766-a8e8-499e-8e22-0d8fcf1c9074 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:35.400752 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 516/1007] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:35 2022] GET /identity/v3/services?type=image => generated 123 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:35.497039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a1274-591c-4d90-b121-c1e6de471705 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:35.497341 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a1274-591c-4d90-b121-c1e6de471705 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:35.497520 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a1274-591c-4d90-b121-c1e6de471705 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:35.499104 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 492/1008] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:35.505178 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a968e-af02-49f3-a525-2222c728d6eb None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:35.505535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a968e-af02-49f3-a525-2222c728d6eb None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:35.505821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a968e-af02-49f3-a525-2222c728d6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:35.524578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-674a968e-af02-49f3-a525-2222c728d6eb None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:35.525829 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-674a968e-af02-49f3-a525-2222c728d6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:35.600690 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 517/1009] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:35 2022] POST /identity/v3/auth/tokens => generated 1710 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:35.620373 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a1274-591c-4d90-b121-c1e6de471705 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:35.725669 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a1274-591c-4d90-b121-c1e6de471705 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:35.760284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5e3df-6713-4b19-a3fe-d41fe4bce950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:35.761287 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5e3df-6713-4b19-a3fe-d41fe4bce950 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:35.761791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5e3df-6713-4b19-a3fe-d41fe4bce950 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:35.762270 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5e3df-6713-4b19-a3fe-d41fe4bce950 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:35.763617 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5e3df-6713-4b19-a3fe-d41fe4bce950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:35.765302 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5e3df-6713-4b19-a3fe-d41fe4bce950 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:35.767379 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 493/1010] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:35 2022] GET /identity/v3/domains/default => generated 200 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:35.773047 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a968e-af02-49f3-a525-2222c728d6eb None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:35.776222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:35.874478 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a968e-af02-49f3-a525-2222c728d6eb None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:35.907755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b757351-9436-4387-ac12-ef06d5309b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:35.908427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b757351-9436-4387-ac12-ef06d5309b41 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:35.908738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b757351-9436-4387-ac12-ef06d5309b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:35.909014 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b757351-9436-4387-ac12-ef06d5309b41 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:35.909701 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b757351-9436-4387-ac12-ef06d5309b41 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:35.911139 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b757351-9436-4387-ac12-ef06d5309b41 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:36.005536 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 518/1011] 10.222.0.141 () {60 vars in 1146 bytes} [Tue Jul 26 16:05:35 2022] POST /identity/v3/projects => generated 312 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:05:37.014186 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31f8ed-3451-4b25-b561-db36e0f54b59 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:37.014774 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31f8ed-3451-4b25-b561-db36e0f54b59 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:37.014774 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31f8ed-3451-4b25-b561-db36e0f54b59 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:37.016318 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 494/1012] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:05:37.021814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489fc46-823a-4287-b28b-c526b45c7b40 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:37.022660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489fc46-823a-4287-b28b-c526b45c7b40 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:37.023158 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489fc46-823a-4287-b28b-c526b45c7b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:37.041971 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-8489fc46-823a-4287-b28b-c526b45c7b40 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:37.043533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8489fc46-823a-4287-b28b-c526b45c7b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:37.097450 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:37.121016 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 519/1013] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:37 2022] POST /identity/v3/auth/tokens => generated 1710 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 16:05:37.139175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31f8ed-3451-4b25-b561-db36e0f54b59 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:37.143344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:37.262266 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31f8ed-3451-4b25-b561-db36e0f54b59 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:37.301658 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac610dc-0e9c-41d6-a81d-4c580f0c1e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:37.302747 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac610dc-0e9c-41d6-a81d-4c580f0c1e8c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:37.303236 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac610dc-0e9c-41d6-a81d-4c580f0c1e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:37.303787 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac610dc-0e9c-41d6-a81d-4c580f0c1e8c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:37.304633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac610dc-0e9c-41d6-a81d-4c580f0c1e8c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:37.306289 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac610dc-0e9c-41d6-a81d-4c580f0c1e8c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:37.315428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-5ac610dc-0e9c-41d6-a81d-4c580f0c1e8c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 16:05:37.315428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:37.315428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:37.315428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:37.315428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:37.315428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:37.315428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:37.315428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:37.315428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 16:05:37.315428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:37.315428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:37.315428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:37.315428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:37.315428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:37.315428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:37.315428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:37.315428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:37.316380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:37.316380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:37.316380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:37.316380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:37.316380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:37.316380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:37.316380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:37.316380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:37.316380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:37.316380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:37.316380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:37.316380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:37.316380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:37.316380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:37.316380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:37.316380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:37.317260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:37.317260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:37.317260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:37.317260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:37.317260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:37.317260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:37.317260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:37.317260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:37.317260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:37.317260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:37.317260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:37.317260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:37.317260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 16:05:37.317260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:37.323308 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 495/1014] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:37.324534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489fc46-823a-4287-b28b-c526b45c7b40 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:37.426259 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489fc46-823a-4287-b28b-c526b45c7b40 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:37.436912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826efbf8-16e3-4e0d-ad31-98cbf6db57d6 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:37.437824 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826efbf8-16e3-4e0d-ad31-98cbf6db57d6 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:37.438112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826efbf8-16e3-4e0d-ad31-98cbf6db57d6 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:37.439476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 496/1015] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:37 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:37.444407 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a813fd8-8f91-4741-8665-5018c98a8a59 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:37.444715 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a813fd8-8f91-4741-8665-5018c98a8a59 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:37.445000 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a813fd8-8f91-4741-8665-5018c98a8a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:37.461332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2679ec-d02e-472b-a5e0-956655275fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:37.461954 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2679ec-d02e-472b-a5e0-956655275fdf None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:37.462237 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2679ec-d02e-472b-a5e0-956655275fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:37.462509 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2679ec-d02e-472b-a5e0-956655275fdf None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:37.462680 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-5a813fd8-8f91-4741-8665-5018c98a8a59 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:37.463180 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2679ec-d02e-472b-a5e0-956655275fdf None admin] RBAC: Adding query filter params (name=compute) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:37.463483 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2679ec-d02e-472b-a5e0-956655275fdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:37.463867 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5a813fd8-8f91-4741-8665-5018c98a8a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:37.464884 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2679ec-d02e-472b-a5e0-956655275fdf None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:37.475248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 520/1016] 10.222.0.141 () {56 vars in 1117 bytes} [Tue Jul 26 16:05:37 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:37.475892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2679ec-d02e-472b-a5e0-956655275fdf None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:37.527927 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:37.531859 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:37.541964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 497/1017] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:37 2022] POST /identity/v3/auth/tokens => generated 1710 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 16:05:37.565119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a813fd8-8f91-4741-8665-5018c98a8a59 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:37.579626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2679ec-d02e-472b-a5e0-956655275fdf None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:37.619361 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43389f-9bf3-4cfc-a770-54d15d9f4a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:37.619986 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43389f-9bf3-4cfc-a770-54d15d9f4a2d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:37.620267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43389f-9bf3-4cfc-a770-54d15d9f4a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:37.620543 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43389f-9bf3-4cfc-a770-54d15d9f4a2d None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:37.621308 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43389f-9bf3-4cfc-a770-54d15d9f4a2d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:37.621621 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43389f-9bf3-4cfc-a770-54d15d9f4a2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:37.623442 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43389f-9bf3-4cfc-a770-54d15d9f4a2d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:37.633439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 521/1018] 10.222.0.141 () {56 vars in 1117 bytes} [Tue Jul 26 16:05:37 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:37.634654 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43389f-9bf3-4cfc-a770-54d15d9f4a2d None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:37.672953 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a813fd8-8f91-4741-8665-5018c98a8a59 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:37.709383 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190bec4-e92e-4a43-ab70-c78ffeabf99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:37.710041 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190bec4-e92e-4a43-ab70-c78ffeabf99b None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:37.710328 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190bec4-e92e-4a43-ab70-c78ffeabf99b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:37.710632 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190bec4-e92e-4a43-ab70-c78ffeabf99b None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:37.711329 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190bec4-e92e-4a43-ab70-c78ffeabf99b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:37.712724 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190bec4-e92e-4a43-ab70-c78ffeabf99b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:37.739614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43389f-9bf3-4cfc-a770-54d15d9f4a2d None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:37.753302 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:37.773529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a703f2-cf39-4678-81f6-91247f500a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:37.774141 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a703f2-cf39-4678-81f6-91247f500a9a None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:37.774418 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a703f2-cf39-4678-81f6-91247f500a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:37.774689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a703f2-cf39-4678-81f6-91247f500a9a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:37.775386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a703f2-cf39-4678-81f6-91247f500a9a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:37.776953 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a703f2-cf39-4678-81f6-91247f500a9a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:37.801265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 498/1019] 10.222.0.141 () {60 vars in 1146 bytes} [Tue Jul 26 16:05:37 2022] POST /identity/v3/services => generated 243 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:05:37.844362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 522/1020] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:05:37 2022] POST /identity/v3/endpoints => generated 336 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:05:38.087826 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e7a3c-3872-40eb-ab41-5e74240aec9f None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:38.088346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e7a3c-3872-40eb-ab41-5e74240aec9f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:38.088346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e7a3c-3872-40eb-ab41-5e74240aec9f None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:38.089869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 499/1021] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:38.095500 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d3fc1-9f5d-48f5-a158-4683dcb89122 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:38.096869 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d3fc1-9f5d-48f5-a158-4683dcb89122 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:38.096869 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d3fc1-9f5d-48f5-a158-4683dcb89122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:38.116235 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-fd2d3fc1-9f5d-48f5-a158-4683dcb89122 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:38.117701 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fd2d3fc1-9f5d-48f5-a158-4683dcb89122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:38.195731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 523/1022] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:38 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:38.220286 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e7a3c-3872-40eb-ab41-5e74240aec9f None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:38.278422 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:38.325026 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e7a3c-3872-40eb-ab41-5e74240aec9f None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:38.359273 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882aa54d-9694-4c49-af01-e198f2fc5b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:38.359828 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882aa54d-9694-4c49-af01-e198f2fc5b5e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:38.360105 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882aa54d-9694-4c49-af01-e198f2fc5b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:38.360460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882aa54d-9694-4c49-af01-e198f2fc5b5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:38.361604 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882aa54d-9694-4c49-af01-e198f2fc5b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:38.363276 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882aa54d-9694-4c49-af01-e198f2fc5b5e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:38.367682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 500/1023] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:38 2022] GET /identity/v3/domains/default => generated 200 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:38.370966 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d3fc1-9f5d-48f5-a158-4683dcb89122 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:38.469313 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:38.475399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d3fc1-9f5d-48f5-a158-4683dcb89122 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:38.509411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565eba2-b08f-4de0-8070-67b5dd299126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:38.510427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565eba2-b08f-4de0-8070-67b5dd299126 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:38.510948 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565eba2-b08f-4de0-8070-67b5dd299126 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:38.511439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565eba2-b08f-4de0-8070-67b5dd299126 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:38.512316 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565eba2-b08f-4de0-8070-67b5dd299126 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:38.513912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565eba2-b08f-4de0-8070-67b5dd299126 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:38.664689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 524/1024] 10.222.0.141 () {60 vars in 1137 bytes} [Tue Jul 26 16:05:38 2022] POST /identity/v3/users => generated 286 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:05:39.846020 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ff56f-e91f-4292-9538-2694e8c071ab None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:39.846564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ff56f-e91f-4292-9538-2694e8c071ab None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:39.846564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ff56f-e91f-4292-9538-2694e8c071ab None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:39.847925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 501/1025] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:39.853346 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b79f0-4b79-4ef1-bc96-9a171b1004b3 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:39.853745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b79f0-4b79-4ef1-bc96-9a171b1004b3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:39.853897 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b79f0-4b79-4ef1-bc96-9a171b1004b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:39.872342 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-ce3b79f0-4b79-4ef1-bc96-9a171b1004b3 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:39.873562 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ce3b79f0-4b79-4ef1-bc96-9a171b1004b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:39.945431 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 525/1026] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:39 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:39.968039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ff56f-e91f-4292-9538-2694e8c071ab None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:39.980019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06659458-31b2-4d7e-b448-676ad3b10530 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:39.980305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06659458-31b2-4d7e-b448-676ad3b10530 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:39.980580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06659458-31b2-4d7e-b448-676ad3b10530 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:39.982099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 526/1027] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:05:39.987145 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f273185-c41b-496f-b5fa-ed7734d80bdb None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:39.987431 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f273185-c41b-496f-b5fa-ed7734d80bdb None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:39.987706 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f273185-c41b-496f-b5fa-ed7734d80bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:40.006154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-7f273185-c41b-496f-b5fa-ed7734d80bdb None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:40.007330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7f273185-c41b-496f-b5fa-ed7734d80bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:40.077422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 527/1028] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:39 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 16:05:40.079902 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ff56f-e91f-4292-9538-2694e8c071ab None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:40.104784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f273185-c41b-496f-b5fa-ed7734d80bdb None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:40.104948 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:40.115366 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5765e-828f-4a9e-94ff-a9835fd36e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:40.115762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:40.116011 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5765e-828f-4a9e-94ff-a9835fd36e51 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:40.116297 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5765e-828f-4a9e-94ff-a9835fd36e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:40.116695 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5765e-828f-4a9e-94ff-a9835fd36e51 None admin] PATH_INFO: `/v3/services/image` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:40.117227 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5765e-828f-4a9e-94ff-a9835fd36e51 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:40.118736 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5765e-828f-4a9e-94ff-a9835fd36e51 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:40.127535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-06b5765e-828f-4a9e-94ff-a9835fd36e51 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 16:05:40.127535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:40.127535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:40.127535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:40.127535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:40.127535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:40.127535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:40.127535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:40.127535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 16:05:40.127535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:40.127535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:40.127535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:40.127535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:40.127535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:40.127535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:40.127535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:40.127535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:40.129574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:40.129574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:40.129574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:40.129574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:40.129574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:40.129574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:40.129574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:40.129574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:40.129574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:40.129574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:40.129574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:40.129574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:40.129574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:40.129574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:40.129574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:40.129574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:40.130415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:40.130415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:40.130415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:40.130415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:40.130415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:40.130415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:40.130415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:40.130415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:40.130415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:40.130415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:40.130415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:40.130415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:40.130415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 16:05:40.130415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:40.130415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 502/1029] 10.222.0.141 () {56 vars in 1110 bytes} [Tue Jul 26 16:05:39 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:40.134833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5765e-828f-4a9e-94ff-a9835fd36e51 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:40.218265 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f273185-c41b-496f-b5fa-ed7734d80bdb None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:40.242505 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5765e-828f-4a9e-94ff-a9835fd36e51 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:40.257877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaca5de-19c3-4700-a283-5658f14b58bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:40.258873 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaca5de-19c3-4700-a283-5658f14b58bb None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:40.259362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaca5de-19c3-4700-a283-5658f14b58bb None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:40.259700 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaca5de-19c3-4700-a283-5658f14b58bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:40.271704 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaca5de-19c3-4700-a283-5658f14b58bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:05:40.277426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-9aaca5de-19c3-4700-a283-5658f14b58bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 16:05:40.277426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:40.277426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:40.277426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:40.277426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:40.277426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:40.277426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:40.277426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:40.277426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:40.277426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:40.277426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:40.277426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:40.277426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:05:40.277426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:05:40.277426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:05:40.277426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:05:40.278545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:05:40.278545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:05:40.278545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:05:40.278545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:05:40.278545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:40.278545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:40.278545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:40.278545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:40.278545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:40.278545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:40.278545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:40.278545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:40.278545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:40.278545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:40.278545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:40.278545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:40.279553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:40.279553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:40.279553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:40.279553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:40.279553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:05:40.279553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:05:40.279553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:05:40.279553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:05:40.279553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:05:40.279553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:05:40.279553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 16:05:40.279553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:40.283434 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 528/1030] 10.222.0.141 () {56 vars in 1125 bytes} [Tue Jul 26 16:05:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:40.284413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaca5de-19c3-4700-a283-5658f14b58bb None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:40.285149 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc933d-324c-4532-9f90-6531d72efa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:40.285768 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc933d-324c-4532-9f90-6531d72efa5a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:40.286050 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc933d-324c-4532-9f90-6531d72efa5a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:40.286325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc933d-324c-4532-9f90-6531d72efa5a None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:40.287008 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc933d-324c-4532-9f90-6531d72efa5a None admin] RBAC: Adding query filter params (name=image) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:40.287310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc933d-324c-4532-9f90-6531d72efa5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:40.288684 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc933d-324c-4532-9f90-6531d72efa5a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:40.293787 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 503/1031] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:40 2022] GET /identity/v3/services?name=image => generated 123 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:40.300353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc933d-324c-4532-9f90-6531d72efa5a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:40.352902 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:40.364770 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:40.395651 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaca5de-19c3-4700-a283-5658f14b58bb None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:40.401992 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc933d-324c-4532-9f90-6531d72efa5a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:40.433686 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6d11b-3a56-4555-89e6-e8e63303fcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:40.434583 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6d11b-3a56-4555-89e6-e8e63303fcf9 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:40.435012 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6d11b-3a56-4555-89e6-e8e63303fcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:40.435427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6d11b-3a56-4555-89e6-e8e63303fcf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:40.436283 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6d11b-3a56-4555-89e6-e8e63303fcf9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:40.436769 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6d11b-3a56-4555-89e6-e8e63303fcf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:40.438843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6d11b-3a56-4555-89e6-e8e63303fcf9 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:40.441755 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db08a4-6d4c-4957-80fb-be7b2b20d6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:40.442382 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db08a4-6d4c-4957-80fb-be7b2b20d6ff None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:40.442667 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db08a4-6d4c-4957-80fb-be7b2b20d6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:40.442946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db08a4-6d4c-4957-80fb-be7b2b20d6ff None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:40.443625 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db08a4-6d4c-4957-80fb-be7b2b20d6ff None admin] RBAC: Adding query filter params (type=image) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:40.443932 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db08a4-6d4c-4957-80fb-be7b2b20d6ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:40.445384 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db08a4-6d4c-4957-80fb-be7b2b20d6ff None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:40.447626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 529/1032] 10.222.0.141 () {56 vars in 1120 bytes} [Tue Jul 26 16:05:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:40.450792 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 504/1033] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:40 2022] GET /identity/v3/services?type=image => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:40.453673 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6d11b-3a56-4555-89e6-e8e63303fcf9 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:40.458296 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db08a4-6d4c-4957-80fb-be7b2b20d6ff None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:40.557814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6d11b-3a56-4555-89e6-e8e63303fcf9 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:40.570721 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db08a4-6d4c-4957-80fb-be7b2b20d6ff None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:40.587691 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:40.593409 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8f1c1-12a6-4094-9f9d-ee08d9ebc312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:40.598499 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8f1c1-12a6-4094-9f9d-ee08d9ebc312 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:40.598499 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8f1c1-12a6-4094-9f9d-ee08d9ebc312 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:40.598499 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8f1c1-12a6-4094-9f9d-ee08d9ebc312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:40.598499 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:40.605966 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e91b2-7c03-4614-adff-0712b89663d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:40.606146 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8f1c1-12a6-4094-9f9d-ee08d9ebc312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:40.606596 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e91b2-7c03-4614-adff-0712b89663d0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:40.606878 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e91b2-7c03-4614-adff-0712b89663d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:40.607152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e91b2-7c03-4614-adff-0712b89663d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:40.607555 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8f1c1-12a6-4094-9f9d-ee08d9ebc312 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:40.607956 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e91b2-7c03-4614-adff-0712b89663d0 None admin] RBAC: Adding query filter params (interface=public, service_id=0e924517b0c24a6a89e5a4b8aa3a378f, region_id=RegionOne) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:40.608211 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e91b2-7c03-4614-adff-0712b89663d0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:40.610130 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e91b2-7c03-4614-adff-0712b89663d0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:40.619587 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 505/1034] 10.222.0.141 () {56 vars in 1256 bytes} [Tue Jul 26 16:05:40 2022] GET /identity/v3/endpoints?service_id=0e924517b0c24a6a89e5a4b8aa3a378f&interface=public®ion_id=RegionOne => generated 195 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:40.620544 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e91b2-7c03-4614-adff-0712b89663d0 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:40.623281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-e7c8f1c1-12a6-4094-9f9d-ee08d9ebc312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:40.623281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:40.623281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:40.623281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:40.623281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:40.623281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:40.623281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:40.623281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:40.623281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:40.623281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:40.623281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:40.623281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:40.623281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:40.623281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:40.623281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:40.624154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:40.624154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:40.624154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:40.624154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:40.624154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:40.624154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:40.624154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:40.624154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:40.624154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:40.624154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:40.624154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:40.624154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:40.624154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:40.624154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:40.624154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:40.624154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:40.624154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:40.633195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:40.633195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:40.633195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:40.633195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:40.633195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 530/1035] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:40.633195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8f1c1-12a6-4094-9f9d-ee08d9ebc312 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:40.729371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e91b2-7c03-4614-adff-0712b89663d0 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:40.735974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8f1c1-12a6-4094-9f9d-ee08d9ebc312 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:40.764562 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05243e57-f813-4447-96e6-e46faa596437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:40.765237 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05243e57-f813-4447-96e6-e46faa596437 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:40.765517 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05243e57-f813-4447-96e6-e46faa596437 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:40.765785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05243e57-f813-4447-96e6-e46faa596437 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:40.766432 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05243e57-f813-4447-96e6-e46faa596437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:40.767802 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05243e57-f813-4447-96e6-e46faa596437 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:40.772116 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391c527-f7b4-4dc8-bbd1-80b2bd5f87c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:40.772780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391c527-f7b4-4dc8-bbd1-80b2bd5f87c6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:40.773058 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391c527-f7b4-4dc8-bbd1-80b2bd5f87c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:40.773328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391c527-f7b4-4dc8-bbd1-80b2bd5f87c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:40.773998 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391c527-f7b4-4dc8-bbd1-80b2bd5f87c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:40.774297 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391c527-f7b4-4dc8-bbd1-80b2bd5f87c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:40.774385 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 506/1036] 10.222.0.141 () {56 vars in 1092 bytes} [Tue Jul 26 16:05:40 2022] GET /identity/v3/services => generated 1966 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:05:40.775526 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86ff0f-fcdb-48ac-af82-0d041b033018 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:40.775697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391c527-f7b4-4dc8-bbd1-80b2bd5f87c6 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:40.775850 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86ff0f-fcdb-48ac-af82-0d041b033018 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:40.776085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86ff0f-fcdb-48ac-af82-0d041b033018 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:40.777500 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 507/1037] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:40 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:40.786482 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2221e-f949-452d-934a-97503ec85bd1 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:40.786768 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2221e-f949-452d-934a-97503ec85bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:40.787051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2221e-f949-452d-934a-97503ec85bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:40.789462 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 531/1038] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:40.795071 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391c527-f7b4-4dc8-bbd1-80b2bd5f87c6 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:40.808194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-3ff2221e-f949-452d-934a-97503ec85bd1 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:40.809858 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3ff2221e-f949-452d-934a-97503ec85bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:40.851154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:40.855555 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:40.884938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 508/1039] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:40 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 16:05:40.908491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2221e-f949-452d-934a-97503ec85bd1 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:40.914455 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391c527-f7b4-4dc8-bbd1-80b2bd5f87c6 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:40.958573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94051665-0f95-4afc-a6be-ba26940a56dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:40.959226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94051665-0f95-4afc-a6be-ba26940a56dc None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:40.959508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94051665-0f95-4afc-a6be-ba26940a56dc None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:40.959787 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94051665-0f95-4afc-a6be-ba26940a56dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:40.967603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94051665-0f95-4afc-a6be-ba26940a56dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:40.969641 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94051665-0f95-4afc-a6be-ba26940a56dc None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:40.982437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-94051665-0f95-4afc-a6be-ba26940a56dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 16:05:40.982437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:40.982437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:40.982437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:40.982437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:40.982437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:40.982437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:40.982437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:40.982437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:40.982437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:40.982437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:40.982437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:40.982437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:05:40.982437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:05:40.982437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:05:40.982437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:05:40.983411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:40.983411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:40.983411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:05:40.983411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:40.983411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:05:40.983411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:40.983411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:40.983411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:40.983411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:40.983411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:40.983411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:40.983411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:40.983411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:40.983411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:40.983411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:40.983411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:40.983411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:40.983411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:40.984946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:40.984946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:40.984946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:05:40.984946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:05:40.984946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:05:40.984946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:05:40.984946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:05:40.984946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:05:40.984946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 16:05:40.984946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:40.984946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 532/1040] 10.222.0.141 () {56 vars in 1098 bytes} [Tue Jul 26 16:05:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:40.989683 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94051665-0f95-4afc-a6be-ba26940a56dc None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:41.034909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2221e-f949-452d-934a-97503ec85bd1 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:41.071646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8a993-b431-42b2-b29a-3baee2fe2f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:41.072295 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8a993-b431-42b2-b29a-3baee2fe2f9e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:41.072579 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8a993-b431-42b2-b29a-3baee2fe2f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:41.072996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8a993-b431-42b2-b29a-3baee2fe2f9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:41.084000 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8a993-b431-42b2-b29a-3baee2fe2f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:05:41.088307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94051665-0f95-4afc-a6be-ba26940a56dc None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:41.089342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-73b8a993-b431-42b2-b29a-3baee2fe2f9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:05:41.089342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:41.089342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:41.089342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:41.089342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:41.089342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:41.089342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:41.089342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:41.089342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:41.089342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:41.089342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:41.089342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:41.089342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:05:41.089342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:05:41.089342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:05:41.089342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:05:41.090234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:05:41.090234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:05:41.090234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:05:41.090234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:05:41.090234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:41.090234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:41.090234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:41.090234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:41.090234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:41.090234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:41.090234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:41.090234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:41.090234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:41.090234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:41.090234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:41.090234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:41.091068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:41.091068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:41.091068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:41.091068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:41.091068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:05:41.091068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:05:41.091068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:05:41.091068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:05:41.091068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:05:41.091068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:05:41.091068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:05:41.091068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:41.091068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 509/1041] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:05:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:41.097020 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8a993-b431-42b2-b29a-3baee2fe2f9e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:41.102806 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:41.130919 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88985bd4-bdbe-49bb-9603-5d28afe8fce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:41.131562 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88985bd4-bdbe-49bb-9603-5d28afe8fce5 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:41.131823 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88985bd4-bdbe-49bb-9603-5d28afe8fce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:41.132100 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88985bd4-bdbe-49bb-9603-5d28afe8fce5 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:41.132921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88985bd4-bdbe-49bb-9603-5d28afe8fce5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:41.133230 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88985bd4-bdbe-49bb-9603-5d28afe8fce5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:41.133933 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:41.134664 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88985bd4-bdbe-49bb-9603-5d28afe8fce5 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:41.153638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 533/1042] 10.222.0.141 () {56 vars in 1138 bytes} [Tue Jul 26 16:05:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:41.159683 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88985bd4-bdbe-49bb-9603-5d28afe8fce5 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:41.201842 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8a993-b431-42b2-b29a-3baee2fe2f9e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:41.242099 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cc98c-dbcf-4c98-ad2d-f335e23232ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:41.242716 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cc98c-dbcf-4c98-ad2d-f335e23232ac None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:41.242996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cc98c-dbcf-4c98-ad2d-f335e23232ac None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:41.243267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cc98c-dbcf-4c98-ad2d-f335e23232ac None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:41.244106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cc98c-dbcf-4c98-ad2d-f335e23232ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:41.244413 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cc98c-dbcf-4c98-ad2d-f335e23232ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:41.245830 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cc98c-dbcf-4c98-ad2d-f335e23232ac None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:41.254843 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 510/1043] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:05:41 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:41.260169 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cc98c-dbcf-4c98-ad2d-f335e23232ac None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:41.264784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88985bd4-bdbe-49bb-9603-5d28afe8fce5 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:41.304027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c140a2b-c43d-4559-8ce3-2b0a46e0512d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:41.304653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c140a2b-c43d-4559-8ce3-2b0a46e0512d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:41.304984 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c140a2b-c43d-4559-8ce3-2b0a46e0512d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:41.305262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c140a2b-c43d-4559-8ce3-2b0a46e0512d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:41.338350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:41.370353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:41.377554 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cc98c-dbcf-4c98-ad2d-f335e23232ac None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:41.380966 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c140a2b-c43d-4559-8ce3-2b0a46e0512d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:41.382432 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c140a2b-c43d-4559-8ce3-2b0a46e0512d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:41.415547 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f470dc6-2bbb-427b-a0ed-84f169a114a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:41.416109 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f470dc6-2bbb-427b-a0ed-84f169a114a7 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:41.416391 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f470dc6-2bbb-427b-a0ed-84f169a114a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:41.416678 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f470dc6-2bbb-427b-a0ed-84f169a114a7 None admin] PATH_INFO: `/v3/users/9d3dc52033e540a3add60d1e0c6fb56a` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:41.431415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f470dc6-2bbb-427b-a0ed-84f169a114a7 None admin] RBAC: Authorizing `identity:get_user(user_id=9d3dc52033e540a3add60d1e0c6fb56a)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:41.432893 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f470dc6-2bbb-427b-a0ed-84f169a114a7 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:41.439618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 511/1044] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:05:41 2022] GET /identity/v3/users/9d3dc52033e540a3add60d1e0c6fb56a => generated 286 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:41.441546 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f470dc6-2bbb-427b-a0ed-84f169a114a7 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:41.490352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 534/1045] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:05:41 2022] GET /identity/v3/auth/tokens => generated 1963 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 16:05:41.495899 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c140a2b-c43d-4559-8ce3-2b0a46e0512d None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:41.552206 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f470dc6-2bbb-427b-a0ed-84f169a114a7 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:41.558906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:41.587254 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02509e-54e3-44b5-96c0-600cbd465d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:41.587874 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02509e-54e3-44b5-96c0-600cbd465d03 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:41.588159 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02509e-54e3-44b5-96c0-600cbd465d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:41.588431 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02509e-54e3-44b5-96c0-600cbd465d03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:41.602082 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c140a2b-c43d-4559-8ce3-2b0a46e0512d None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:41.614263 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:41.640842 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9644c8d-5be9-4c6d-b476-8175d614ea9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:41.641791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9644c8d-5be9-4c6d-b476-8175d614ea9d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:41.642154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9644c8d-5be9-4c6d-b476-8175d614ea9d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:41.642432 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9644c8d-5be9-4c6d-b476-8175d614ea9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:41.652867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9644c8d-5be9-4c6d-b476-8175d614ea9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:41.654211 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9644c8d-5be9-4c6d-b476-8175d614ea9d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:41.660865 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02509e-54e3-44b5-96c0-600cbd465d03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:41.662306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02509e-54e3-44b5-96c0-600cbd465d03 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:41.669741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-a9644c8d-5be9-4c6d-b476-8175d614ea9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:41.669741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:41.669741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:41.669741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:41.669741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:41.669741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:41.669741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:41.669741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:41.669741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:41.669741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:41.669741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:41.669741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:41.669741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:41.669741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:41.669741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:41.670762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:41.670762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:41.670762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:41.670762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:41.670762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:41.670762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:41.670762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:41.670762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:41.670762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:41.670762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:41.670762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:41.670762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:41.670762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:41.670762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:41.670762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:41.670762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:41.670762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:41.671677 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:41.671677 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:41.671677 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:41.671677 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:41.671677 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 535/1046] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:41.676402 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9644c8d-5be9-4c6d-b476-8175d614ea9d None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:41.772104 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 512/1047] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:05:41 2022] GET /identity/v3/auth/tokens => generated 1963 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 16:05:41.777680 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02509e-54e3-44b5-96c0-600cbd465d03 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:41.783618 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9644c8d-5be9-4c6d-b476-8175d614ea9d None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:41.801246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:41.819942 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af70780-b59f-4af2-9fb4-4e9585669891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:41.820549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af70780-b59f-4af2-9fb4-4e9585669891 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:41.820866 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af70780-b59f-4af2-9fb4-4e9585669891 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:41.821138 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af70780-b59f-4af2-9fb4-4e9585669891 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:41.821826 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af70780-b59f-4af2-9fb4-4e9585669891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:41.822129 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af70780-b59f-4af2-9fb4-4e9585669891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:41.823488 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af70780-b59f-4af2-9fb4-4e9585669891 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:41.836081 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 536/1048] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:41.836438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:41.841589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af70780-b59f-4af2-9fb4-4e9585669891 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:41.889549 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02509e-54e3-44b5-96c0-600cbd465d03 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:41.931197 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9ebab-705c-428c-b6bc-84f148783682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:41.931767 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9ebab-705c-428c-b6bc-84f148783682 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:41.932048 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9ebab-705c-428c-b6bc-84f148783682 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:41.932696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9ebab-705c-428c-b6bc-84f148783682 None admin] PATH_INFO: `/v3/projects/24543c8f69a44b1dba1e3f29c98c4f03` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:41.933572 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9ebab-705c-428c-b6bc-84f148783682 None admin] RBAC: Authorizing `identity:get_project(project_id=24543c8f69a44b1dba1e3f29c98c4f03)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:41.935008 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9ebab-705c-428c-b6bc-84f148783682 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:41.937067 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 513/1049] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:05:41 2022] GET /identity/v3/projects/24543c8f69a44b1dba1e3f29c98c4f03 => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:41.942786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9ebab-705c-428c-b6bc-84f148783682 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:41.972770 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af70780-b59f-4af2-9fb4-4e9585669891 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:42.009824 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbb32b-a2af-46c8-8b96-57919d77a552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:42.010456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbb32b-a2af-46c8-8b96-57919d77a552 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:42.010734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbb32b-a2af-46c8-8b96-57919d77a552 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:42.011009 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbb32b-a2af-46c8-8b96-57919d77a552 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:42.017925 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbb32b-a2af-46c8-8b96-57919d77a552 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:42.020443 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbb32b-a2af-46c8-8b96-57919d77a552 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:42.033634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-42dbb32b-a2af-46c8-8b96-57919d77a552 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:42.033634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:42.033634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:42.033634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:42.033634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:42.033634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:42.033634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:42.033634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:42.033634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:42.033634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:42.033634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:42.033634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:42.033634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:05:42.033634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:05:42.033634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:05:42.034565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:05:42.034565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:42.034565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:42.034565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:42.034565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:42.034565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:42.034565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:42.034565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:42.034565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:42.034565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:42.034565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:42.034565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:42.034565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:42.034565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:42.034565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:42.034565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:42.034565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:42.036080 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:05:42.036080 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:05:42.036080 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:05:42.036080 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:05:42.036080 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:05:42.036080 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:05:42.036080 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:42.036080 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:42.036080 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 537/1050] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:42.040365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbb32b-a2af-46c8-8b96-57919d77a552 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:42.053701 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9ebab-705c-428c-b6bc-84f148783682 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:42.076465 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:42.078453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:42.089550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28593f85-7f3e-463f-9008-62d435488c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:42.090161 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28593f85-7f3e-463f-9008-62d435488c7d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:42.090444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28593f85-7f3e-463f-9008-62d435488c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:42.090717 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28593f85-7f3e-463f-9008-62d435488c7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:42.098428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28593f85-7f3e-463f-9008-62d435488c7d None admin] RBAC: Adding query filter params (role.id=94ecbd6c86a84b75bdb0c57fc27a9a07, scope.project.id=24543c8f69a44b1dba1e3f29c98c4f03, user.id=9d3dc52033e540a3add60d1e0c6fb56a) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:42.098428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28593f85-7f3e-463f-9008-62d435488c7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:42.098428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28593f85-7f3e-463f-9008-62d435488c7d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:42.099181 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 514/1051] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:05:41 2022] GET /identity/v3/role_assignments?user.id=9d3dc52033e540a3add60d1e0c6fb56a&scope.project.id=24543c8f69a44b1dba1e3f29c98c4f03&role.id=94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:42.146943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbb32b-a2af-46c8-8b96-57919d77a552 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:42.186997 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44045efd-96e5-45d4-b303-e4a1e895dbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:42.187984 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44045efd-96e5-45d4-b303-e4a1e895dbec None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:42.188470 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44045efd-96e5-45d4-b303-e4a1e895dbec None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:42.189013 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44045efd-96e5-45d4-b303-e4a1e895dbec None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:42.190059 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44045efd-96e5-45d4-b303-e4a1e895dbec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:42.190614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44045efd-96e5-45d4-b303-e4a1e895dbec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:42.192271 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44045efd-96e5-45d4-b303-e4a1e895dbec None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:42.206502 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 538/1052] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:05:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:42.212442 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28593f85-7f3e-463f-9008-62d435488c7d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:42.328126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28593f85-7f3e-463f-9008-62d435488c7d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:42.363307 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcba5b-53b2-49c8-998e-3c5507c09562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:42.363974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcba5b-53b2-49c8-998e-3c5507c09562 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:42.364264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcba5b-53b2-49c8-998e-3c5507c09562 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:42.364538 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcba5b-53b2-49c8-998e-3c5507c09562 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:42.365428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcba5b-53b2-49c8-998e-3c5507c09562 None admin] RBAC: Adding query filter params (role.id=7b1cae16e1ba4a1c8c57b844e944c8a5, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=f7eac931cabf4921b6dbd42f63b9300f) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:42.365741 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcba5b-53b2-49c8-998e-3c5507c09562 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:42.367205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcba5b-53b2-49c8-998e-3c5507c09562 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:42.380760 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 515/1053] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:05:42 2022] GET /identity/v3/role_assignments?user.id=f7eac931cabf4921b6dbd42f63b9300f&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=7b1cae16e1ba4a1c8c57b844e944c8a5 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:42.816477 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46574d-62a8-43fa-8943-7248be1a5be7 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:42.816919 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46574d-62a8-43fa-8943-7248be1a5be7 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:42.817097 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46574d-62a8-43fa-8943-7248be1a5be7 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:42.818471 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 539/1054] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:42.823585 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d51f7-b434-4968-8ff9-f89c2457b0e9 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:42.823874 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d51f7-b434-4968-8ff9-f89c2457b0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:42.824148 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d51f7-b434-4968-8ff9-f89c2457b0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:42.842839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-688d51f7-b434-4968-8ff9-f89c2457b0e9 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:42.844042 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-688d51f7-b434-4968-8ff9-f89c2457b0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:42.892418 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:42.916776 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 516/1055] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:42 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:42.936491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46574d-62a8-43fa-8943-7248be1a5be7 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:43.038865 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:43.047415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46574d-62a8-43fa-8943-7248be1a5be7 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:43.081875 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295e3a6-1cd9-4ed1-a2b9-c88dca903418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:43.082452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295e3a6-1cd9-4ed1-a2b9-c88dca903418 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:43.082777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295e3a6-1cd9-4ed1-a2b9-c88dca903418 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:43.083052 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295e3a6-1cd9-4ed1-a2b9-c88dca903418 None admin] PATH_INFO: `/v3/services/image` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:43.083753 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295e3a6-1cd9-4ed1-a2b9-c88dca903418 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:43.085047 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295e3a6-1cd9-4ed1-a2b9-c88dca903418 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:43.094120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-d295e3a6-1cd9-4ed1-a2b9-c88dca903418 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 16:05:43.094120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:43.094120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:05:43.094120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:05:43.094120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:05:43.094120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:05:43.094120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:05:43.094120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:43.094120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 16:05:43.094120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:43.094120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:05:43.094120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:43.094120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:43.094120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:43.094120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:43.094120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:43.094120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:43.095345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:43.095345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:43.095345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:43.095345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:43.095345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:43.095345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:43.095345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:05:43.095345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:05:43.095345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:05:43.095345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:05:43.095345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:43.095345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:43.095345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:43.095345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:43.095345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:43.095345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:43.096181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:43.096181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:43.096181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:43.096181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:43.096181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:43.096181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:43.096181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:43.096181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:43.096181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:43.096181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:43.096181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:05:43.096181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:05:43.096181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 16:05:43.096181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:43.100484 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 540/1056] 10.222.0.141 () {56 vars in 1110 bytes} [Tue Jul 26 16:05:42 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:43.101692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d51f7-b434-4968-8ff9-f89c2457b0e9 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:43.201739 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d51f7-b434-4968-8ff9-f89c2457b0e9 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:43.236117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41af69-3e64-418a-affd-9ff4b2f91195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:43.236760 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41af69-3e64-418a-affd-9ff4b2f91195 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:43.237045 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41af69-3e64-418a-affd-9ff4b2f91195 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:43.237319 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41af69-3e64-418a-affd-9ff4b2f91195 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:43.237987 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41af69-3e64-418a-affd-9ff4b2f91195 None admin] RBAC: Adding query filter params (name=image) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:43.238289 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41af69-3e64-418a-affd-9ff4b2f91195 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:43.239654 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41af69-3e64-418a-affd-9ff4b2f91195 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:43.249069 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 517/1057] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:43 2022] GET /identity/v3/services?name=image => generated 123 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:43.250753 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295e3a6-1cd9-4ed1-a2b9-c88dca903418 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:43.352131 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295e3a6-1cd9-4ed1-a2b9-c88dca903418 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:43.385968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8abe7-377a-413d-a92a-410575f50006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:43.386581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8abe7-377a-413d-a92a-410575f50006 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:43.386857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8abe7-377a-413d-a92a-410575f50006 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:43.387127 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8abe7-377a-413d-a92a-410575f50006 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:43.387868 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8abe7-377a-413d-a92a-410575f50006 None admin] RBAC: Adding query filter params (type=image) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:43.388172 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8abe7-377a-413d-a92a-410575f50006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:43.389640 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8abe7-377a-413d-a92a-410575f50006 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:43.395146 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 541/1058] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:43 2022] GET /identity/v3/services?type=image => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:43.400564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41af69-3e64-418a-affd-9ff4b2f91195 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:43.448181 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:43.504215 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41af69-3e64-418a-affd-9ff4b2f91195 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:43.539209 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2c29b-50d7-435b-86a7-6779a32dc50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:43.539831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2c29b-50d7-435b-86a7-6779a32dc50c None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:43.540113 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2c29b-50d7-435b-86a7-6779a32dc50c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:43.540393 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2c29b-50d7-435b-86a7-6779a32dc50c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:43.541140 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2c29b-50d7-435b-86a7-6779a32dc50c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:43.542511 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2c29b-50d7-435b-86a7-6779a32dc50c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:43.629561 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 518/1059] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:05:43 2022] POST /identity/v3/endpoints => generated 329 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:05:44.102383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcded0-50da-478b-a55f-8fa831b6bc16 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:44.102910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcded0-50da-478b-a55f-8fa831b6bc16 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:44.102910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcded0-50da-478b-a55f-8fa831b6bc16 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:44.104282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 542/1060] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:44.109559 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9231b-4077-41f6-bf3d-c613607cc1ed None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:44.109981 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9231b-4077-41f6-bf3d-c613607cc1ed None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:44.110148 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9231b-4077-41f6-bf3d-c613607cc1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:44.128841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c6e9231b-4077-41f6-bf3d-c613607cc1ed None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:44.130020 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c6e9231b-4077-41f6-bf3d-c613607cc1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:44.205404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 519/1061] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:44 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:44.226622 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcded0-50da-478b-a55f-8fa831b6bc16 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:44.253009 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:44.333385 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcded0-50da-478b-a55f-8fa831b6bc16 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:44.366927 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c46df-6b13-4953-8ac9-6db267da1c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:44.367566 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c46df-6b13-4953-8ac9-6db267da1c14 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:44.367843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c46df-6b13-4953-8ac9-6db267da1c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:44.368113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c46df-6b13-4953-8ac9-6db267da1c14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:44.372533 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581eb4d-0681-4c83-bfc9-945be402e4fe None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:44.372857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581eb4d-0681-4c83-bfc9-945be402e4fe None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:44.373133 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581eb4d-0681-4c83-bfc9-945be402e4fe None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:44.375516 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 520/1062] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:05:44.379893 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c46df-6b13-4953-8ac9-6db267da1c14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:05:44.380105 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca7b23-502f-4ebc-b325-58474d42bac7 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:44.380342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca7b23-502f-4ebc-b325-58474d42bac7 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:44.380617 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca7b23-502f-4ebc-b325-58474d42bac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:44.384840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-170c46df-6b13-4953-8ac9-6db267da1c14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:05:44.384840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:44.384840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:44.384840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:44.384840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:44.384840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:44.384840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:44.384840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:44.384840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:44.384840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:44.384840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:44.384840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:44.384840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:05:44.384840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:05:44.384840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:05:44.384840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:05:44.385815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:05:44.385815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:05:44.385815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:05:44.385815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:05:44.385815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:44.385815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:44.385815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:44.385815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:44.385815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:44.385815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:44.385815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:44.385815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:44.385815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:44.385815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:44.385815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:44.385815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:44.386633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:44.386633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:44.386633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:44.386633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:44.386633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:05:44.386633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:05:44.386633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:05:44.386633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:05:44.386633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:05:44.386633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:05:44.386633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:05:44.386633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:44.386633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 543/1063] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:05:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:44.391867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c46df-6b13-4953-8ac9-6db267da1c14 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:44.402955 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-1bca7b23-502f-4ebc-b325-58474d42bac7 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:44.404262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1bca7b23-502f-4ebc-b325-58474d42bac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:44.425872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:44.473328 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 521/1064] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:44 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 16:05:44.484718 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:44.495690 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca7b23-502f-4ebc-b325-58474d42bac7 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:44.502280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c46df-6b13-4953-8ac9-6db267da1c14 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:44.537508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d88047-a503-4e94-8f5d-727172420a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:44.538120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d88047-a503-4e94-8f5d-727172420a60 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:44.538397 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d88047-a503-4e94-8f5d-727172420a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:44.538667 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d88047-a503-4e94-8f5d-727172420a60 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:44.539368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d88047-a503-4e94-8f5d-727172420a60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:44.539669 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d88047-a503-4e94-8f5d-727172420a60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:44.541067 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d88047-a503-4e94-8f5d-727172420a60 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:44.551513 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 544/1065] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:05:44 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:44.557134 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d88047-a503-4e94-8f5d-727172420a60 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:44.598025 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca7b23-502f-4ebc-b325-58474d42bac7 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:44.632914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe8df3-4705-41a7-9098-dcbf599c3fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:44.633561 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe8df3-4705-41a7-9098-dcbf599c3fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:44.633844 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe8df3-4705-41a7-9098-dcbf599c3fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:44.634117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe8df3-4705-41a7-9098-dcbf599c3fb8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:44.644718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe8df3-4705-41a7-9098-dcbf599c3fb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:05:44.649609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-0ffe8df3-4705-41a7-9098-dcbf599c3fb8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 16:05:44.649609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:44.649609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:44.649609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:44.649609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:44.649609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:44.649609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:44.649609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:44.649609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:44.649609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:44.649609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:44.649609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:44.649609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:05:44.649609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:05:44.649609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:05:44.649609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:05:44.650518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:05:44.650518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:05:44.650518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:05:44.650518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:05:44.650518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:44.650518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:44.650518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:44.650518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:44.650518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:44.650518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:44.650518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:44.650518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:44.650518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:44.650518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:44.650518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:44.650518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:44.651480 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:44.651480 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:44.651480 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:44.651480 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:44.651480 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:05:44.651480 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:05:44.651480 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:05:44.651480 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:05:44.651480 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:05:44.651480 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:05:44.651480 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 16:05:44.651480 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:44.651480 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 522/1066] 10.222.0.141 () {56 vars in 1125 bytes} [Tue Jul 26 16:05:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:44.656577 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe8df3-4705-41a7-9098-dcbf599c3fb8 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:44.663963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d88047-a503-4e94-8f5d-727172420a60 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:44.675093 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:44.701770 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264ec2c-3705-4c4b-9087-8b205a4fcf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:44.702432 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264ec2c-3705-4c4b-9087-8b205a4fcf54 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:44.702709 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264ec2c-3705-4c4b-9087-8b205a4fcf54 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:44.702978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264ec2c-3705-4c4b-9087-8b205a4fcf54 None admin] PATH_INFO: `/v3/users/9d3dc52033e540a3add60d1e0c6fb56a` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:44.704221 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264ec2c-3705-4c4b-9087-8b205a4fcf54 None admin] RBAC: Authorizing `identity:get_user(user_id=9d3dc52033e540a3add60d1e0c6fb56a)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:44.705690 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264ec2c-3705-4c4b-9087-8b205a4fcf54 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:44.707477 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 545/1067] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:05:44 2022] GET /identity/v3/users/9d3dc52033e540a3add60d1e0c6fb56a => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:44.712892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264ec2c-3705-4c4b-9087-8b205a4fcf54 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:44.729816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:44.766664 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe8df3-4705-41a7-9098-dcbf599c3fb8 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:44.804463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b3d6a-ec10-4739-9185-6a305451c623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:44.805103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b3d6a-ec10-4739-9185-6a305451c623 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:44.805376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b3d6a-ec10-4739-9185-6a305451c623 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:44.805665 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b3d6a-ec10-4739-9185-6a305451c623 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:44.806348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b3d6a-ec10-4739-9185-6a305451c623 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:44.806651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b3d6a-ec10-4739-9185-6a305451c623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:44.808050 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b3d6a-ec10-4739-9185-6a305451c623 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:44.816112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 523/1068] 10.222.0.141 () {56 vars in 1120 bytes} [Tue Jul 26 16:05:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:44.821727 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b3d6a-ec10-4739-9185-6a305451c623 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:44.827102 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264ec2c-3705-4c4b-9087-8b205a4fcf54 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:44.872762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a0a31-9d17-4ed6-9ce0-cb7ff89b7526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:44.873420 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a0a31-9d17-4ed6-9ce0-cb7ff89b7526 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:44.873779 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a0a31-9d17-4ed6-9ce0-cb7ff89b7526 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:44.874049 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a0a31-9d17-4ed6-9ce0-cb7ff89b7526 None admin] PATH_INFO: `/v3/projects/24543c8f69a44b1dba1e3f29c98c4f03` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:44.875223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a0a31-9d17-4ed6-9ce0-cb7ff89b7526 None admin] RBAC: Authorizing `identity:get_project(project_id=24543c8f69a44b1dba1e3f29c98c4f03)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:44.876640 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a0a31-9d17-4ed6-9ce0-cb7ff89b7526 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:44.878449 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 546/1069] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:05:44 2022] GET /identity/v3/projects/24543c8f69a44b1dba1e3f29c98c4f03 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:44.884462 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a0a31-9d17-4ed6-9ce0-cb7ff89b7526 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:44.904752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:44.932176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b3d6a-ec10-4739-9185-6a305451c623 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:44.969606 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f439d-21b4-49d2-8d38-d9323da0aa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:44.970252 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f439d-21b4-49d2-8d38-d9323da0aa79 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:44.970532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f439d-21b4-49d2-8d38-d9323da0aa79 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:44.970805 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f439d-21b4-49d2-8d38-d9323da0aa79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:44.980088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:44.983700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f439d-21b4-49d2-8d38-d9323da0aa79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:44.985738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f439d-21b4-49d2-8d38-d9323da0aa79 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:44.998348 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a0a31-9d17-4ed6-9ce0-cb7ff89b7526 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:45.004170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-457f439d-21b4-49d2-8d38-d9323da0aa79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:45.004170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:45.004170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:45.004170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:45.004170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:45.004170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:45.004170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:45.004170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:45.004170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:45.004170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:45.004170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:45.004170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:45.004170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:45.004170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:45.004170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:45.005070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:45.005070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:45.005070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:45.005070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:45.005070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:45.005070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:45.005070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:45.005070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:45.005070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:45.005070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:45.005070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:45.005070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:45.005070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:45.005070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:45.005070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:45.005070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:45.005070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:45.005954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:45.005954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:45.005954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:45.005954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:45.010125 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 524/1070] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:45.010947 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f439d-21b4-49d2-8d38-d9323da0aa79 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:45.036436 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d743f63-213f-44c7-a6d3-9d6a09ad87f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:45.037140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d743f63-213f-44c7-a6d3-9d6a09ad87f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:45.037423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d743f63-213f-44c7-a6d3-9d6a09ad87f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:45.037706 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d743f63-213f-44c7-a6d3-9d6a09ad87f7 None admin] PATH_INFO: `/v3/projects/24543c8f69a44b1dba1e3f29c98c4f03/users/9d3dc52033e540a3add60d1e0c6fb56a/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:45.039657 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d743f63-213f-44c7-a6d3-9d6a09ad87f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=24543c8f69a44b1dba1e3f29c98c4f03, user_id=9d3dc52033e540a3add60d1e0c6fb56a, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:45.041123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d743f63-213f-44c7-a6d3-9d6a09ad87f7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:45.108915 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 547/1071] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:05:44 2022] PUT /identity/v3/projects/24543c8f69a44b1dba1e3f29c98c4f03/users/9d3dc52033e540a3add60d1e0c6fb56a/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:05:45.123835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f439d-21b4-49d2-8d38-d9323da0aa79 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:45.158042 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:45.164342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e2164-7745-470e-8f15-b605eabed188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:45.165085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e2164-7745-470e-8f15-b605eabed188 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:45.165370 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e2164-7745-470e-8f15-b605eabed188 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:45.165645 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e2164-7745-470e-8f15-b605eabed188 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:45.166360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e2164-7745-470e-8f15-b605eabed188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:45.166665 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e2164-7745-470e-8f15-b605eabed188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:45.168070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e2164-7745-470e-8f15-b605eabed188 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:45.181628 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 525/1072] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:45.187393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d743f63-213f-44c7-a6d3-9d6a09ad87f7 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:45.302776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d743f63-213f-44c7-a6d3-9d6a09ad87f7 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:45.336107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb4c4c-632d-4a17-863e-f82c11063608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:45.336775 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb4c4c-632d-4a17-863e-f82c11063608 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:45.337058 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb4c4c-632d-4a17-863e-f82c11063608 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:45.337330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb4c4c-632d-4a17-863e-f82c11063608 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:45.345070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb4c4c-632d-4a17-863e-f82c11063608 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:45.346518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb4c4c-632d-4a17-863e-f82c11063608 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:45.358317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-dfeb4c4c-632d-4a17-863e-f82c11063608 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 16:05:45.358317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:45.358317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:45.358317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:45.358317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:45.358317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:45.358317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:45.358317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:45.358317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:45.358317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:45.358317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:45.358317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:45.358317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:05:45.358317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:05:45.358317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:05:45.358317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:05:45.359284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:45.359284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:45.359284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:05:45.359284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:45.359284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:05:45.359284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:45.359284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:45.359284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:45.359284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:45.359284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:45.359284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:45.359284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:45.359284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:45.359284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:45.359284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:45.359284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:45.359284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:45.359284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:45.360209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:45.360209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:45.360209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:05:45.360209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:05:45.360209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:05:45.360209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:05:45.360209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:05:45.360209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:05:45.360209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 16:05:45.360209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:45.360209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 548/1073] 10.222.0.141 () {56 vars in 1098 bytes} [Tue Jul 26 16:05:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:45.365498 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e2164-7745-470e-8f15-b605eabed188 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:45.466285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e2164-7745-470e-8f15-b605eabed188 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:45.500315 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b196c1-3de5-4189-87ee-334c7fad9083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:45.500957 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b196c1-3de5-4189-87ee-334c7fad9083 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:45.501238 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b196c1-3de5-4189-87ee-334c7fad9083 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:45.501511 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b196c1-3de5-4189-87ee-334c7fad9083 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:45.502298 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b196c1-3de5-4189-87ee-334c7fad9083 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:45.502606 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b196c1-3de5-4189-87ee-334c7fad9083 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:45.504033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b196c1-3de5-4189-87ee-334c7fad9083 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:45.526461 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 526/1074] 10.222.0.141 () {56 vars in 1138 bytes} [Tue Jul 26 16:05:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:45.527897 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb4c4c-632d-4a17-863e-f82c11063608 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:45.530797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:45.637423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb4c4c-632d-4a17-863e-f82c11063608 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:45.669389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07aab5-f751-4e4d-9e81-c6cccc283534 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:45.669718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07aab5-f751-4e4d-9e81-c6cccc283534 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:45.669952 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07aab5-f751-4e4d-9e81-c6cccc283534 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:45.671474 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 527/1075] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:05:45.671577 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff7e38-f73b-4b70-b345-e195284a2bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:45.672396 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff7e38-f73b-4b70-b345-e195284a2bdd None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:45.672651 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff7e38-f73b-4b70-b345-e195284a2bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:45.672862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff7e38-f73b-4b70-b345-e195284a2bdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:45.676514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba936a10-275b-460c-bd25-0673a7a61521 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:45.676834 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba936a10-275b-460c-bd25-0673a7a61521 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:45.677116 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba936a10-275b-460c-bd25-0673a7a61521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:45.683938 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff7e38-f73b-4b70-b345-e195284a2bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:45.685406 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff7e38-f73b-4b70-b345-e195284a2bdd None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:45.695373 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ba936a10-275b-460c-bd25-0673a7a61521 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:45.696635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ba936a10-275b-460c-bd25-0673a7a61521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:45.699967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-baff7e38-f73b-4b70-b345-e195284a2bdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:45.699967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:45.699967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:45.699967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:45.699967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:45.699967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:45.699967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:45.699967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:45.699967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:45.699967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:45.699967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:45.699967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:45.699967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:45.699967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:45.699967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:45.701088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:45.701088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:45.701088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:45.701088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:45.701088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:45.701088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:45.701088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:45.701088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:45.701088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:45.701088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:45.701088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:45.701088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:45.701088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:45.701088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:45.701088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:45.701088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:45.701088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:45.707463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:45.707463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:45.707463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:45.707463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:45.707463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 549/1076] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:45.707463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff7e38-f73b-4b70-b345-e195284a2bdd None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:45.745354 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:45.764008 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:45.769858 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 528/1077] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:45 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 16:05:45.792255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba936a10-275b-460c-bd25-0673a7a61521 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:45.813360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff7e38-f73b-4b70-b345-e195284a2bdd None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:45.849847 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98c22d-f8db-4382-bf1b-c8a4e207a2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:45.850469 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98c22d-f8db-4382-bf1b-c8a4e207a2ef None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:45.850751 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98c22d-f8db-4382-bf1b-c8a4e207a2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:45.851026 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98c22d-f8db-4382-bf1b-c8a4e207a2ef None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:45.851838 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98c22d-f8db-4382-bf1b-c8a4e207a2ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:45.852265 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98c22d-f8db-4382-bf1b-c8a4e207a2ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:45.853663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98c22d-f8db-4382-bf1b-c8a4e207a2ef None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:45.867446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 550/1078] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:45.872528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98c22d-f8db-4382-bf1b-c8a4e207a2ef None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:45.899119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba936a10-275b-460c-bd25-0673a7a61521 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:45.945143 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32e1d9-1a8c-429c-be14-049713732d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:45.946115 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32e1d9-1a8c-429c-be14-049713732d1f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:45.946400 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32e1d9-1a8c-429c-be14-049713732d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:45.946680 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32e1d9-1a8c-429c-be14-049713732d1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:45.988603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98c22d-f8db-4382-bf1b-c8a4e207a2ef None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:45.996531 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:46.002757 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:46.020233 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32e1d9-1a8c-429c-be14-049713732d1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:46.021808 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32e1d9-1a8c-429c-be14-049713732d1f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:46.022600 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4663649-c36d-46e1-8f05-4d180114c99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:46.023237 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4663649-c36d-46e1-8f05-4d180114c99c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:46.023520 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4663649-c36d-46e1-8f05-4d180114c99c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:46.023792 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4663649-c36d-46e1-8f05-4d180114c99c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:46.030448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4663649-c36d-46e1-8f05-4d180114c99c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:46.031874 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4663649-c36d-46e1-8f05-4d180114c99c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:46.043177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-a4663649-c36d-46e1-8f05-4d180114c99c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:46.043177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:46.043177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:46.043177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:46.043177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:46.043177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:46.043177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:46.043177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:46.043177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:46.043177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:46.043177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:46.043177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:46.043177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:05:46.043177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:05:46.043177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:05:46.050305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:05:46.050305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:46.050305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:46.050305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:46.050305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:46.050305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:46.050305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:46.050305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:46.050305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:46.050305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:46.050305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:46.050305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:46.050305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:46.050305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:46.050305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:46.050305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:46.050305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:46.051186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:05:46.051186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:05:46.051186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:05:46.051186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:05:46.051186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:05:46.051186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:05:46.051186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:46.051186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:46.051186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 551/1079] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:46.051692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4663649-c36d-46e1-8f05-4d180114c99c None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:46.125407 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 529/1080] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:05:45 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 16:05:46.131211 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32e1d9-1a8c-429c-be14-049713732d1f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:46.161640 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4663649-c36d-46e1-8f05-4d180114c99c None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:46.196974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198ecfd-bc6b-429f-9c40-3878b7045660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:46.197599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198ecfd-bc6b-429f-9c40-3878b7045660 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:46.197888 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198ecfd-bc6b-429f-9c40-3878b7045660 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:46.198159 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198ecfd-bc6b-429f-9c40-3878b7045660 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:46.198913 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198ecfd-bc6b-429f-9c40-3878b7045660 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:46.199220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198ecfd-bc6b-429f-9c40-3878b7045660 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:46.200642 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198ecfd-bc6b-429f-9c40-3878b7045660 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:46.210076 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:46.213254 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 552/1081] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:05:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:46.219781 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198ecfd-bc6b-429f-9c40-3878b7045660 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:46.235439 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32e1d9-1a8c-429c-be14-049713732d1f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:46.256884 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:46.271103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa8533-98fe-426b-a24c-73cf2ebe031c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:46.272061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa8533-98fe-426b-a24c-73cf2ebe031c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:46.272343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa8533-98fe-426b-a24c-73cf2ebe031c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:46.272621 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa8533-98fe-426b-a24c-73cf2ebe031c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:46.284059 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa8533-98fe-426b-a24c-73cf2ebe031c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:46.285648 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa8533-98fe-426b-a24c-73cf2ebe031c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:46.301977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-5eaa8533-98fe-426b-a24c-73cf2ebe031c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:46.301977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:46.301977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:46.301977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:46.301977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:46.301977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:46.301977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:46.301977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:46.301977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:46.301977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:46.301977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:46.301977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:46.301977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:46.301977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:46.301977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:46.302914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:46.302914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:46.302914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:46.302914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:46.302914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:46.302914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:46.302914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:46.302914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:46.302914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:46.302914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:46.302914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:46.302914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:46.302914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:46.302914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:46.302914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:46.302914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:46.302914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:46.303783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:46.303783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:46.303783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:46.303783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:46.303783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 530/1082] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:46.309900 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa8533-98fe-426b-a24c-73cf2ebe031c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:46.336581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198ecfd-bc6b-429f-9c40-3878b7045660 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:46.372894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc759ff-ecf4-47d9-9651-b5129f483fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:46.373560 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc759ff-ecf4-47d9-9651-b5129f483fdb None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:46.373846 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc759ff-ecf4-47d9-9651-b5129f483fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:46.374126 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc759ff-ecf4-47d9-9651-b5129f483fdb None admin] PATH_INFO: `/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/f7eac931cabf4921b6dbd42f63b9300f/roles/7b1cae16e1ba4a1c8c57b844e944c8a5` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:46.376381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc759ff-ecf4-47d9-9651-b5129f483fdb None admin] RBAC: Authorizing `identity:create_grant(project_id=3747e176cdf2495d9b31a1afae618f68, user_id=f7eac931cabf4921b6dbd42f63b9300f, role_id=7b1cae16e1ba4a1c8c57b844e944c8a5)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:46.377846 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc759ff-ecf4-47d9-9651-b5129f483fdb None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:46.413485 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa8533-98fe-426b-a24c-73cf2ebe031c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:46.441541 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:46.447518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9cbf5-943b-48d3-ab72-9a0a7a26bf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:46.448135 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9cbf5-943b-48d3-ab72-9a0a7a26bf6b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:46.448417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9cbf5-943b-48d3-ab72-9a0a7a26bf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:46.448835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9cbf5-943b-48d3-ab72-9a0a7a26bf6b None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:46.449457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9cbf5-943b-48d3-ab72-9a0a7a26bf6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:46.449763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9cbf5-943b-48d3-ab72-9a0a7a26bf6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:46.451155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9cbf5-943b-48d3-ab72-9a0a7a26bf6b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:46.459395 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 553/1083] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:05:46 2022] PUT /identity/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/f7eac931cabf4921b6dbd42f63b9300f/roles/7b1cae16e1ba4a1c8c57b844e944c8a5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:05:46.463670 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 531/1084] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:47.141734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb777ae-c5ef-470c-bbc8-adf2b36dd10d None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:47.142019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb777ae-c5ef-470c-bbc8-adf2b36dd10d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:47.142292 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb777ae-c5ef-470c-bbc8-adf2b36dd10d None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:47.143637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 554/1085] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:47.149150 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dba673-63cc-4e09-bcfd-4b7fe2370d82 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:47.149610 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dba673-63cc-4e09-bcfd-4b7fe2370d82 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:47.149699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dba673-63cc-4e09-bcfd-4b7fe2370d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:47.168259 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-34dba673-63cc-4e09-bcfd-4b7fe2370d82 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:47.169491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-34dba673-63cc-4e09-bcfd-4b7fe2370d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:47.234828 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 532/1086] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:47 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:47.258639 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb777ae-c5ef-470c-bbc8-adf2b36dd10d None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:47.350549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:47.357930 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb777ae-c5ef-470c-bbc8-adf2b36dd10d None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:47.391669 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc46e7a-edf6-497b-b189-a699df5be271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:47.392296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc46e7a-edf6-497b-b189-a699df5be271 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:47.392579 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc46e7a-edf6-497b-b189-a699df5be271 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:47.392880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc46e7a-edf6-497b-b189-a699df5be271 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:47.402697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc46e7a-edf6-497b-b189-a699df5be271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:05:47.407607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-6dc46e7a-edf6-497b-b189-a699df5be271 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:05:47.407607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:47.407607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:47.407607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:47.407607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:47.407607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:47.407607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:47.407607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:47.407607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:47.407607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:47.407607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:47.407607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:47.407607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:05:47.407607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:05:47.407607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:05:47.407607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:05:47.408518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:05:47.408518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:05:47.408518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:05:47.408518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:05:47.408518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:47.408518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:47.408518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:47.408518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:47.408518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:47.408518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:47.408518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:47.408518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:47.408518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:47.408518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:47.408518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:47.408518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:47.409589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:47.409589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:47.409589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:47.409589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:47.409589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:05:47.409589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:05:47.409589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:05:47.409589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:05:47.409589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:05:47.409589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:05:47.409589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:05:47.409589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:47.409589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 555/1087] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:05:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:47.414908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dba673-63cc-4e09-bcfd-4b7fe2370d82 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:47.513635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dba673-63cc-4e09-bcfd-4b7fe2370d82 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:47.533264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:47.547466 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c642a52-0af3-496a-90a0-10c245d4ccc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:47.548079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c642a52-0af3-496a-90a0-10c245d4ccc5 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:47.548357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c642a52-0af3-496a-90a0-10c245d4ccc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:47.548629 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c642a52-0af3-496a-90a0-10c245d4ccc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:47.549376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c642a52-0af3-496a-90a0-10c245d4ccc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:47.549678 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c642a52-0af3-496a-90a0-10c245d4ccc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:47.551044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c642a52-0af3-496a-90a0-10c245d4ccc5 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:47.560517 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 533/1088] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:05:47 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:47.567111 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc46e7a-edf6-497b-b189-a699df5be271 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:47.664748 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc46e7a-edf6-497b-b189-a699df5be271 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:47.697980 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65588c-7c64-4c49-957a-7f12ce773eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:47.698612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65588c-7c64-4c49-957a-7f12ce773eac None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:47.698890 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65588c-7c64-4c49-957a-7f12ce773eac None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:47.699163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65588c-7c64-4c49-957a-7f12ce773eac None admin] PATH_INFO: `/v3/users/9d3dc52033e540a3add60d1e0c6fb56a` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:47.700318 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65588c-7c64-4c49-957a-7f12ce773eac None admin] RBAC: Authorizing `identity:get_user(user_id=9d3dc52033e540a3add60d1e0c6fb56a)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:47.701766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65588c-7c64-4c49-957a-7f12ce773eac None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:47.703410 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 556/1089] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:05:47 2022] GET /identity/v3/users/9d3dc52033e540a3add60d1e0c6fb56a => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:47.709297 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c642a52-0af3-496a-90a0-10c245d4ccc5 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:47.805217 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c642a52-0af3-496a-90a0-10c245d4ccc5 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:47.836344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c02dfe-f3c6-4298-90d9-c8024d59bd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:47.836968 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c02dfe-f3c6-4298-90d9-c8024d59bd77 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:47.837246 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c02dfe-f3c6-4298-90d9-c8024d59bd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:47.837516 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c02dfe-f3c6-4298-90d9-c8024d59bd77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:47.883987 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:47.901882 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c02dfe-f3c6-4298-90d9-c8024d59bd77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:47.903316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c02dfe-f3c6-4298-90d9-c8024d59bd77 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:48.010987 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 534/1090] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:05:47 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 16:05:48.017561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65588c-7c64-4c49-957a-7f12ce773eac None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:48.041578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:48.118348 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65588c-7c64-4c49-957a-7f12ce773eac None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:48.151965 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127f709-cb33-44ad-a9ea-4410fd9b4c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:48.152598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127f709-cb33-44ad-a9ea-4410fd9b4c53 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:48.152903 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127f709-cb33-44ad-a9ea-4410fd9b4c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:48.153175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127f709-cb33-44ad-a9ea-4410fd9b4c53 None admin] PATH_INFO: `/v3/projects/24543c8f69a44b1dba1e3f29c98c4f03` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:48.154332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127f709-cb33-44ad-a9ea-4410fd9b4c53 None admin] RBAC: Authorizing `identity:get_project(project_id=24543c8f69a44b1dba1e3f29c98c4f03)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:48.155825 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127f709-cb33-44ad-a9ea-4410fd9b4c53 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:48.157594 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 557/1091] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:05:48 2022] GET /identity/v3/projects/24543c8f69a44b1dba1e3f29c98c4f03 => generated 312 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:48.163649 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c02dfe-f3c6-4298-90d9-c8024d59bd77 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:48.242889 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:48.262947 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c02dfe-f3c6-4298-90d9-c8024d59bd77 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:48.296526 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f14721-36fb-44c9-b988-f4ac67a904e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:48.297426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f14721-36fb-44c9-b988-f4ac67a904e1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:48.297702 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f14721-36fb-44c9-b988-f4ac67a904e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:48.297968 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f14721-36fb-44c9-b988-f4ac67a904e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:48.298739 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f14721-36fb-44c9-b988-f4ac67a904e1 None admin] RBAC: Adding query filter params (role.id=94ecbd6c86a84b75bdb0c57fc27a9a07, scope.project.id=24543c8f69a44b1dba1e3f29c98c4f03, user.id=9d3dc52033e540a3add60d1e0c6fb56a) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:48.299045 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f14721-36fb-44c9-b988-f4ac67a904e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:48.300477 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f14721-36fb-44c9-b988-f4ac67a904e1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:48.306072 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 535/1092] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:05:48 2022] GET /identity/v3/role_assignments?user.id=9d3dc52033e540a3add60d1e0c6fb56a&scope.project.id=24543c8f69a44b1dba1e3f29c98c4f03&role.id=94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 610 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:48.464439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3781b-437f-4e1f-88e0-e109d722be59 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:48.465004 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3781b-437f-4e1f-88e0-e109d722be59 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:48.465196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3781b-437f-4e1f-88e0-e109d722be59 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:48.466554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 558/1093] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:48.472329 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe622dbd-47e8-42ed-a817-c177de6be2d4 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:48.472619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe622dbd-47e8-42ed-a817-c177de6be2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:48.472937 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe622dbd-47e8-42ed-a817-c177de6be2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:48.491666 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-fe622dbd-47e8-42ed-a817-c177de6be2d4 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:48.492894 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fe622dbd-47e8-42ed-a817-c177de6be2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:48.559895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 536/1094] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:48 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:48.585678 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3781b-437f-4e1f-88e0-e109d722be59 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:48.682752 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:48.692932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3781b-437f-4e1f-88e0-e109d722be59 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:48.725734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c641b3a-def9-4e22-9d49-b53702589d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:48.726293 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c641b3a-def9-4e22-9d49-b53702589d40 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:48.726566 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c641b3a-def9-4e22-9d49-b53702589d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:48.726832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c641b3a-def9-4e22-9d49-b53702589d40 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:48.737249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c641b3a-def9-4e22-9d49-b53702589d40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:05:48.742742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-6c641b3a-def9-4e22-9d49-b53702589d40 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 16:05:48.742742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:48.742742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:48.742742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:48.742742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:48.742742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:48.742742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:48.742742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:48.742742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:48.742742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:48.742742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:48.742742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:48.742742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:05:48.742742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:05:48.742742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:05:48.742742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:05:48.743699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:05:48.743699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:05:48.743699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:05:48.743699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:05:48.743699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:48.743699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:48.743699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:48.743699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:48.743699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:48.743699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:48.743699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:48.743699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:48.743699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:48.743699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:48.743699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:48.743699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:48.744540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:48.744540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:48.744540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:48.744540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:48.744540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:05:48.744540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:05:48.744540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:05:48.744540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:05:48.744540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:05:48.744540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:05:48.744540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 16:05:48.744540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:48.744540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 559/1095] 10.222.0.141 () {56 vars in 1125 bytes} [Tue Jul 26 16:05:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:48.750434 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe622dbd-47e8-42ed-a817-c177de6be2d4 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:48.825636 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:48.848188 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe622dbd-47e8-42ed-a817-c177de6be2d4 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:48.881216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8ff67-e8c6-47f4-9831-efbb84e9353c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:48.881827 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8ff67-e8c6-47f4-9831-efbb84e9353c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:48.882102 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8ff67-e8c6-47f4-9831-efbb84e9353c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:48.882373 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8ff67-e8c6-47f4-9831-efbb84e9353c None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:48.883071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8ff67-e8c6-47f4-9831-efbb84e9353c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:48.883371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8ff67-e8c6-47f4-9831-efbb84e9353c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:48.884912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8ff67-e8c6-47f4-9831-efbb84e9353c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:48.893136 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 537/1096] 10.222.0.141 () {56 vars in 1120 bytes} [Tue Jul 26 16:05:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:48.898815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c641b3a-def9-4e22-9d49-b53702589d40 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:49.002796 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c641b3a-def9-4e22-9d49-b53702589d40 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:49.035929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2bf44-9cc5-4949-80b6-ddcad4c6d9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:49.036584 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2bf44-9cc5-4949-80b6-ddcad4c6d9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:49.036882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2bf44-9cc5-4949-80b6-ddcad4c6d9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:49.037152 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2bf44-9cc5-4949-80b6-ddcad4c6d9e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:49.047736 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2bf44-9cc5-4949-80b6-ddcad4c6d9e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:49.049204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2bf44-9cc5-4949-80b6-ddcad4c6d9e1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:49.062944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-89d2bf44-9cc5-4949-80b6-ddcad4c6d9e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:49.062944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:49.062944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:49.062944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:49.062944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:49.062944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:49.062944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:49.062944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:49.062944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:49.062944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:49.062944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:49.062944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:49.062944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:49.062944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:49.062944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:49.063968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:49.063968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:49.063968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:49.063968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:49.063968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:49.063968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:49.063968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:49.063968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:49.063968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:49.063968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:49.063968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:49.063968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:49.063968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:49.063968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:49.063968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:49.063968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:49.063968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:49.064886 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:49.064886 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:49.064886 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:49.064886 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:49.064886 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 560/1097] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:49.069781 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8ff67-e8c6-47f4-9831-efbb84e9353c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:49.196526 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8ff67-e8c6-47f4-9831-efbb84e9353c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:49.228267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2fd51-874b-4252-89d9-7f632d7cdbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:49.228892 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2fd51-874b-4252-89d9-7f632d7cdbab None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:49.229170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2fd51-874b-4252-89d9-7f632d7cdbab None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:49.229437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2fd51-874b-4252-89d9-7f632d7cdbab None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:49.230112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2fd51-874b-4252-89d9-7f632d7cdbab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:49.230409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2fd51-874b-4252-89d9-7f632d7cdbab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:49.231758 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2fd51-874b-4252-89d9-7f632d7cdbab None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:49.238324 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:49.243228 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 538/1098] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:49.248830 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2bf44-9cc5-4949-80b6-ddcad4c6d9e1 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:49.252216 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:49.347590 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2bf44-9cc5-4949-80b6-ddcad4c6d9e1 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:49.380120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4d6e2-af1e-43ed-9e1a-8bd2d8004351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:49.380791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4d6e2-af1e-43ed-9e1a-8bd2d8004351 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:49.381073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4d6e2-af1e-43ed-9e1a-8bd2d8004351 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:49.381347 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4d6e2-af1e-43ed-9e1a-8bd2d8004351 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:49.388855 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4d6e2-af1e-43ed-9e1a-8bd2d8004351 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:49.390372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4d6e2-af1e-43ed-9e1a-8bd2d8004351 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:49.401539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-94c4d6e2-af1e-43ed-9e1a-8bd2d8004351 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 16:05:49.401539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:49.401539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:49.401539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:49.401539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:49.401539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:49.401539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:49.401539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:49.401539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:49.401539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:49.401539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:49.401539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:49.401539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:05:49.401539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:05:49.401539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:05:49.401539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:05:49.402629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:49.402629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:49.402629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:05:49.402629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:49.402629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:05:49.402629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:05:49.402629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:49.402629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:49.402629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:49.402629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:49.402629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:49.402629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:49.402629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:49.402629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:49.402629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:49.402629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:49.402629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:49.402629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:49.403603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:49.403603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:49.403603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:05:49.403603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:05:49.403603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:05:49.403603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:05:49.403603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:05:49.403603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:05:49.403603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 16:05:49.403603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:05:49.403603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 561/1099] 10.222.0.141 () {56 vars in 1098 bytes} [Tue Jul 26 16:05:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:49.409244 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2fd51-874b-4252-89d9-7f632d7cdbab None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:49.509138 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2fd51-874b-4252-89d9-7f632d7cdbab None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:49.541837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38be61d-534c-4557-b620-fd88f36b9c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:49.542445 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38be61d-534c-4557-b620-fd88f36b9c89 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:49.542721 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38be61d-534c-4557-b620-fd88f36b9c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:49.542992 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38be61d-534c-4557-b620-fd88f36b9c89 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:49.543765 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38be61d-534c-4557-b620-fd88f36b9c89 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:49.544066 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38be61d-534c-4557-b620-fd88f36b9c89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:49.545528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38be61d-534c-4557-b620-fd88f36b9c89 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:49.562423 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 539/1100] 10.222.0.141 () {56 vars in 1138 bytes} [Tue Jul 26 16:05:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:49.568108 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4d6e2-af1e-43ed-9e1a-8bd2d8004351 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:49.629750 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:49.667602 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4d6e2-af1e-43ed-9e1a-8bd2d8004351 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:49.701592 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db3036-dba2-43c7-bb8c-5b12734d6c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:49.702215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db3036-dba2-43c7-bb8c-5b12734d6c68 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:49.702485 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db3036-dba2-43c7-bb8c-5b12734d6c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:49.702757 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db3036-dba2-43c7-bb8c-5b12734d6c68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:49.767564 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db3036-dba2-43c7-bb8c-5b12734d6c68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:49.769043 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db3036-dba2-43c7-bb8c-5b12734d6c68 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:49.826535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:49.864919 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 562/1101] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:05:49 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 16:05:49.870613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38be61d-534c-4557-b620-fd88f36b9c89 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:49.931766 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:49.976100 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38be61d-534c-4557-b620-fd88f36b9c89 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:50.013108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60809e3b-aad5-4e81-881d-b832c1209eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:50.013741 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60809e3b-aad5-4e81-881d-b832c1209eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:50.014018 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60809e3b-aad5-4e81-881d-b832c1209eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:50.014288 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60809e3b-aad5-4e81-881d-b832c1209eb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:50.024071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60809e3b-aad5-4e81-881d-b832c1209eb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:50.025548 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60809e3b-aad5-4e81-881d-b832c1209eb1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:50.040417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-60809e3b-aad5-4e81-881d-b832c1209eb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:50.040417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:50.040417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:50.040417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:50.040417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:50.040417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:50.040417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:50.040417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:50.040417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:50.040417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:50.040417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:50.040417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:50.040417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:05:50.040417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:05:50.040417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:05:50.041390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:05:50.041390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:50.041390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:50.041390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:50.041390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:50.041390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:50.041390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:50.041390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:50.041390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:50.041390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:50.041390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:50.041390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:50.041390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:50.041390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:50.041390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:50.041390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:50.041390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:50.042284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:05:50.042284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:05:50.042284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:05:50.042284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:50.042284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 540/1102] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 16:05:50.047993 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db3036-dba2-43c7-bb8c-5b12734d6c68 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:50.144782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db3036-dba2-43c7-bb8c-5b12734d6c68 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:50.178509 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7784d2-83bf-4116-8df4-e9e9ed88a9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:50.179115 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7784d2-83bf-4116-8df4-e9e9ed88a9fe None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:50.179390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7784d2-83bf-4116-8df4-e9e9ed88a9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:50.179662 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7784d2-83bf-4116-8df4-e9e9ed88a9fe None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:50.180337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7784d2-83bf-4116-8df4-e9e9ed88a9fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:50.180636 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7784d2-83bf-4116-8df4-e9e9ed88a9fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:50.182064 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7784d2-83bf-4116-8df4-e9e9ed88a9fe None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:50.192872 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 563/1103] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:05:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:50.198432 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60809e3b-aad5-4e81-881d-b832c1209eb1 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:50.296501 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60809e3b-aad5-4e81-881d-b832c1209eb1 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:50.305491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:50.331473 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79b0ef-dadb-4364-a9b4-37dd32b676ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:50.332112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79b0ef-dadb-4364-a9b4-37dd32b676ac None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:50.332397 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79b0ef-dadb-4364-a9b4-37dd32b676ac None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:50.332686 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79b0ef-dadb-4364-a9b4-37dd32b676ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:50.339864 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79b0ef-dadb-4364-a9b4-37dd32b676ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:50.341335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79b0ef-dadb-4364-a9b4-37dd32b676ac None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:50.349250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfddf75-b175-4538-a52c-ca4a1866a756 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:50.349537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfddf75-b175-4538-a52c-ca4a1866a756 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:50.349870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfddf75-b175-4538-a52c-ca4a1866a756 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:50.351228 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 564/1104] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:05:50.352920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-de79b0ef-dadb-4364-a9b4-37dd32b676ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:50.352920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:05:50.352920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:05:50.352920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:05:50.352920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:05:50.352920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:05:50.352920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:05:50.352920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:05:50.352920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:05:50.352920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:05:50.352920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:05:50.352920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:05:50.352920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:05:50.352920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:05:50.352920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:05:50.353922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:05:50.353922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:05:50.353922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:05:50.353922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:05:50.353922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:05:50.353922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:05:50.353922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:05:50.353922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:05:50.353922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:05:50.353922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:05:50.353922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:05:50.353922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:05:50.353922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:05:50.353922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:05:50.353922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:05:50.353922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:05:50.353922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:05:50.354832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:05:50.354832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:05:50.354832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:05:50.354832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:05:50.354832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:05:50.354832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:05:50.354832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:05:50.354832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:05:50.354832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 541/1105] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:05:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:05:50.356218 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf7b3b-0d5e-4085-bceb-e0b55f6132b9 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:50.356523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf7b3b-0d5e-4085-bceb-e0b55f6132b9 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:50.356840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf7b3b-0d5e-4085-bceb-e0b55f6132b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:50.360307 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79b0ef-dadb-4364-a9b4-37dd32b676ac None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:50.376944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-ebbf7b3b-0d5e-4085-bceb-e0b55f6132b9 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:50.378259 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ebbf7b3b-0d5e-4085-bceb-e0b55f6132b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:50.394496 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:50.445324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 565/1106] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:50 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 16:05:50.458630 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79b0ef-dadb-4364-a9b4-37dd32b676ac None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:50.469400 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf7b3b-0d5e-4085-bceb-e0b55f6132b9 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:50.491249 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e3896-17bb-4c79-be66-da04ecf11859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:50.491863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e3896-17bb-4c79-be66-da04ecf11859 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:50.492146 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e3896-17bb-4c79-be66-da04ecf11859 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:50.492417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e3896-17bb-4c79-be66-da04ecf11859 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:50.493190 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e3896-17bb-4c79-be66-da04ecf11859 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:50.493495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e3896-17bb-4c79-be66-da04ecf11859 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:50.494987 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e3896-17bb-4c79-be66-da04ecf11859 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:50.506964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 542/1107] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:05:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:50.513098 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e3896-17bb-4c79-be66-da04ecf11859 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:50.540112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:50.568801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf7b3b-0d5e-4085-bceb-e0b55f6132b9 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:50.602455 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c769a37-b31d-482d-a3c7-0d5e25ed4236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:50.603092 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c769a37-b31d-482d-a3c7-0d5e25ed4236 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:50.603371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c769a37-b31d-482d-a3c7-0d5e25ed4236 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:50.603649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c769a37-b31d-482d-a3c7-0d5e25ed4236 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:50.604819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c769a37-b31d-482d-a3c7-0d5e25ed4236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:50.606260 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c769a37-b31d-482d-a3c7-0d5e25ed4236 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:50.607831 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 566/1108] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:05:50 2022] GET /identity/v3/domains/default => generated 200 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:50.613144 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e3896-17bb-4c79-be66-da04ecf11859 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:50.614003 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c769a37-b31d-482d-a3c7-0d5e25ed4236 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:50.635652 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:50.644071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e334b-0aa3-4590-9246-8a24996383d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:50.646886 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e334b-0aa3-4590-9246-8a24996383d2 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:50.646886 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e334b-0aa3-4590-9246-8a24996383d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:50.646886 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e334b-0aa3-4590-9246-8a24996383d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:50.646886 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e334b-0aa3-4590-9246-8a24996383d2 None admin] RBAC: Adding query filter params (role.id=7b1cae16e1ba4a1c8c57b844e944c8a5, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=f7eac931cabf4921b6dbd42f63b9300f) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:50.646886 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e334b-0aa3-4590-9246-8a24996383d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:50.647822 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e334b-0aa3-4590-9246-8a24996383d2 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:50.653524 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 543/1109] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:05:50 2022] GET /identity/v3/role_assignments?user.id=f7eac931cabf4921b6dbd42f63b9300f&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=7b1cae16e1ba4a1c8c57b844e944c8a5 => generated 610 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:50.722201 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c769a37-b31d-482d-a3c7-0d5e25ed4236 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:50.757516 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8a8db-3f6f-4d07-939f-045db97d76b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:50.758169 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8a8db-3f6f-4d07-939f-045db97d76b4 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:50.758448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8a8db-3f6f-4d07-939f-045db97d76b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:50.758719 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8a8db-3f6f-4d07-939f-045db97d76b4 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:50.759412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8a8db-3f6f-4d07-939f-045db97d76b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:50.760890 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8a8db-3f6f-4d07-939f-045db97d76b4 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:50.846651 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 567/1110] 10.222.0.141 () {60 vars in 1137 bytes} [Tue Jul 26 16:05:50 2022] POST /identity/v3/users => generated 287 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:05:52.962122 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bdf0c-2959-490f-9194-536225a3b38a None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:52.962542 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bdf0c-2959-490f-9194-536225a3b38a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:52.962656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bdf0c-2959-490f-9194-536225a3b38a None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:52.963998 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 544/1111] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:52.969812 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398dd73-cf99-4828-932d-2071945ebd29 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:52.970220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398dd73-cf99-4828-932d-2071945ebd29 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:52.970372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398dd73-cf99-4828-932d-2071945ebd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:52.988682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-8398dd73-cf99-4828-932d-2071945ebd29 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:52.989874 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8398dd73-cf99-4828-932d-2071945ebd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:53.056187 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 568/1112] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:52 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:53.078848 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bdf0c-2959-490f-9194-536225a3b38a None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:53.168221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:53.178564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bdf0c-2959-490f-9194-536225a3b38a None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:53.211517 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f43b8-437d-4f6a-8f40-ddcb516afd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:53.212086 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f43b8-437d-4f6a-8f40-ddcb516afd9d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:53.212369 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f43b8-437d-4f6a-8f40-ddcb516afd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:53.212646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f43b8-437d-4f6a-8f40-ddcb516afd9d None admin] PATH_INFO: `/v3/roles/33fa4ece26464ae98122f3279db92307` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:53.214118 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f43b8-437d-4f6a-8f40-ddcb516afd9d None admin] RBAC: Authorizing `identity:get_role(role_id=33fa4ece26464ae98122f3279db92307)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:53.215542 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f43b8-437d-4f6a-8f40-ddcb516afd9d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:53.216922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 545/1113] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:05:53 2022] GET /identity/v3/roles/33fa4ece26464ae98122f3279db92307 => generated 224 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:53.223271 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398dd73-cf99-4828-932d-2071945ebd29 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:53.231221 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:53.319762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398dd73-cf99-4828-932d-2071945ebd29 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:53.353539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba998fab-6384-4d69-8e26-82ec62adc767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:53.354180 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba998fab-6384-4d69-8e26-82ec62adc767 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:53.354462 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba998fab-6384-4d69-8e26-82ec62adc767 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:53.354741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba998fab-6384-4d69-8e26-82ec62adc767 None admin] PATH_INFO: `/v3/users/a7109731e3af4954a34128bb2899c580` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:53.367491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba998fab-6384-4d69-8e26-82ec62adc767 None admin] RBAC: Authorizing `identity:get_user(user_id=a7109731e3af4954a34128bb2899c580)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:53.368950 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba998fab-6384-4d69-8e26-82ec62adc767 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:53.370550 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 569/1114] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:05:53 2022] GET /identity/v3/users/a7109731e3af4954a34128bb2899c580 => generated 287 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:53.376344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f43b8-437d-4f6a-8f40-ddcb516afd9d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:53.472643 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f43b8-437d-4f6a-8f40-ddcb516afd9d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:53.504181 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f780ea-f0d3-43a7-a938-5430031ec659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:53.504819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f780ea-f0d3-43a7-a938-5430031ec659 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:53.505101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f780ea-f0d3-43a7-a938-5430031ec659 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:53.505374 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f780ea-f0d3-43a7-a938-5430031ec659 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:53.532898 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:53.570296 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f780ea-f0d3-43a7-a938-5430031ec659 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:53.571996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f780ea-f0d3-43a7-a938-5430031ec659 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:53.665639 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 546/1115] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:05:53 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 16:05:53.671415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba998fab-6384-4d69-8e26-82ec62adc767 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:53.732007 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:53.769272 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba998fab-6384-4d69-8e26-82ec62adc767 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:53.802184 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b607b-e634-4c86-b39d-00cf1f68cc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:53.802807 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b607b-e634-4c86-b39d-00cf1f68cc95 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:53.803083 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b607b-e634-4c86-b39d-00cf1f68cc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:53.803347 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b607b-e634-4c86-b39d-00cf1f68cc95 None admin] PATH_INFO: `/v3/projects/24543c8f69a44b1dba1e3f29c98c4f03` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:53.804461 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b607b-e634-4c86-b39d-00cf1f68cc95 None admin] RBAC: Authorizing `identity:get_project(project_id=24543c8f69a44b1dba1e3f29c98c4f03)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:53.805921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b607b-e634-4c86-b39d-00cf1f68cc95 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:53.807532 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 570/1116] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:05:53 2022] GET /identity/v3/projects/24543c8f69a44b1dba1e3f29c98c4f03 => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:53.814223 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f780ea-f0d3-43a7-a938-5430031ec659 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:53.870842 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:53.910731 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f780ea-f0d3-43a7-a938-5430031ec659 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:53.944170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9385388-6023-468b-97cc-b734d9967346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:53.944812 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9385388-6023-468b-97cc-b734d9967346 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:53.945089 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9385388-6023-468b-97cc-b734d9967346 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:53.945359 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9385388-6023-468b-97cc-b734d9967346 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:53.946149 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9385388-6023-468b-97cc-b734d9967346 None admin] RBAC: Adding query filter params (role.id=33fa4ece26464ae98122f3279db92307, scope.project.id=24543c8f69a44b1dba1e3f29c98c4f03, user.id=a7109731e3af4954a34128bb2899c580) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:53.946457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9385388-6023-468b-97cc-b734d9967346 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:53.947877 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9385388-6023-468b-97cc-b734d9967346 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:53.953785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 547/1117] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:05:53 2022] GET /identity/v3/role_assignments?user.id=a7109731e3af4954a34128bb2899c580&scope.project.id=24543c8f69a44b1dba1e3f29c98c4f03&role.id=33fa4ece26464ae98122f3279db92307 => generated 260 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:05:55.905145 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4976da-4336-494d-bc37-0cdce73b3f06 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:55.905705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4976da-4336-494d-bc37-0cdce73b3f06 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:55.905705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4976da-4336-494d-bc37-0cdce73b3f06 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:55.907040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 571/1118] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:55.912212 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a0016-bd21-455d-9885-daa522ae29bc None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:55.912615 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a0016-bd21-455d-9885-daa522ae29bc None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:55.912802 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a0016-bd21-455d-9885-daa522ae29bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:55.931078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-927a0016-bd21-455d-9885-daa522ae29bc None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:55.932263 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-927a0016-bd21-455d-9885-daa522ae29bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:55.996430 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 548/1119] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:55 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:56.018281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4976da-4336-494d-bc37-0cdce73b3f06 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:56.117745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4976da-4336-494d-bc37-0cdce73b3f06 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:56.145611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:56.150220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486323f-8670-42d4-95fe-dfbe2e1d0e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:56.150847 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486323f-8670-42d4-95fe-dfbe2e1d0e55 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:56.151128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486323f-8670-42d4-95fe-dfbe2e1d0e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:56.151403 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486323f-8670-42d4-95fe-dfbe2e1d0e55 None admin] PATH_INFO: `/v3/roles/33fa4ece26464ae98122f3279db92307` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:56.152857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486323f-8670-42d4-95fe-dfbe2e1d0e55 None admin] RBAC: Authorizing `identity:get_role(role_id=33fa4ece26464ae98122f3279db92307)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:56.154208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486323f-8670-42d4-95fe-dfbe2e1d0e55 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:56.160832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 572/1120] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:05:56 2022] GET /identity/v3/roles/33fa4ece26464ae98122f3279db92307 => generated 224 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:56.161989 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a0016-bd21-455d-9885-daa522ae29bc None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:56.214968 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:56.258417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a0016-bd21-455d-9885-daa522ae29bc None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:56.290952 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df00ee2-c3c0-4548-9cd4-56e1580a4fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:56.291575 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df00ee2-c3c0-4548-9cd4-56e1580a4fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:56.291855 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df00ee2-c3c0-4548-9cd4-56e1580a4fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:56.292128 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df00ee2-c3c0-4548-9cd4-56e1580a4fc2 None admin] PATH_INFO: `/v3/users/a7109731e3af4954a34128bb2899c580` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:56.293278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df00ee2-c3c0-4548-9cd4-56e1580a4fc2 None admin] RBAC: Authorizing `identity:get_user(user_id=a7109731e3af4954a34128bb2899c580)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:56.294733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df00ee2-c3c0-4548-9cd4-56e1580a4fc2 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:56.296309 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 549/1121] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:05:56 2022] GET /identity/v3/users/a7109731e3af4954a34128bb2899c580 => generated 287 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:56.302292 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486323f-8670-42d4-95fe-dfbe2e1d0e55 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:56.398239 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486323f-8670-42d4-95fe-dfbe2e1d0e55 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:56.431254 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993697c6-ebc7-4eaa-8403-baae1e056980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:56.431818 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993697c6-ebc7-4eaa-8403-baae1e056980 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:56.432094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993697c6-ebc7-4eaa-8403-baae1e056980 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:56.432364 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993697c6-ebc7-4eaa-8403-baae1e056980 None admin] PATH_INFO: `/v3/projects/24543c8f69a44b1dba1e3f29c98c4f03` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:56.433519 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993697c6-ebc7-4eaa-8403-baae1e056980 None admin] RBAC: Authorizing `identity:get_project(project_id=24543c8f69a44b1dba1e3f29c98c4f03)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:56.434934 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993697c6-ebc7-4eaa-8403-baae1e056980 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:56.436558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 573/1122] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:05:56 2022] GET /identity/v3/projects/24543c8f69a44b1dba1e3f29c98c4f03 => generated 312 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:56.443144 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df00ee2-c3c0-4548-9cd4-56e1580a4fc2 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:56.537484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df00ee2-c3c0-4548-9cd4-56e1580a4fc2 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:56.559456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:56.570956 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb121da-85d9-446a-b9b9-f705be2c89ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:56.574573 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb121da-85d9-446a-b9b9-f705be2c89ec None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:56.574573 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb121da-85d9-446a-b9b9-f705be2c89ec None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:56.574573 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb121da-85d9-446a-b9b9-f705be2c89ec None admin] PATH_INFO: `/v3/projects/24543c8f69a44b1dba1e3f29c98c4f03/users/a7109731e3af4954a34128bb2899c580/roles/33fa4ece26464ae98122f3279db92307` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:56.574573 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb121da-85d9-446a-b9b9-f705be2c89ec None admin] RBAC: Authorizing `identity:create_grant(project_id=24543c8f69a44b1dba1e3f29c98c4f03, user_id=a7109731e3af4954a34128bb2899c580, role_id=33fa4ece26464ae98122f3279db92307)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:56.575745 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb121da-85d9-446a-b9b9-f705be2c89ec None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:56.649936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 550/1123] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:05:56 2022] PUT /identity/v3/projects/24543c8f69a44b1dba1e3f29c98c4f03/users/a7109731e3af4954a34128bb2899c580/roles/33fa4ece26464ae98122f3279db92307 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:05:58.624913 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759f50e-f926-4276-af88-d7794d7ae4a0 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:58.626076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759f50e-f926-4276-af88-d7794d7ae4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:58.626076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759f50e-f926-4276-af88-d7794d7ae4a0 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:58.627369 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 574/1124] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:05:58 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:05:58.632398 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c56dab-d328-4baa-afc5-72aa9527b5b6 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:58.632835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c56dab-d328-4baa-afc5-72aa9527b5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:58.632977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c56dab-d328-4baa-afc5-72aa9527b5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:58.650513 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a5c56dab-d328-4baa-afc5-72aa9527b5b6 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:05:58.651693 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a5c56dab-d328-4baa-afc5-72aa9527b5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:05:58.717040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 551/1125] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:05:58 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:05:58.739795 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759f50e-f926-4276-af88-d7794d7ae4a0 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:58.805056 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:58.837751 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759f50e-f926-4276-af88-d7794d7ae4a0 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:58.870069 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55873d-2c29-4e36-8faa-06993557a60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:58.870684 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55873d-2c29-4e36-8faa-06993557a60c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:58.870959 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55873d-2c29-4e36-8faa-06993557a60c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:58.871228 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55873d-2c29-4e36-8faa-06993557a60c None admin] PATH_INFO: `/v3/roles/33fa4ece26464ae98122f3279db92307` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:58.872623 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55873d-2c29-4e36-8faa-06993557a60c None admin] RBAC: Authorizing `identity:get_role(role_id=33fa4ece26464ae98122f3279db92307)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:58.873983 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55873d-2c29-4e36-8faa-06993557a60c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:58.875958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 575/1126] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:05:58 2022] GET /identity/v3/roles/33fa4ece26464ae98122f3279db92307 => generated 224 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:58.881674 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c56dab-d328-4baa-afc5-72aa9527b5b6 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:58.977838 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c56dab-d328-4baa-afc5-72aa9527b5b6 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:58.991166 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:59.011412 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e3096-f53c-4b48-9002-fa34d0515dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:59.012050 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e3096-f53c-4b48-9002-fa34d0515dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:59.012333 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e3096-f53c-4b48-9002-fa34d0515dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:59.012606 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e3096-f53c-4b48-9002-fa34d0515dc0 None admin] PATH_INFO: `/v3/users/a7109731e3af4954a34128bb2899c580` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:59.013789 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e3096-f53c-4b48-9002-fa34d0515dc0 None admin] RBAC: Authorizing `identity:get_user(user_id=a7109731e3af4954a34128bb2899c580)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:59.015213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e3096-f53c-4b48-9002-fa34d0515dc0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:59.017046 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 552/1127] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:05:58 2022] GET /identity/v3/users/a7109731e3af4954a34128bb2899c580 => generated 287 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:59.022672 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55873d-2c29-4e36-8faa-06993557a60c None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:59.119080 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55873d-2c29-4e36-8faa-06993557a60c None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:59.150968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd8139-5822-4715-b7c8-4448a58e3690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:59.151506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8139-5822-4715-b7c8-4448a58e3690 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:59.151780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8139-5822-4715-b7c8-4448a58e3690 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:59.152048 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8139-5822-4715-b7c8-4448a58e3690 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:59.155319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:59.219784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd8139-5822-4715-b7c8-4448a58e3690 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:59.221240 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd8139-5822-4715-b7c8-4448a58e3690 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:59.316990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 576/1128] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:05:59 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 16:05:59.322888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e3096-f53c-4b48-9002-fa34d0515dc0 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:59.419986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e3096-f53c-4b48-9002-fa34d0515dc0 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:59.452789 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415cee1-24ea-47a9-be72-1c68cffffe2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:59.453995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415cee1-24ea-47a9-be72-1c68cffffe2a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:59.454277 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415cee1-24ea-47a9-be72-1c68cffffe2a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:59.454551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415cee1-24ea-47a9-be72-1c68cffffe2a None admin] PATH_INFO: `/v3/projects/24543c8f69a44b1dba1e3f29c98c4f03` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:59.455696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415cee1-24ea-47a9-be72-1c68cffffe2a None admin] RBAC: Authorizing `identity:get_project(project_id=24543c8f69a44b1dba1e3f29c98c4f03)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:59.457154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415cee1-24ea-47a9-be72-1c68cffffe2a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:59.458772 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 553/1129] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:05:59 2022] GET /identity/v3/projects/24543c8f69a44b1dba1e3f29c98c4f03 => generated 312 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:05:59.464652 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd8139-5822-4715-b7c8-4448a58e3690 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:05:59.497717 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:05:59.562166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd8139-5822-4715-b7c8-4448a58e3690 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:05:59.596004 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189122f-9840-4807-bd01-a8911b1aee75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:05:59.596618 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189122f-9840-4807-bd01-a8911b1aee75 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:05:59.596923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189122f-9840-4807-bd01-a8911b1aee75 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:05:59.597192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189122f-9840-4807-bd01-a8911b1aee75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:05:59.597954 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189122f-9840-4807-bd01-a8911b1aee75 None admin] RBAC: Adding query filter params (role.id=33fa4ece26464ae98122f3279db92307, scope.project.id=24543c8f69a44b1dba1e3f29c98c4f03, user.id=a7109731e3af4954a34128bb2899c580) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:05:59.598255 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189122f-9840-4807-bd01-a8911b1aee75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:05:59.599649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189122f-9840-4807-bd01-a8911b1aee75 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:05:59.605286 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 577/1130] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:05:59 2022] GET /identity/v3/role_assignments?user.id=a7109731e3af4954a34128bb2899c580&scope.project.id=24543c8f69a44b1dba1e3f29c98c4f03&role.id=33fa4ece26464ae98122f3279db92307 => generated 610 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:01.601485 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84085010-6962-4072-9fc5-17b3b04e30b0 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:01.602030 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84085010-6962-4072-9fc5-17b3b04e30b0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:01.602030 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84085010-6962-4072-9fc5-17b3b04e30b0 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:01.603379 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 554/1131] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:06:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:06:01.608541 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52ca91-c430-4d3e-8fa5-0ad55793c40e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:01.608979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52ca91-c430-4d3e-8fa5-0ad55793c40e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:01.609130 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52ca91-c430-4d3e-8fa5-0ad55793c40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:01.626669 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6d52ca91-c430-4d3e-8fa5-0ad55793c40e None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:06:01.627849 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6d52ca91-c430-4d3e-8fa5-0ad55793c40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:06:01.693100 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 578/1132] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:06:01 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:06:01.715331 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84085010-6962-4072-9fc5-17b3b04e30b0 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:01.763935 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:01.813561 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84085010-6962-4072-9fc5-17b3b04e30b0 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:01.845212 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612875a1-f45f-4a38-a857-aa9b85e2b081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:01.845832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612875a1-f45f-4a38-a857-aa9b85e2b081 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:01.846111 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612875a1-f45f-4a38-a857-aa9b85e2b081 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:01.846384 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612875a1-f45f-4a38-a857-aa9b85e2b081 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:01.847504 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612875a1-f45f-4a38-a857-aa9b85e2b081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:01.848957 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612875a1-f45f-4a38-a857-aa9b85e2b081 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:01.850501 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 555/1133] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:06:01 2022] GET /identity/v3/domains/default => generated 200 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:01.856284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52ca91-c430-4d3e-8fa5-0ad55793c40e None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:01.886167 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:01.954895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52ca91-c430-4d3e-8fa5-0ad55793c40e None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:01.988240 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3c116-88fa-4a68-af5c-abacc8a51ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:01.988876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3c116-88fa-4a68-af5c-abacc8a51ee4 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:01.989159 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3c116-88fa-4a68-af5c-abacc8a51ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:01.989442 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3c116-88fa-4a68-af5c-abacc8a51ee4 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:01.990131 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3c116-88fa-4a68-af5c-abacc8a51ee4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:01.991554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3c116-88fa-4a68-af5c-abacc8a51ee4 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:02.108251 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 579/1134] 10.222.0.141 () {60 vars in 1146 bytes} [Tue Jul 26 16:06:01 2022] POST /identity/v3/projects => generated 312 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:06:04.120569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485c530-4435-4c12-abbd-c4c1ccd8d8aa None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:04.121120 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485c530-4435-4c12-abbd-c4c1ccd8d8aa None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:04.121231 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485c530-4435-4c12-abbd-c4c1ccd8d8aa None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:04.122574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 556/1135] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:06:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:06:04.128173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55334d7-e875-4685-acf6-5005a1151584 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:04.128599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55334d7-e875-4685-acf6-5005a1151584 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:04.128793 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55334d7-e875-4685-acf6-5005a1151584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:04.146454 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-e55334d7-e875-4685-acf6-5005a1151584 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:06:04.147644 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e55334d7-e875-4685-acf6-5005a1151584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:06:04.213260 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 580/1136] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:06:04 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:06:04.238120 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485c530-4435-4c12-abbd-c4c1ccd8d8aa None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:04.335226 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485c530-4435-4c12-abbd-c4c1ccd8d8aa None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:04.351207 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:04.368761 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89b898-5961-4f70-8e1d-29feb671cb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:04.369346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89b898-5961-4f70-8e1d-29feb671cb6b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:04.369627 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89b898-5961-4f70-8e1d-29feb671cb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:04.369901 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89b898-5961-4f70-8e1d-29feb671cb6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:04.371044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89b898-5961-4f70-8e1d-29feb671cb6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:04.372475 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89b898-5961-4f70-8e1d-29feb671cb6b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:04.374092 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 557/1137] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:06:04 2022] GET /identity/v3/domains/default => generated 200 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:04.380345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55334d7-e875-4685-acf6-5005a1151584 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:04.394517 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:04.478518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55334d7-e875-4685-acf6-5005a1151584 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:04.511419 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbd4b1-b051-4615-a088-40961ea4047e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:04.512026 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbd4b1-b051-4615-a088-40961ea4047e None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:04.512307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbd4b1-b051-4615-a088-40961ea4047e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:04.512583 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbd4b1-b051-4615-a088-40961ea4047e None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:04.513291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbd4b1-b051-4615-a088-40961ea4047e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:04.514729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbd4b1-b051-4615-a088-40961ea4047e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:04.621779 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 581/1138] 10.222.0.141 () {60 vars in 1137 bytes} [Tue Jul 26 16:06:04 2022] POST /identity/v3/users => generated 287 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:06:06.657520 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee3bf9-ca0e-484d-9b40-bbd4dcd490ed None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:06.658045 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee3bf9-ca0e-484d-9b40-bbd4dcd490ed None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:06.658045 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee3bf9-ca0e-484d-9b40-bbd4dcd490ed None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:06.659421 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 558/1139] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:06:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:06:06.664487 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcad229-4eee-440d-afaa-9806eb5fb935 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:06.665052 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcad229-4eee-440d-afaa-9806eb5fb935 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:06.665140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcad229-4eee-440d-afaa-9806eb5fb935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:06.683491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-0fcad229-4eee-440d-afaa-9806eb5fb935 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:06:06.684689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0fcad229-4eee-440d-afaa-9806eb5fb935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:06:06.744091 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:06.749304 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 582/1140] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:06:06 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:06:06.772034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee3bf9-ca0e-484d-9b40-bbd4dcd490ed None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:06.870134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee3bf9-ca0e-484d-9b40-bbd4dcd490ed None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:06.902731 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa4ba0-500d-47d9-8006-c87c6a7e3acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:06.903359 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa4ba0-500d-47d9-8006-c87c6a7e3acb None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:06.903643 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa4ba0-500d-47d9-8006-c87c6a7e3acb None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:06.903918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa4ba0-500d-47d9-8006-c87c6a7e3acb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:06.914438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa4ba0-500d-47d9-8006-c87c6a7e3acb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:06:06.919269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-c3fa4ba0-500d-47d9-8006-c87c6a7e3acb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:06:06.919269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:06:06.919269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:06:06.919269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:06:06.919269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:06:06.919269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:06:06.919269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:06:06.919269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:06:06.919269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:06:06.919269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:06:06.919269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:06:06.919269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:06:06.919269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:06:06.919269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:06:06.919269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:06:06.919269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:06:06.920460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:06:06.920460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:06:06.920460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:06:06.920460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:06:06.920460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:06:06.920460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:06:06.920460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:06:06.920460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:06:06.920460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:06:06.920460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:06:06.920460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:06:06.920460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:06:06.920460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:06:06.920460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:06:06.920460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:06:06.920460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:06:06.922142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:06:06.922142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:06:06.922142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:06:06.922142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:06:06.922142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:06:06.922142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:06:06.922142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:06:06.922142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:06:06.922142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:06:06.922142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:06:06.922142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:06:06.922142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:06:06.922142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 559/1141] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:06:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:06:06.926601 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcad229-4eee-440d-afaa-9806eb5fb935 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:07.021408 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcad229-4eee-440d-afaa-9806eb5fb935 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:07.054102 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056b4c5-2b88-4799-891f-fc29e26bad57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:07.054704 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056b4c5-2b88-4799-891f-fc29e26bad57 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:07.054987 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056b4c5-2b88-4799-891f-fc29e26bad57 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:07.055262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056b4c5-2b88-4799-891f-fc29e26bad57 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:07.055961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056b4c5-2b88-4799-891f-fc29e26bad57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:06:07.056263 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056b4c5-2b88-4799-891f-fc29e26bad57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:07.057654 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056b4c5-2b88-4799-891f-fc29e26bad57 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:07.065519 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 583/1142] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:06:06 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:07.071316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa4ba0-500d-47d9-8006-c87c6a7e3acb None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:07.116989 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:07.168630 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa4ba0-500d-47d9-8006-c87c6a7e3acb None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:07.201145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843afc6-d9a4-47a8-9624-307481e7299e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:07.201764 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843afc6-d9a4-47a8-9624-307481e7299e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:07.202043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843afc6-d9a4-47a8-9624-307481e7299e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:07.202315 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843afc6-d9a4-47a8-9624-307481e7299e None admin] PATH_INFO: `/v3/users/ecd6427d688244648d8e94c41a070edf` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:07.215856 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843afc6-d9a4-47a8-9624-307481e7299e None admin] RBAC: Authorizing `identity:get_user(user_id=ecd6427d688244648d8e94c41a070edf)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:07.217348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843afc6-d9a4-47a8-9624-307481e7299e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:07.218945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 560/1143] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:06:07 2022] GET /identity/v3/users/ecd6427d688244648d8e94c41a070edf => generated 287 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:07.224655 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056b4c5-2b88-4799-891f-fc29e26bad57 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:07.282365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:07.322152 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056b4c5-2b88-4799-891f-fc29e26bad57 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:07.357343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd93e63-b252-4b12-b65f-f834fb87ecd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:07.357960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd93e63-b252-4b12-b65f-f834fb87ecd6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:07.358248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd93e63-b252-4b12-b65f-f834fb87ecd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:07.358522 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd93e63-b252-4b12-b65f-f834fb87ecd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:07.425853 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd93e63-b252-4b12-b65f-f834fb87ecd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:07.427242 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd93e63-b252-4b12-b65f-f834fb87ecd6 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:07.482761 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:07.523170 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 584/1144] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:06:07 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 16:06:07.529066 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843afc6-d9a4-47a8-9624-307481e7299e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:07.624432 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843afc6-d9a4-47a8-9624-307481e7299e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:07.626520 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:07.657208 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b66d9-96c6-4e87-8f7d-ee7b8252ad3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:07.657847 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b66d9-96c6-4e87-8f7d-ee7b8252ad3c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:07.658384 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b66d9-96c6-4e87-8f7d-ee7b8252ad3c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:07.658384 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b66d9-96c6-4e87-8f7d-ee7b8252ad3c None admin] PATH_INFO: `/v3/projects/0191a1dba81043af80d81d15e7cd53f8` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:07.659503 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b66d9-96c6-4e87-8f7d-ee7b8252ad3c None admin] RBAC: Authorizing `identity:get_project(project_id=0191a1dba81043af80d81d15e7cd53f8)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:07.660950 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b66d9-96c6-4e87-8f7d-ee7b8252ad3c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:07.662633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 561/1145] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:06:07 2022] GET /identity/v3/projects/0191a1dba81043af80d81d15e7cd53f8 => generated 312 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:07.668681 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd93e63-b252-4b12-b65f-f834fb87ecd6 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:07.765930 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd93e63-b252-4b12-b65f-f834fb87ecd6 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:07.799236 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c30acb-e729-41ea-b86d-531ef012cd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:07.799840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c30acb-e729-41ea-b86d-531ef012cd62 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:07.800120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c30acb-e729-41ea-b86d-531ef012cd62 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:07.800393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c30acb-e729-41ea-b86d-531ef012cd62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:07.801201 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c30acb-e729-41ea-b86d-531ef012cd62 None admin] RBAC: Adding query filter params (role.id=94ecbd6c86a84b75bdb0c57fc27a9a07, scope.project.id=0191a1dba81043af80d81d15e7cd53f8, user.id=ecd6427d688244648d8e94c41a070edf) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:06:07.801511 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c30acb-e729-41ea-b86d-531ef012cd62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:07.803728 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c30acb-e729-41ea-b86d-531ef012cd62 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:07.810406 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 585/1146] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:06:07 2022] GET /identity/v3/role_assignments?user.id=ecd6427d688244648d8e94c41a070edf&scope.project.id=0191a1dba81043af80d81d15e7cd53f8&role.id=94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 260 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:09.760361 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592e2ce-4e6d-4427-865b-0da7a64fab3b None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:09.760922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592e2ce-4e6d-4427-865b-0da7a64fab3b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:09.761023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592e2ce-4e6d-4427-865b-0da7a64fab3b None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:09.762297 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 562/1147] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:06:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:06:09.768069 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539acec-8563-41fb-97a3-509b1efecea9 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:09.768458 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539acec-8563-41fb-97a3-509b1efecea9 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:09.768615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539acec-8563-41fb-97a3-509b1efecea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:09.786199 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-e539acec-8563-41fb-97a3-509b1efecea9 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:06:09.787374 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e539acec-8563-41fb-97a3-509b1efecea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:06:09.804621 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:09.851744 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 586/1148] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:06:09 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:06:09.874229 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592e2ce-4e6d-4427-865b-0da7a64fab3b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:09.974727 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592e2ce-4e6d-4427-865b-0da7a64fab3b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:10.007891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324da19-e638-4f51-95fa-dd32d3d7d60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:10.008522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324da19-e638-4f51-95fa-dd32d3d7d60e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:10.008837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324da19-e638-4f51-95fa-dd32d3d7d60e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:10.009116 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324da19-e638-4f51-95fa-dd32d3d7d60e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:10.019110 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324da19-e638-4f51-95fa-dd32d3d7d60e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:06:10.023908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-7324da19-e638-4f51-95fa-dd32d3d7d60e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:06:10.023908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:06:10.023908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:06:10.023908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:06:10.023908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:06:10.023908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:06:10.023908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:06:10.023908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:06:10.023908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:06:10.023908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:06:10.023908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:06:10.023908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:06:10.023908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:06:10.023908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:06:10.023908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:06:10.023908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:06:10.025002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:06:10.025002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:06:10.025002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:06:10.025002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:06:10.025002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:06:10.025002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:06:10.025002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:06:10.025002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:06:10.025002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:06:10.025002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:06:10.025002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:06:10.025002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:06:10.025002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:06:10.025002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:06:10.025002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:06:10.025002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:06:10.025873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:06:10.025873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:06:10.025873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:06:10.025873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:06:10.025873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:06:10.025873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:06:10.025873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:06:10.025873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:06:10.025873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:06:10.025873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:06:10.025873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:06:10.025873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:06:10.025873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 563/1149] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:06:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:06:10.031033 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539acec-8563-41fb-97a3-509b1efecea9 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:10.125809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539acec-8563-41fb-97a3-509b1efecea9 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:10.159339 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6387a-6034-4748-a4ea-267c00d3875b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:10.159934 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6387a-6034-4748-a4ea-267c00d3875b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:10.160209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6387a-6034-4748-a4ea-267c00d3875b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:10.160480 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6387a-6034-4748-a4ea-267c00d3875b None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:10.161209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6387a-6034-4748-a4ea-267c00d3875b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:06:10.161512 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6387a-6034-4748-a4ea-267c00d3875b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:10.162861 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6387a-6034-4748-a4ea-267c00d3875b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:10.170529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 587/1150] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:06:10 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:10.176735 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324da19-e638-4f51-95fa-dd32d3d7d60e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:10.206095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:10.274479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324da19-e638-4f51-95fa-dd32d3d7d60e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:10.306538 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb4a9f-6fbf-461a-b5f7-623952b716fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:10.307164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb4a9f-6fbf-461a-b5f7-623952b716fb None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:10.307439 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb4a9f-6fbf-461a-b5f7-623952b716fb None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:10.307710 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb4a9f-6fbf-461a-b5f7-623952b716fb None admin] PATH_INFO: `/v3/users/ecd6427d688244648d8e94c41a070edf` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:10.308866 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb4a9f-6fbf-461a-b5f7-623952b716fb None admin] RBAC: Authorizing `identity:get_user(user_id=ecd6427d688244648d8e94c41a070edf)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:10.310283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb4a9f-6fbf-461a-b5f7-623952b716fb None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:10.311847 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 564/1151] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:06:10 2022] GET /identity/v3/users/ecd6427d688244648d8e94c41a070edf => generated 287 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:10.318080 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6387a-6034-4748-a4ea-267c00d3875b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:10.336931 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:10.415660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6387a-6034-4748-a4ea-267c00d3875b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:10.450531 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c2cb8-3996-491f-995a-9460c10e37be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:10.451154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c2cb8-3996-491f-995a-9460c10e37be None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:10.451433 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c2cb8-3996-491f-995a-9460c10e37be None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:10.451705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c2cb8-3996-491f-995a-9460c10e37be None admin] PATH_INFO: `/v3/projects/0191a1dba81043af80d81d15e7cd53f8` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:10.452894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c2cb8-3996-491f-995a-9460c10e37be None admin] RBAC: Authorizing `identity:get_project(project_id=0191a1dba81043af80d81d15e7cd53f8)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:10.454410 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c2cb8-3996-491f-995a-9460c10e37be None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:10.456119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 588/1152] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:06:10 2022] GET /identity/v3/projects/0191a1dba81043af80d81d15e7cd53f8 => generated 312 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:10.462153 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb4a9f-6fbf-461a-b5f7-623952b716fb None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:10.555995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:10.559596 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb4a9f-6fbf-461a-b5f7-623952b716fb None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:10.592762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c41c80-0f0e-4357-a97a-49316f10efae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:10.594058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c41c80-0f0e-4357-a97a-49316f10efae None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:10.594345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c41c80-0f0e-4357-a97a-49316f10efae None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:10.594621 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c41c80-0f0e-4357-a97a-49316f10efae None admin] PATH_INFO: `/v3/projects/0191a1dba81043af80d81d15e7cd53f8/users/ecd6427d688244648d8e94c41a070edf/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:10.596554 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c41c80-0f0e-4357-a97a-49316f10efae None admin] RBAC: Authorizing `identity:create_grant(project_id=0191a1dba81043af80d81d15e7cd53f8, user_id=ecd6427d688244648d8e94c41a070edf, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:10.598033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c41c80-0f0e-4357-a97a-49316f10efae None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:10.684170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 565/1153] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:06:10 2022] PUT /identity/v3/projects/0191a1dba81043af80d81d15e7cd53f8/users/ecd6427d688244648d8e94c41a070edf/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:06:12.659032 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f18eda-74e8-4021-831c-c2575ecf7bdd None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:12.659582 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f18eda-74e8-4021-831c-c2575ecf7bdd None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:12.659582 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f18eda-74e8-4021-831c-c2575ecf7bdd None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:12.661073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 589/1154] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:06:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:06:12.666230 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715f0f0-6549-4e1a-bc81-29f1679e3b41 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:12.666634 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715f0f0-6549-4e1a-bc81-29f1679e3b41 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:12.666792 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715f0f0-6549-4e1a-bc81-29f1679e3b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:12.685418 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c715f0f0-6549-4e1a-bc81-29f1679e3b41 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:06:12.686600 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c715f0f0-6549-4e1a-bc81-29f1679e3b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:06:12.752082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 566/1155] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:06:12 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:06:12.775496 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f18eda-74e8-4021-831c-c2575ecf7bdd None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:12.858526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:12.875508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f18eda-74e8-4021-831c-c2575ecf7bdd None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:12.907286 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa469a5d-7192-4983-8334-2d50b24cdc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:12.907907 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa469a5d-7192-4983-8334-2d50b24cdc88 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:12.908190 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa469a5d-7192-4983-8334-2d50b24cdc88 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:12.908471 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa469a5d-7192-4983-8334-2d50b24cdc88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:12.919106 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa469a5d-7192-4983-8334-2d50b24cdc88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:06:12.924741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-fa469a5d-7192-4983-8334-2d50b24cdc88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:06:12.924741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:06:12.924741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:06:12.924741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:06:12.924741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:06:12.924741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:06:12.924741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:06:12.924741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:06:12.924741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:06:12.924741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:06:12.924741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:06:12.924741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:06:12.924741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:06:12.924741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:06:12.924741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:06:12.924741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:06:12.925843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:06:12.925843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:06:12.925843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:06:12.925843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:06:12.925843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:06:12.925843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:06:12.925843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:06:12.925843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:06:12.925843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:06:12.925843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:06:12.925843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:06:12.925843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:06:12.925843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:06:12.925843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:06:12.925843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:06:12.925843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:06:12.926688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:06:12.926688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:06:12.926688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:06:12.926688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:06:12.926688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:06:12.926688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:06:12.926688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:06:12.926688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:06:12.926688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:06:12.926688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:06:12.926688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:06:12.926688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:06:12.926688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 590/1156] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:06:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:06:12.932278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715f0f0-6549-4e1a-bc81-29f1679e3b41 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:13.015370 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:13.026548 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715f0f0-6549-4e1a-bc81-29f1679e3b41 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:13.059404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3c491-6dcc-46eb-8ea7-fbc968a71723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:13.060048 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3c491-6dcc-46eb-8ea7-fbc968a71723 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:13.060331 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3c491-6dcc-46eb-8ea7-fbc968a71723 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:13.060603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3c491-6dcc-46eb-8ea7-fbc968a71723 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:13.061338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3c491-6dcc-46eb-8ea7-fbc968a71723 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:06:13.061640 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3c491-6dcc-46eb-8ea7-fbc968a71723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:13.063605 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3c491-6dcc-46eb-8ea7-fbc968a71723 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:13.071642 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 567/1157] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:06:12 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:13.077406 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa469a5d-7192-4983-8334-2d50b24cdc88 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:13.176579 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa469a5d-7192-4983-8334-2d50b24cdc88 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:13.209147 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206976e3-46c4-4bf1-9f6a-7127c84ec8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:13.209774 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206976e3-46c4-4bf1-9f6a-7127c84ec8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:13.210088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206976e3-46c4-4bf1-9f6a-7127c84ec8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:13.210365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206976e3-46c4-4bf1-9f6a-7127c84ec8f7 None admin] PATH_INFO: `/v3/users/ecd6427d688244648d8e94c41a070edf` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:13.211505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206976e3-46c4-4bf1-9f6a-7127c84ec8f7 None admin] RBAC: Authorizing `identity:get_user(user_id=ecd6427d688244648d8e94c41a070edf)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:13.212968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206976e3-46c4-4bf1-9f6a-7127c84ec8f7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:13.214544 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 591/1158] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:06:13 2022] GET /identity/v3/users/ecd6427d688244648d8e94c41a070edf => generated 287 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:13.220855 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3c491-6dcc-46eb-8ea7-fbc968a71723 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:13.316056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3c491-6dcc-46eb-8ea7-fbc968a71723 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:13.347822 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a11299-8be3-413a-8fee-b598e322531f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:13.348423 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a11299-8be3-413a-8fee-b598e322531f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:13.348735 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a11299-8be3-413a-8fee-b598e322531f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:13.349010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a11299-8be3-413a-8fee-b598e322531f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:13.366849 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:13.414800 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a11299-8be3-413a-8fee-b598e322531f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:13.416246 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a11299-8be3-413a-8fee-b598e322531f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:13.511447 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 568/1159] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:06:13 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 16:06:13.517519 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206976e3-46c4-4bf1-9f6a-7127c84ec8f7 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:13.533033 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:13.616178 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206976e3-46c4-4bf1-9f6a-7127c84ec8f7 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:13.648613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4bb68-cc0c-4f11-914c-b78270ce525d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:13.649276 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4bb68-cc0c-4f11-914c-b78270ce525d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:13.649561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4bb68-cc0c-4f11-914c-b78270ce525d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:13.649841 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4bb68-cc0c-4f11-914c-b78270ce525d None admin] PATH_INFO: `/v3/projects/0191a1dba81043af80d81d15e7cd53f8` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:13.650984 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4bb68-cc0c-4f11-914c-b78270ce525d None admin] RBAC: Authorizing `identity:get_project(project_id=0191a1dba81043af80d81d15e7cd53f8)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:13.652411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4bb68-cc0c-4f11-914c-b78270ce525d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:13.654180 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 592/1160] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:06:13 2022] GET /identity/v3/projects/0191a1dba81043af80d81d15e7cd53f8 => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:13.660919 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a11299-8be3-413a-8fee-b598e322531f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:13.709764 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:13.758190 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a11299-8be3-413a-8fee-b598e322531f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:13.790020 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca432e-a906-406a-b6e8-464f2f6a212b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:13.790568 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca432e-a906-406a-b6e8-464f2f6a212b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:13.790851 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca432e-a906-406a-b6e8-464f2f6a212b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:13.791130 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca432e-a906-406a-b6e8-464f2f6a212b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:13.791908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca432e-a906-406a-b6e8-464f2f6a212b None admin] RBAC: Adding query filter params (role.id=94ecbd6c86a84b75bdb0c57fc27a9a07, scope.project.id=0191a1dba81043af80d81d15e7cd53f8, user.id=ecd6427d688244648d8e94c41a070edf) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:06:13.792222 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca432e-a906-406a-b6e8-464f2f6a212b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:13.793677 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca432e-a906-406a-b6e8-464f2f6a212b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:13.800026 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 569/1161] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:06:13 2022] GET /identity/v3/role_assignments?user.id=ecd6427d688244648d8e94c41a070edf&scope.project.id=0191a1dba81043af80d81d15e7cd53f8&role.id=94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 610 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:15.792092 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115b7eb-599e-4a9d-82b3-21842ded06f8 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:15.792616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115b7eb-599e-4a9d-82b3-21842ded06f8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:15.792616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115b7eb-599e-4a9d-82b3-21842ded06f8 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:15.794005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 593/1162] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:06:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:06:15.799819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325e8dd-02f6-4b73-ba53-7ef0f876b518 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:15.800336 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325e8dd-02f6-4b73-ba53-7ef0f876b518 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:15.800512 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325e8dd-02f6-4b73-ba53-7ef0f876b518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:15.821833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8325e8dd-02f6-4b73-ba53-7ef0f876b518 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:06:15.823066 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8325e8dd-02f6-4b73-ba53-7ef0f876b518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:06:15.887023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 570/1163] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:06:15 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:06:15.908551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115b7eb-599e-4a9d-82b3-21842ded06f8 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:15.989468 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:16.008843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115b7eb-599e-4a9d-82b3-21842ded06f8 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:16.042513 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13987a-d2bc-4fbb-b507-245d8d989461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:16.043064 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13987a-d2bc-4fbb-b507-245d8d989461 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:16.043342 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13987a-d2bc-4fbb-b507-245d8d989461 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:16.043613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13987a-d2bc-4fbb-b507-245d8d989461 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:16.109661 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13987a-d2bc-4fbb-b507-245d8d989461 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:16.111100 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13987a-d2bc-4fbb-b507-245d8d989461 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:16.187231 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:16.207432 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 594/1164] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:06:15 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 16:06:16.213594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325e8dd-02f6-4b73-ba53-7ef0f876b518 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:16.257877 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:16.310099 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325e8dd-02f6-4b73-ba53-7ef0f876b518 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:16.342064 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0608a6-f10c-4cd8-9da7-85fdad632619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:16.342693 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0608a6-f10c-4cd8-9da7-85fdad632619 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:16.343496 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0608a6-f10c-4cd8-9da7-85fdad632619 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:16.343783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0608a6-f10c-4cd8-9da7-85fdad632619 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:16.350273 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0608a6-f10c-4cd8-9da7-85fdad632619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:16.351718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0608a6-f10c-4cd8-9da7-85fdad632619 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:16.362945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-da0608a6-f10c-4cd8-9da7-85fdad632619 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 26 16:06:16.362945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:06:16.362945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 26 16:06:16.362945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 26 16:06:16.362945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:06:16.362945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:06:16.362945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:06:16.362945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:06:16.362945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 26 16:06:16.362945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:06:16.362945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:06:16.362945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:06:16.362945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:06:16.362945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:06:16.362945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:06:16.362945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:06:16.362945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:06:16.364119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:06:16.364119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:06:16.364119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:06:16.364119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:06:16.364119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:06:16.364119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:06:16.364119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:06:16.364119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:06:16.364119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:06:16.364119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:06:16.364119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:06:16.364119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:06:16.364119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:06:16.364119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:06:16.364119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:06:16.364119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:06:16.364993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:06:16.364993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:06:16.364993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:06:16.364993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:06:16.364993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:06:16.364993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:06:16.364993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:06:16.364993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:06:16.364993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:06:16.364993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:06:16.364993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 26 16:06:16.364993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:06:16.364993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 26 16:06:16.364993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:06:16.364993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 571/1165] 10.222.0.141 () {56 vars in 1122 bytes} [Tue Jul 26 16:06:16 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:06:16.369966 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13987a-d2bc-4fbb-b507-245d8d989461 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:16.466925 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13987a-d2bc-4fbb-b507-245d8d989461 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:16.499805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf3d15-ef25-40aa-a5b8-a19c95951f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:16.500411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf3d15-ef25-40aa-a5b8-a19c95951f7f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:16.500714 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf3d15-ef25-40aa-a5b8-a19c95951f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:16.500991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf3d15-ef25-40aa-a5b8-a19c95951f7f None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:16.501669 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf3d15-ef25-40aa-a5b8-a19c95951f7f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:06:16.501976 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf3d15-ef25-40aa-a5b8-a19c95951f7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:16.503332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf3d15-ef25-40aa-a5b8-a19c95951f7f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:16.510212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 595/1166] 10.222.0.141 () {56 vars in 1120 bytes} [Tue Jul 26 16:06:16 2022] GET /identity/v3/domains?name=swift_test => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:18.487545 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b64a3-6b42-4961-9a22-908ebf2c03b6 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:18.488063 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b64a3-6b42-4961-9a22-908ebf2c03b6 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:18.488153 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b64a3-6b42-4961-9a22-908ebf2c03b6 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:18.489473 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 572/1167] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:06:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:06:18.494673 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a3e1c-07ac-45d4-9488-a538195e7b90 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:18.495047 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a3e1c-07ac-45d4-9488-a538195e7b90 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:18.495239 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a3e1c-07ac-45d4-9488-a538195e7b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:18.513313 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f55a3e1c-07ac-45d4-9488-a538195e7b90 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:06:18.514504 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f55a3e1c-07ac-45d4-9488-a538195e7b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:06:18.553816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:18.579573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 596/1168] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:06:18 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:06:18.602706 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b64a3-6b42-4961-9a22-908ebf2c03b6 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:18.701516 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b64a3-6b42-4961-9a22-908ebf2c03b6 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:18.703768 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:18.734001 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968fbba6-f028-4e5e-8421-7fdeebb1f9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:18.735464 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fbba6-f028-4e5e-8421-7fdeebb1f9c5 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:18.736431 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fbba6-f028-4e5e-8421-7fdeebb1f9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:18.736736 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fbba6-f028-4e5e-8421-7fdeebb1f9c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:18.737455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968fbba6-f028-4e5e-8421-7fdeebb1f9c5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:18.738937 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968fbba6-f028-4e5e-8421-7fdeebb1f9c5 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:18.861537 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 573/1169] 10.222.0.141 () {60 vars in 1143 bytes} [Tue Jul 26 16:06:18 2022] POST /identity/v3/domains => generated 268 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:06:20.889233 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d730d-a066-4ff1-903f-d35d747b1a4c None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:20.889785 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d730d-a066-4ff1-903f-d35d747b1a4c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:20.890188 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d730d-a066-4ff1-903f-d35d747b1a4c None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:20.893204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 597/1170] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:06:20 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:06:20.899054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a819bb-717f-4241-9e55-1a864c3e44d4 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:20.899465 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a819bb-717f-4241-9e55-1a864c3e44d4 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:20.899595 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a819bb-717f-4241-9e55-1a864c3e44d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:20.917102 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-14a819bb-717f-4241-9e55-1a864c3e44d4 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:06:20.918266 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-14a819bb-717f-4241-9e55-1a864c3e44d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:06:20.984085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 574/1171] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:06:20 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:06:21.007183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d730d-a066-4ff1-903f-d35d747b1a4c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:21.103769 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d730d-a066-4ff1-903f-d35d747b1a4c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:21.136479 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ff55a-d9b1-4acd-8360-5626063c978f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:21.137121 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ff55a-d9b1-4acd-8360-5626063c978f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:21.137398 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ff55a-d9b1-4acd-8360-5626063c978f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:21.137667 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ff55a-d9b1-4acd-8360-5626063c978f None admin] PATH_INFO: `/v3/domains/6bb3a7f6c97d4bc59de94377c9f7b06e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:21.147699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ff55a-d9b1-4acd-8360-5626063c978f None admin] RBAC: Authorizing `identity:get_domain(domain_id=6bb3a7f6c97d4bc59de94377c9f7b06e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:21.149567 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ff55a-d9b1-4acd-8360-5626063c978f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:21.151114 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 598/1172] 10.222.0.141 () {56 vars in 1188 bytes} [Tue Jul 26 16:06:21 2022] GET /identity/v3/domains/6bb3a7f6c97d4bc59de94377c9f7b06e => generated 268 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:21.156879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a819bb-717f-4241-9e55-1a864c3e44d4 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:21.245586 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:21.252392 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a819bb-717f-4241-9e55-1a864c3e44d4 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:21.284296 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fa9ff-1efb-406f-a94e-6cb94e4746ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:21.284929 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fa9ff-1efb-406f-a94e-6cb94e4746ee None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:21.285209 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fa9ff-1efb-406f-a94e-6cb94e4746ee None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:21.285480 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fa9ff-1efb-406f-a94e-6cb94e4746ee None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:21.286152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fa9ff-1efb-406f-a94e-6cb94e4746ee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:21.287583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fa9ff-1efb-406f-a94e-6cb94e4746ee None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:21.365017 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 575/1173] 10.222.0.141 () {60 vars in 1146 bytes} [Tue Jul 26 16:06:21 2022] POST /identity/v3/projects => generated 362 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:06:23.380599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cdd8e-0bcb-43a1-ae00-6e9cfe6ab55a None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:23.381126 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cdd8e-0bcb-43a1-ae00-6e9cfe6ab55a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:23.381236 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cdd8e-0bcb-43a1-ae00-6e9cfe6ab55a None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:23.382550 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 599/1174] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:06:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:06:23.387598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390e96c-c06e-4fa1-b00d-cfc7cf7fbbca None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:23.387990 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390e96c-c06e-4fa1-b00d-cfc7cf7fbbca None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:23.388160 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390e96c-c06e-4fa1-b00d-cfc7cf7fbbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:23.405864 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-1390e96c-c06e-4fa1-b00d-cfc7cf7fbbca None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:06:23.407064 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1390e96c-c06e-4fa1-b00d-cfc7cf7fbbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:06:23.471804 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 576/1175] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:06:23 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:06:23.496693 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cdd8e-0bcb-43a1-ae00-6e9cfe6ab55a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:23.532236 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:23.597472 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cdd8e-0bcb-43a1-ae00-6e9cfe6ab55a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:23.630345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7832c-ada3-41e8-bb0b-870d915eaf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:23.631024 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7832c-ada3-41e8-bb0b-870d915eaf6f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:23.631251 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7832c-ada3-41e8-bb0b-870d915eaf6f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:23.631524 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7832c-ada3-41e8-bb0b-870d915eaf6f None admin] PATH_INFO: `/v3/domains/6bb3a7f6c97d4bc59de94377c9f7b06e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:23.632671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7832c-ada3-41e8-bb0b-870d915eaf6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=6bb3a7f6c97d4bc59de94377c9f7b06e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:23.634101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7832c-ada3-41e8-bb0b-870d915eaf6f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:23.635853 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 600/1176] 10.222.0.141 () {56 vars in 1188 bytes} [Tue Jul 26 16:06:23 2022] GET /identity/v3/domains/6bb3a7f6c97d4bc59de94377c9f7b06e => generated 268 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:23.641646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390e96c-c06e-4fa1-b00d-cfc7cf7fbbca None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:23.715295 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:23.738166 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390e96c-c06e-4fa1-b00d-cfc7cf7fbbca None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:23.771071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb5e7e-6edb-4618-89f1-b5f570999602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:23.771677 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb5e7e-6edb-4618-89f1-b5f570999602 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:23.771959 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb5e7e-6edb-4618-89f1-b5f570999602 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:23.772234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb5e7e-6edb-4618-89f1-b5f570999602 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:23.772949 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb5e7e-6edb-4618-89f1-b5f570999602 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:23.774410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb5e7e-6edb-4618-89f1-b5f570999602 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:23.838126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 577/1177] 10.222.0.141 () {60 vars in 1137 bytes} [Tue Jul 26 16:06:23 2022] POST /identity/v3/users => generated 312 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:06:25.850680 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e772a-5c8b-481d-8a53-4ad6c0a08f90 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:25.851240 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e772a-5c8b-481d-8a53-4ad6c0a08f90 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:25.851240 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e772a-5c8b-481d-8a53-4ad6c0a08f90 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:25.852577 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 601/1178] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:06:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:06:25.857666 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bc5fc-bf4c-4c39-b667-472c188cbea5 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:25.858084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bc5fc-bf4c-4c39-b667-472c188cbea5 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:25.858220 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bc5fc-bf4c-4c39-b667-472c188cbea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:25.876784 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c00bc5fc-bf4c-4c39-b667-472c188cbea5 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:06:25.877944 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c00bc5fc-bf4c-4c39-b667-472c188cbea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:06:25.941445 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 578/1179] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:06:25 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:06:25.963943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e772a-5c8b-481d-8a53-4ad6c0a08f90 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:26.063133 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e772a-5c8b-481d-8a53-4ad6c0a08f90 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:26.064612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:26.095581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7f128-e979-4ad6-9a4d-4a6c66de18a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:26.096198 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7f128-e979-4ad6-9a4d-4a6c66de18a2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:26.096476 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7f128-e979-4ad6-9a4d-4a6c66de18a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:26.096778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7f128-e979-4ad6-9a4d-4a6c66de18a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:26.110600 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7f128-e979-4ad6-9a4d-4a6c66de18a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:06:26.112264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-23c7f128-e979-4ad6-9a4d-4a6c66de18a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:06:26.112264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:06:26.112264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:06:26.112264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:06:26.112264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:06:26.112264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:06:26.112264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:06:26.112264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:06:26.112264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:06:26.112264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:06:26.112264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:06:26.112264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:06:26.112264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:06:26.112264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:06:26.112264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:06:26.112264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:06:26.113387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:06:26.113387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:06:26.113387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:06:26.113387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:06:26.113387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:06:26.113387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:06:26.113387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:06:26.113387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:06:26.113387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:06:26.113387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:06:26.113387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:06:26.113387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:06:26.113387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:06:26.113387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:06:26.113387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:06:26.113387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:06:26.114269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:06:26.114269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:06:26.114269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:06:26.114269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:06:26.114269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:06:26.114269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:06:26.114269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:06:26.114269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:06:26.114269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:06:26.114269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:06:26.114269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:06:26.114269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:06:26.114269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 602/1180] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:06:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:06:26.119329 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bc5fc-bf4c-4c39-b667-472c188cbea5 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:26.179139 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:26.215151 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bc5fc-bf4c-4c39-b667-472c188cbea5 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:26.249173 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a1e53-cebd-4641-ac4f-8bbc79064578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:26.249808 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a1e53-cebd-4641-ac4f-8bbc79064578 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:26.250088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a1e53-cebd-4641-ac4f-8bbc79064578 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:26.250359 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a1e53-cebd-4641-ac4f-8bbc79064578 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:26.251066 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a1e53-cebd-4641-ac4f-8bbc79064578 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:06:26.251370 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a1e53-cebd-4641-ac4f-8bbc79064578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:26.252748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a1e53-cebd-4641-ac4f-8bbc79064578 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:26.260479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 579/1181] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:06:26 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:06:26.266880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7f128-e979-4ad6-9a4d-4a6c66de18a2 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:26.363457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7f128-e979-4ad6-9a4d-4a6c66de18a2 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:26.395845 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fe284-74bb-4240-a5ad-76e9b894c7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:26.396493 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fe284-74bb-4240-a5ad-76e9b894c7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:26.396941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fe284-74bb-4240-a5ad-76e9b894c7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:26.397219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fe284-74bb-4240-a5ad-76e9b894c7d0 None admin] PATH_INFO: `/v3/users/72c59fa6633945ccbb2498d85e9ab1cf` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:26.410372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fe284-74bb-4240-a5ad-76e9b894c7d0 None admin] RBAC: Authorizing `identity:get_user(user_id=72c59fa6633945ccbb2498d85e9ab1cf)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:26.411785 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fe284-74bb-4240-a5ad-76e9b894c7d0 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:26.413412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 603/1182] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:06:26 2022] GET /identity/v3/users/72c59fa6633945ccbb2498d85e9ab1cf => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:26.419002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a1e53-cebd-4641-ac4f-8bbc79064578 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:26.514994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a1e53-cebd-4641-ac4f-8bbc79064578 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:26.538008 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:26.548483 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be2221-5e9b-43a9-b136-d58b47334547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:26.552865 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be2221-5e9b-43a9-b136-d58b47334547 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:26.552865 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be2221-5e9b-43a9-b136-d58b47334547 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:26.552865 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be2221-5e9b-43a9-b136-d58b47334547 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:26.614058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be2221-5e9b-43a9-b136-d58b47334547 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:26.615453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be2221-5e9b-43a9-b136-d58b47334547 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:26.710686 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 580/1183] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:06:26 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 16:06:26.716531 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fe284-74bb-4240-a5ad-76e9b894c7d0 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:26.737479 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:26.813013 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fe284-74bb-4240-a5ad-76e9b894c7d0 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:26.845609 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa29a8-e5e4-43c1-9db8-5cab9f807fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:26.846234 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa29a8-e5e4-43c1-9db8-5cab9f807fae None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:26.846513 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa29a8-e5e4-43c1-9db8-5cab9f807fae None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:26.846785 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa29a8-e5e4-43c1-9db8-5cab9f807fae None admin] PATH_INFO: `/v3/projects/36f3d15e5e5c48fa9013cb48b8eb1c37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:26.847911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa29a8-e5e4-43c1-9db8-5cab9f807fae None admin] RBAC: Authorizing `identity:get_project(project_id=36f3d15e5e5c48fa9013cb48b8eb1c37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:26.849354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa29a8-e5e4-43c1-9db8-5cab9f807fae None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:26.850979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 604/1184] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:06:26 2022] GET /identity/v3/projects/36f3d15e5e5c48fa9013cb48b8eb1c37 => generated 362 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:26.857169 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be2221-5e9b-43a9-b136-d58b47334547 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:26.881241 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:26.955090 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be2221-5e9b-43a9-b136-d58b47334547 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:26.987399 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1b4f4-eed6-45a3-a009-9dcdd0528589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:26.988002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1b4f4-eed6-45a3-a009-9dcdd0528589 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:26.988284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1b4f4-eed6-45a3-a009-9dcdd0528589 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:26.988566 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1b4f4-eed6-45a3-a009-9dcdd0528589 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:26.989390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1b4f4-eed6-45a3-a009-9dcdd0528589 None admin] RBAC: Adding query filter params (role.id=94ecbd6c86a84b75bdb0c57fc27a9a07, scope.project.id=36f3d15e5e5c48fa9013cb48b8eb1c37, user.id=72c59fa6633945ccbb2498d85e9ab1cf) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:06:26.989707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1b4f4-eed6-45a3-a009-9dcdd0528589 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:26.991135 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1b4f4-eed6-45a3-a009-9dcdd0528589 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:26.996319 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 581/1185] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:06:26 2022] GET /identity/v3/role_assignments?user.id=72c59fa6633945ccbb2498d85e9ab1cf&scope.project.id=36f3d15e5e5c48fa9013cb48b8eb1c37&role.id=94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 260 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:28.949496 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7d42d-b8e3-48e2-831b-564699db5edf None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:28.949977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7d42d-b8e3-48e2-831b-564699db5edf None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:28.950078 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7d42d-b8e3-48e2-831b-564699db5edf None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:28.951390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 605/1186] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:06:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:06:28.956568 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae4540-1d2b-4eb0-a141-24df89d9b180 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:28.956990 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae4540-1d2b-4eb0-a141-24df89d9b180 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:28.957152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae4540-1d2b-4eb0-a141-24df89d9b180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:28.975136 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-9bae4540-1d2b-4eb0-a141-24df89d9b180 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:06:28.976323 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9bae4540-1d2b-4eb0-a141-24df89d9b180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:06:29.040440 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 582/1187] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:06:28 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:06:29.063055 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7d42d-b8e3-48e2-831b-564699db5edf None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:29.149141 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:29.161176 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7d42d-b8e3-48e2-831b-564699db5edf None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:29.194231 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a6faa-e3a7-4798-82ce-4f1f5314b9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:29.194796 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a6faa-e3a7-4798-82ce-4f1f5314b9bc None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:29.195076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a6faa-e3a7-4798-82ce-4f1f5314b9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:29.195347 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a6faa-e3a7-4798-82ce-4f1f5314b9bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:29.205722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a6faa-e3a7-4798-82ce-4f1f5314b9bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:06:29.210558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-782a6faa-e3a7-4798-82ce-4f1f5314b9bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:06:29.210558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:06:29.210558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:06:29.210558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:06:29.210558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:06:29.210558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:06:29.210558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:06:29.210558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:06:29.210558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:06:29.210558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:06:29.210558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:06:29.210558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:06:29.210558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:06:29.210558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:06:29.210558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:06:29.210558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:06:29.211707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:06:29.211707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:06:29.211707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:06:29.211707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:06:29.211707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:06:29.211707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:06:29.211707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:06:29.211707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:06:29.211707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:06:29.211707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:06:29.211707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:06:29.211707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:06:29.211707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:06:29.211707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:06:29.211707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:06:29.211707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:06:29.212973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:06:29.212973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:06:29.212973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:06:29.212973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:06:29.212973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:06:29.212973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:06:29.212973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:06:29.212973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:06:29.212973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:06:29.212973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:06:29.212973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:06:29.212973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:06:29.212973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 606/1188] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:06:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:06:29.217880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae4540-1d2b-4eb0-a141-24df89d9b180 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:29.235507 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:29.313975 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae4540-1d2b-4eb0-a141-24df89d9b180 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:29.345822 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3868a-cf37-49dd-b49f-1f0eccb621a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:29.346426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3868a-cf37-49dd-b49f-1f0eccb621a2 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:29.346708 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3868a-cf37-49dd-b49f-1f0eccb621a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:29.346983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3868a-cf37-49dd-b49f-1f0eccb621a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:29.347688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3868a-cf37-49dd-b49f-1f0eccb621a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:06:29.347993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3868a-cf37-49dd-b49f-1f0eccb621a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:29.349377 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3868a-cf37-49dd-b49f-1f0eccb621a2 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:29.357123 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 583/1189] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:06:29 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:29.363468 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a6faa-e3a7-4798-82ce-4f1f5314b9bc None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:29.460641 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a6faa-e3a7-4798-82ce-4f1f5314b9bc None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:29.492300 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc4f54-1578-4541-8997-82bf8dfd9071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:29.492947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc4f54-1578-4541-8997-82bf8dfd9071 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:29.493224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc4f54-1578-4541-8997-82bf8dfd9071 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:29.493492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc4f54-1578-4541-8997-82bf8dfd9071 None admin] PATH_INFO: `/v3/users/72c59fa6633945ccbb2498d85e9ab1cf` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:29.494615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc4f54-1578-4541-8997-82bf8dfd9071 None admin] RBAC: Authorizing `identity:get_user(user_id=72c59fa6633945ccbb2498d85e9ab1cf)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:29.496014 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc4f54-1578-4541-8997-82bf8dfd9071 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:29.497590 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 607/1190] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:06:29 2022] GET /identity/v3/users/72c59fa6633945ccbb2498d85e9ab1cf => generated 312 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:29.503782 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3868a-cf37-49dd-b49f-1f0eccb621a2 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:29.586179 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:29.603867 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3868a-cf37-49dd-b49f-1f0eccb621a2 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:29.637367 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c01b0-369b-49bf-8a83-33992e843e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:29.638002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c01b0-369b-49bf-8a83-33992e843e11 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:29.638284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c01b0-369b-49bf-8a83-33992e843e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:29.638558 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c01b0-369b-49bf-8a83-33992e843e11 None admin] PATH_INFO: `/v3/projects/36f3d15e5e5c48fa9013cb48b8eb1c37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:29.639685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c01b0-369b-49bf-8a83-33992e843e11 None admin] RBAC: Authorizing `identity:get_project(project_id=36f3d15e5e5c48fa9013cb48b8eb1c37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:29.641170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c01b0-369b-49bf-8a83-33992e843e11 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:29.642807 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 584/1191] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:06:29 2022] GET /identity/v3/projects/36f3d15e5e5c48fa9013cb48b8eb1c37 => generated 362 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:29.648744 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc4f54-1578-4541-8997-82bf8dfd9071 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:29.667937 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:29.746511 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc4f54-1578-4541-8997-82bf8dfd9071 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:29.778508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11021847-83bb-451d-985e-d2233f4fa802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:29.779203 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11021847-83bb-451d-985e-d2233f4fa802 None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:29.779486 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11021847-83bb-451d-985e-d2233f4fa802 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:29.779761 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11021847-83bb-451d-985e-d2233f4fa802 None admin] PATH_INFO: `/v3/projects/36f3d15e5e5c48fa9013cb48b8eb1c37/users/72c59fa6633945ccbb2498d85e9ab1cf/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:29.782310 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11021847-83bb-451d-985e-d2233f4fa802 None admin] RBAC: Authorizing `identity:create_grant(project_id=36f3d15e5e5c48fa9013cb48b8eb1c37, user_id=72c59fa6633945ccbb2498d85e9ab1cf, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:29.783735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11021847-83bb-451d-985e-d2233f4fa802 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:29.849462 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 608/1192] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:06:29 2022] PUT /identity/v3/projects/36f3d15e5e5c48fa9013cb48b8eb1c37/users/72c59fa6633945ccbb2498d85e9ab1cf/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:06:31.821738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6daf10-2c5e-4aab-8841-dcf12a79c2d6 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:31.822266 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6daf10-2c5e-4aab-8841-dcf12a79c2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:31.822266 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6daf10-2c5e-4aab-8841-dcf12a79c2d6 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:31.823635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 585/1193] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:06:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:06:31.828686 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3ee6a-1fb4-468f-ad83-41074df6b6df None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:31.829131 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3ee6a-1fb4-468f-ad83-41074df6b6df None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:31.829246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3ee6a-1fb4-468f-ad83-41074df6b6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:31.846825 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-39f3ee6a-1fb4-468f-ad83-41074df6b6df None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:06:31.848012 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-39f3ee6a-1fb4-468f-ad83-41074df6b6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:06:31.915121 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 609/1194] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:06:31 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:06:31.938650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6daf10-2c5e-4aab-8841-dcf12a79c2d6 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:32.037719 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6daf10-2c5e-4aab-8841-dcf12a79c2d6 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:32.070505 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603182cf-4c0c-4a72-84b9-02cc53532564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:32.071126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603182cf-4c0c-4a72-84b9-02cc53532564 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:32.071405 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603182cf-4c0c-4a72-84b9-02cc53532564 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:32.071678 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603182cf-4c0c-4a72-84b9-02cc53532564 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:32.081736 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603182cf-4c0c-4a72-84b9-02cc53532564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:06:32.086523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-603182cf-4c0c-4a72-84b9-02cc53532564 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:06:32.086523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:06:32.086523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:06:32.086523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:06:32.086523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:06:32.086523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:06:32.086523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:06:32.086523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:06:32.086523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:06:32.086523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:06:32.086523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:06:32.086523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:06:32.086523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:06:32.086523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:06:32.086523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:06:32.086523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:06:32.087602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:06:32.087602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:06:32.087602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:06:32.087602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:06:32.087602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:06:32.087602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:06:32.087602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:06:32.087602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:06:32.087602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:06:32.087602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:06:32.087602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:06:32.087602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:06:32.087602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:06:32.087602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:06:32.087602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:06:32.087602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:06:32.088453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:06:32.088453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:06:32.088453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:06:32.088453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:06:32.088453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:06:32.088453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:06:32.088453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:06:32.088453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:06:32.088453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:06:32.088453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:06:32.088453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:06:32.088453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:06:32.088453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 586/1195] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:06:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:06:32.094237 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3ee6a-1fb4-468f-ad83-41074df6b6df None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:32.102203 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:32.188838 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3ee6a-1fb4-468f-ad83-41074df6b6df None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:32.220999 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83560c5a-ff91-49b5-83e6-394c5bebf006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:32.221601 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83560c5a-ff91-49b5-83e6-394c5bebf006 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:32.221879 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83560c5a-ff91-49b5-83e6-394c5bebf006 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:32.222150 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83560c5a-ff91-49b5-83e6-394c5bebf006 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:32.222853 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83560c5a-ff91-49b5-83e6-394c5bebf006 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:06:32.223157 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83560c5a-ff91-49b5-83e6-394c5bebf006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:32.224510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83560c5a-ff91-49b5-83e6-394c5bebf006 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:32.232914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 610/1196] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:06:32 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:32.239359 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603182cf-4c0c-4a72-84b9-02cc53532564 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:32.250901 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:32.338300 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603182cf-4c0c-4a72-84b9-02cc53532564 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:32.371765 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd16ef-7b9a-46b8-bf09-84a150c23e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:32.372390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd16ef-7b9a-46b8-bf09-84a150c23e38 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:32.372749 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd16ef-7b9a-46b8-bf09-84a150c23e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:32.372969 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd16ef-7b9a-46b8-bf09-84a150c23e38 None admin] PATH_INFO: `/v3/users/72c59fa6633945ccbb2498d85e9ab1cf` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:32.374127 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd16ef-7b9a-46b8-bf09-84a150c23e38 None admin] RBAC: Authorizing `identity:get_user(user_id=72c59fa6633945ccbb2498d85e9ab1cf)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:32.376146 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd16ef-7b9a-46b8-bf09-84a150c23e38 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:32.377756 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 587/1197] 10.222.0.141 () {56 vars in 1182 bytes} [Tue Jul 26 16:06:32 2022] GET /identity/v3/users/72c59fa6633945ccbb2498d85e9ab1cf => generated 312 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:32.383385 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83560c5a-ff91-49b5-83e6-394c5bebf006 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:32.448440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:32.479961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83560c5a-ff91-49b5-83e6-394c5bebf006 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:32.512853 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3eefdf-4885-42a7-a26f-5cde44eee7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:32.513460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3eefdf-4885-42a7-a26f-5cde44eee7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:32.513738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3eefdf-4885-42a7-a26f-5cde44eee7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:32.514011 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3eefdf-4885-42a7-a26f-5cde44eee7e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:32.577917 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3eefdf-4885-42a7-a26f-5cde44eee7e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:32.579348 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3eefdf-4885-42a7-a26f-5cde44eee7e3 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:32.640580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:32.673782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 611/1198] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:06:32 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 16:06:32.679719 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd16ef-7b9a-46b8-bf09-84a150c23e38 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:32.752627 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:32.774101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd16ef-7b9a-46b8-bf09-84a150c23e38 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:32.809691 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f6114-70fb-4a70-87cb-884691a83b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:32.810342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f6114-70fb-4a70-87cb-884691a83b85 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:32.810620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f6114-70fb-4a70-87cb-884691a83b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:32.810889 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f6114-70fb-4a70-87cb-884691a83b85 None admin] PATH_INFO: `/v3/projects/36f3d15e5e5c48fa9013cb48b8eb1c37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:32.812054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f6114-70fb-4a70-87cb-884691a83b85 None admin] RBAC: Authorizing `identity:get_project(project_id=36f3d15e5e5c48fa9013cb48b8eb1c37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:32.813496 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f6114-70fb-4a70-87cb-884691a83b85 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:32.815131 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 588/1199] 10.222.0.141 () {56 vars in 1191 bytes} [Tue Jul 26 16:06:32 2022] GET /identity/v3/projects/36f3d15e5e5c48fa9013cb48b8eb1c37 => generated 362 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:32.821156 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3eefdf-4885-42a7-a26f-5cde44eee7e3 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:06:32.920106 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3eefdf-4885-42a7-a26f-5cde44eee7e3 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:06:32.954879 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bf878-259c-4d6a-b824-6decc46c3a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:06:32.955478 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bf878-259c-4d6a-b824-6decc46c3a35 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:06:32.955752 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bf878-259c-4d6a-b824-6decc46c3a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:06:32.956018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bf878-259c-4d6a-b824-6decc46c3a35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:06:32.956814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11bf878-259c-4d6a-b824-6decc46c3a35 None admin] RBAC: Adding query filter params (role.id=94ecbd6c86a84b75bdb0c57fc27a9a07, scope.project.id=36f3d15e5e5c48fa9013cb48b8eb1c37, user.id=72c59fa6633945ccbb2498d85e9ab1cf) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:06:32.957118 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11bf878-259c-4d6a-b824-6decc46c3a35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:06:32.958512 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11bf878-259c-4d6a-b824-6decc46c3a35 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:06:32.964004 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 612/1200] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:06:32 2022] GET /identity/v3/role_assignments?user.id=72c59fa6633945ccbb2498d85e9ab1cf&scope.project.id=36f3d15e5e5c48fa9013cb48b8eb1c37&role.id=94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 610 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:06:42.805603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=28 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:06:42.961524 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=84 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:46.372331 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785faf6c-5c49-4b23-8398-c183db9b8c7a None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:46.372917 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785faf6c-5c49-4b23-8398-c183db9b8c7a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:46.372917 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785faf6c-5c49-4b23-8398-c183db9b8c7a None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:46.374301 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 589/1201] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:07:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:07:46.379511 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054349f5-f1aa-4ab3-9ad4-da8a19efb7b1 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:46.379963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054349f5-f1aa-4ab3-9ad4-da8a19efb7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:46.380062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054349f5-f1aa-4ab3-9ad4-da8a19efb7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:46.397810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-054349f5-f1aa-4ab3-9ad4-da8a19efb7b1 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:07:46.401423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-054349f5-f1aa-4ab3-9ad4-da8a19efb7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:07:46.464538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 613/1202] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:07:46 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:07:46.491464 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785faf6c-5c49-4b23-8398-c183db9b8c7a None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:46.592878 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785faf6c-5c49-4b23-8398-c183db9b8c7a None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:46.626079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee133b1-eee5-4546-a987-8902b0e33ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:46.626688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee133b1-eee5-4546-a987-8902b0e33ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:46.626973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee133b1-eee5-4546-a987-8902b0e33ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:46.627255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee133b1-eee5-4546-a987-8902b0e33ae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:46.637158 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee133b1-eee5-4546-a987-8902b0e33ae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:46.639129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee133b1-eee5-4546-a987-8902b0e33ae1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:46.653454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-4ee133b1-eee5-4546-a987-8902b0e33ae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:07:46.653454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:07:46.653454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:07:46.653454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:07:46.653454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:07:46.653454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:07:46.653454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:07:46.653454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:07:46.653454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:07:46.653454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:07:46.653454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:07:46.653454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:07:46.653454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:07:46.653454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:07:46.653454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:07:46.655134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:07:46.655134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:07:46.655134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:07:46.655134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:07:46.655134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:07:46.655134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:07:46.655134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:07:46.655134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:07:46.655134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:07:46.655134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:07:46.655134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:07:46.655134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:07:46.655134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:07:46.655134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:07:46.655134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:07:46.655134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:07:46.655134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:07:46.656316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:07:46.656316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:07:46.656316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:07:46.656316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:07:46.656316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 590/1203] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:07:46.661336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054349f5-f1aa-4ab3-9ad4-da8a19efb7b1 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:46.759873 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054349f5-f1aa-4ab3-9ad4-da8a19efb7b1 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:46.787344 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:46.792897 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa926c9c-7bef-4b25-8077-0c0ae957da9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:46.793509 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa926c9c-7bef-4b25-8077-0c0ae957da9c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:46.793787 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa926c9c-7bef-4b25-8077-0c0ae957da9c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:46.794059 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa926c9c-7bef-4b25-8077-0c0ae957da9c None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:46.794737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa926c9c-7bef-4b25-8077-0c0ae957da9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:07:46.795807 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa926c9c-7bef-4b25-8077-0c0ae957da9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:46.797195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa926c9c-7bef-4b25-8077-0c0ae957da9c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:46.808048 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 614/1204] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:07:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:07:46.814498 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee133b1-eee5-4546-a987-8902b0e33ae1 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:46.866103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:46.912121 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee133b1-eee5-4546-a987-8902b0e33ae1 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:46.946073 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82347073-9d65-47a5-9b8d-e3249309b81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:46.946690 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82347073-9d65-47a5-9b8d-e3249309b81e None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:46.946971 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82347073-9d65-47a5-9b8d-e3249309b81e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:46.947243 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82347073-9d65-47a5-9b8d-e3249309b81e None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:46.947919 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82347073-9d65-47a5-9b8d-e3249309b81e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:46.949398 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82347073-9d65-47a5-9b8d-e3249309b81e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:47.075378 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 591/1205] 10.222.0.141 () {60 vars in 1137 bytes} [Tue Jul 26 16:07:46 2022] POST /identity/v3/users => generated 252 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:07:49.105953 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93f6c5-7244-4f07-b66a-9d0d077aac12 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:49.106474 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93f6c5-7244-4f07-b66a-9d0d077aac12 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:49.106474 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93f6c5-7244-4f07-b66a-9d0d077aac12 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:49.107880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 615/1206] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:07:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:07:49.113306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8c842-6b85-4ee7-8b7e-35e786889d7f None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:49.113721 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8c842-6b85-4ee7-8b7e-35e786889d7f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:49.113864 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8c842-6b85-4ee7-8b7e-35e786889d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:49.132450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-91d8c842-6b85-4ee7-8b7e-35e786889d7f None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:07:49.138165 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-91d8c842-6b85-4ee7-8b7e-35e786889d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:07:49.200360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 592/1207] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:07:49 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:07:49.223528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93f6c5-7244-4f07-b66a-9d0d077aac12 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:49.323877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93f6c5-7244-4f07-b66a-9d0d077aac12 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:49.357238 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed245f-b9f2-404c-9cea-ebb12f3a48f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:49.357872 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed245f-b9f2-404c-9cea-ebb12f3a48f4 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:49.358148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed245f-b9f2-404c-9cea-ebb12f3a48f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:49.358417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed245f-b9f2-404c-9cea-ebb12f3a48f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:49.368797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed245f-b9f2-404c-9cea-ebb12f3a48f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:07:49.373648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-19ed245f-b9f2-404c-9cea-ebb12f3a48f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:07:49.373648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:07:49.373648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:07:49.373648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:07:49.373648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:07:49.373648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:07:49.373648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:07:49.373648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:07:49.373648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:07:49.373648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:07:49.373648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:07:49.373648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:07:49.373648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:07:49.373648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:07:49.373648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:07:49.373648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:07:49.375290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:07:49.375290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:07:49.375290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:07:49.375290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:07:49.375290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:07:49.375290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:07:49.375290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:07:49.375290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:07:49.375290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:07:49.375290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:07:49.375290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:07:49.375290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:07:49.375290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:07:49.375290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:07:49.375290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:07:49.375290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:07:49.376492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:07:49.376492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:07:49.376492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:07:49.376492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:07:49.376492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:07:49.376492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:07:49.376492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:07:49.376492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:07:49.376492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:07:49.376492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:07:49.376492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:07:49.376492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:07:49.376492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 616/1208] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:07:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:07:49.381307 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8c842-6b85-4ee7-8b7e-35e786889d7f None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:49.420153 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:49.484243 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8c842-6b85-4ee7-8b7e-35e786889d7f None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:49.517978 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468146d-ace7-416b-b977-3ac5f95fc650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:49.518593 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468146d-ace7-416b-b977-3ac5f95fc650 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:49.518870 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468146d-ace7-416b-b977-3ac5f95fc650 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:49.519142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468146d-ace7-416b-b977-3ac5f95fc650 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:49.519846 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468146d-ace7-416b-b977-3ac5f95fc650 None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:07:49.520150 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468146d-ace7-416b-b977-3ac5f95fc650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:49.521541 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468146d-ace7-416b-b977-3ac5f95fc650 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:49.529114 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 593/1209] 10.222.0.141 () {56 vars in 1108 bytes} [Tue Jul 26 16:07:49 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:07:49.535465 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed245f-b9f2-404c-9cea-ebb12f3a48f4 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:49.586935 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:49.635656 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed245f-b9f2-404c-9cea-ebb12f3a48f4 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:49.668613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c5b4b-edaa-43cb-b84b-95b343babba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:49.669269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c5b4b-edaa-43cb-b84b-95b343babba1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:49.669550 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c5b4b-edaa-43cb-b84b-95b343babba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:49.669824 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c5b4b-edaa-43cb-b84b-95b343babba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:49.681153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c5b4b-edaa-43cb-b84b-95b343babba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:49.682598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c5b4b-edaa-43cb-b84b-95b343babba1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:49.697196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-380c5b4b-edaa-43cb-b84b-95b343babba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:07:49.697196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:07:49.697196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:07:49.697196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:07:49.697196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:07:49.697196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:07:49.697196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:07:49.697196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:07:49.697196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:07:49.697196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:07:49.697196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:07:49.697196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:07:49.697196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:07:49.697196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:07:49.697196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:07:49.698612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:07:49.698612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:07:49.698612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:07:49.698612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:07:49.698612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:07:49.698612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:07:49.698612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:07:49.698612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:07:49.698612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:07:49.698612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:07:49.698612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:07:49.698612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:07:49.698612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:07:49.698612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:07:49.698612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:07:49.698612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:07:49.698612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:07:49.699475 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:07:49.699475 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:07:49.699475 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:07:49.699475 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:07:49.699475 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 617/1210] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:07:49.704180 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468146d-ace7-416b-b977-3ac5f95fc650 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:49.801121 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:49.803972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468146d-ace7-416b-b977-3ac5f95fc650 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:49.836765 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e6f7c-e48e-45be-90f7-20fb0165f913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:49.837323 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e6f7c-e48e-45be-90f7-20fb0165f913 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:49.837622 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e6f7c-e48e-45be-90f7-20fb0165f913 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:49.837894 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e6f7c-e48e-45be-90f7-20fb0165f913 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:49.838576 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e6f7c-e48e-45be-90f7-20fb0165f913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:07:49.838879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e6f7c-e48e-45be-90f7-20fb0165f913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:49.840283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e6f7c-e48e-45be-90f7-20fb0165f913 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:49.851718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 594/1211] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:07:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:07:49.857399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c5b4b-edaa-43cb-b84b-95b343babba1 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:49.957968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c5b4b-edaa-43cb-b84b-95b343babba1 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:49.959614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:49.991700 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08773e69-6f10-4339-8228-bbc7f7cd4d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:49.993862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08773e69-6f10-4339-8228-bbc7f7cd4d4b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:49.993862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08773e69-6f10-4339-8228-bbc7f7cd4d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:49.993862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08773e69-6f10-4339-8228-bbc7f7cd4d4b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:50.000303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08773e69-6f10-4339-8228-bbc7f7cd4d4b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:50.001780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08773e69-6f10-4339-8228-bbc7f7cd4d4b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:50.012921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-08773e69-6f10-4339-8228-bbc7f7cd4d4b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 16:07:50.012921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:07:50.012921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:07:50.012921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:07:50.012921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:07:50.012921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:07:50.012921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:07:50.012921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:07:50.012921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:07:50.012921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:07:50.012921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:07:50.012921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:07:50.012921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:07:50.012921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:07:50.012921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:07:50.012921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:07:50.014070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:07:50.014070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:07:50.014070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:07:50.014070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:07:50.014070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:07:50.014070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:07:50.014070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:07:50.014070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:07:50.014070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:07:50.014070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:07:50.014070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:07:50.014070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:07:50.014070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:07:50.014070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:07:50.014070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:07:50.014070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:07:50.014070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:07:50.014070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:07:50.015386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:07:50.015386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:07:50.015386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:07:50.015386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:07:50.015386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:07:50.015386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:07:50.015386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:07:50.015386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:07:50.015386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 16:07:50.015386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:07:50.015386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 618/1212] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:07:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:07:50.019929 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e6f7c-e48e-45be-90f7-20fb0165f913 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:50.117677 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e6f7c-e48e-45be-90f7-20fb0165f913 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:50.149496 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7cf5a-d29f-4bd7-ad72-f35c55f4ba15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:50.150088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7cf5a-d29f-4bd7-ad72-f35c55f4ba15 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:50.150367 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7cf5a-d29f-4bd7-ad72-f35c55f4ba15 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:50.150637 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7cf5a-d29f-4bd7-ad72-f35c55f4ba15 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:50.151410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7cf5a-d29f-4bd7-ad72-f35c55f4ba15 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:07:50.151714 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7cf5a-d29f-4bd7-ad72-f35c55f4ba15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:50.153163 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7cf5a-d29f-4bd7-ad72-f35c55f4ba15 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:50.170055 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 595/1213] 10.222.0.141 () {56 vars in 1148 bytes} [Tue Jul 26 16:07:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:07:50.176164 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08773e69-6f10-4339-8228-bbc7f7cd4d4b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:50.273414 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08773e69-6f10-4339-8228-bbc7f7cd4d4b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:50.306507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7108a-e1a7-4b15-b7e6-8bc00ac5827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:50.307111 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7108a-e1a7-4b15-b7e6-8bc00ac5827e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:50.307388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7108a-e1a7-4b15-b7e6-8bc00ac5827e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:50.307659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7108a-e1a7-4b15-b7e6-8bc00ac5827e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:50.336302 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:50.373183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7108a-e1a7-4b15-b7e6-8bc00ac5827e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:50.374647 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7108a-e1a7-4b15-b7e6-8bc00ac5827e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:50.470062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 619/1214] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:07:50 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 16:07:50.475940 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7cf5a-d29f-4bd7-ad72-f35c55f4ba15 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:50.494341 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:50.574842 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7cf5a-d29f-4bd7-ad72-f35c55f4ba15 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:50.608426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae275457-001f-40d7-8412-c7782073baf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:50.609085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae275457-001f-40d7-8412-c7782073baf1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:50.609368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae275457-001f-40d7-8412-c7782073baf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:50.609642 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae275457-001f-40d7-8412-c7782073baf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:50.619569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae275457-001f-40d7-8412-c7782073baf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:50.621058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae275457-001f-40d7-8412-c7782073baf1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:50.635983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-ae275457-001f-40d7-8412-c7782073baf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:07:50.635983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:07:50.635983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:07:50.635983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:07:50.635983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:07:50.635983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:07:50.635983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:07:50.635983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:07:50.635983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:07:50.635983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:07:50.635983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:07:50.635983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:07:50.635983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:07:50.635983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:07:50.635983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:07:50.639748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:07:50.639748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:07:50.639748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:07:50.639748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:07:50.639748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:07:50.639748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:07:50.639748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:07:50.639748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:07:50.639748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:07:50.639748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:07:50.639748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:07:50.639748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:07:50.639748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:07:50.639748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:07:50.639748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:07:50.639748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:07:50.639748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:07:50.641497 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:07:50.641497 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:07:50.641497 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:07:50.641497 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:07:50.641497 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 596/1215] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:07:50.643648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7108a-e1a7-4b15-b7e6-8bc00ac5827e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:50.703995 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:50.741799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7108a-e1a7-4b15-b7e6-8bc00ac5827e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:50.773724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acdd47-0205-4e5d-96ad-ec6819d686db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:50.774326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acdd47-0205-4e5d-96ad-ec6819d686db None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:50.774607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acdd47-0205-4e5d-96ad-ec6819d686db None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:50.774880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acdd47-0205-4e5d-96ad-ec6819d686db None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:50.775553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acdd47-0205-4e5d-96ad-ec6819d686db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:07:50.775854 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acdd47-0205-4e5d-96ad-ec6819d686db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:50.777236 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acdd47-0205-4e5d-96ad-ec6819d686db None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:50.788686 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 620/1216] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:07:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:07:50.794208 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae275457-001f-40d7-8412-c7782073baf1 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:50.861571 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:50.890452 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae275457-001f-40d7-8412-c7782073baf1 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:50.925270 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2a598-db21-4699-a819-2e8e0577e47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:50.926215 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2a598-db21-4699-a819-2e8e0577e47b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:50.926215 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2a598-db21-4699-a819-2e8e0577e47b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:50.926439 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2a598-db21-4699-a819-2e8e0577e47b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:50.933309 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2a598-db21-4699-a819-2e8e0577e47b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:50.934818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2a598-db21-4699-a819-2e8e0577e47b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:50.947040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-faf2a598-db21-4699-a819-2e8e0577e47b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:07:50.947040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:07:50.947040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:07:50.947040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:07:50.947040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:07:50.947040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:07:50.947040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:07:50.947040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:07:50.947040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:07:50.947040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:07:50.947040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:07:50.947040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:07:50.947040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:07:50.947040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:07:50.947040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:07:50.948126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:07:50.948126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:07:50.948126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:07:50.948126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:07:50.948126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:07:50.948126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:07:50.948126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:07:50.948126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:07:50.948126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:07:50.948126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:07:50.948126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:07:50.948126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:07:50.948126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:07:50.948126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:07:50.948126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:07:50.948126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:07:50.948126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:07:50.949445 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:07:50.949445 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:07:50.949445 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:07:50.949445 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:07:50.949445 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:07:50.949445 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:07:50.949445 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:07:50.949445 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:07:50.949445 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 597/1217] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:07:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:07:50.954648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acdd47-0205-4e5d-96ad-ec6819d686db None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:51.051989 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acdd47-0205-4e5d-96ad-ec6819d686db None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:51.073137 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:51.084618 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01720997-b9f3-424d-8f70-196258bc6001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:51.085249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01720997-b9f3-424d-8f70-196258bc6001 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:51.085527 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01720997-b9f3-424d-8f70-196258bc6001 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:51.085799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01720997-b9f3-424d-8f70-196258bc6001 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:51.086530 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01720997-b9f3-424d-8f70-196258bc6001 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:07:51.086836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01720997-b9f3-424d-8f70-196258bc6001 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:51.088256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01720997-b9f3-424d-8f70-196258bc6001 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:51.100393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 621/1218] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:07:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:07:51.106548 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2a598-db21-4699-a819-2e8e0577e47b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:51.205351 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2a598-db21-4699-a819-2e8e0577e47b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:51.232330 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:51.238413 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17376118-fee8-41c1-82d8-dfdfa94bbda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:51.239004 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17376118-fee8-41c1-82d8-dfdfa94bbda3 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:51.239283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17376118-fee8-41c1-82d8-dfdfa94bbda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:51.239553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17376118-fee8-41c1-82d8-dfdfa94bbda3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:51.240331 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17376118-fee8-41c1-82d8-dfdfa94bbda3 None admin] RBAC: Adding query filter params (role.id=6540af5baf2c4ff78d0fedfc4bea4e46, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=fda05b7b9675423e992470819d1c150a) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:07:51.240639 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17376118-fee8-41c1-82d8-dfdfa94bbda3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:51.242194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17376118-fee8-41c1-82d8-dfdfa94bbda3 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:51.247354 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 598/1219] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:07:51 2022] GET /identity/v3/role_assignments?user.id=fda05b7b9675423e992470819d1c150a&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=6540af5baf2c4ff78d0fedfc4bea4e46 => generated 260 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:07:53.193452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ab5a9-3e87-46e3-bee1-3912ea65ad8a None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:53.193989 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ab5a9-3e87-46e3-bee1-3912ea65ad8a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:53.193989 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ab5a9-3e87-46e3-bee1-3912ea65ad8a None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:53.195255 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 622/1220] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:07:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:07:53.200414 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683c7f4-99fc-4ff6-98d8-77bbbce114e8 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:53.200851 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683c7f4-99fc-4ff6-98d8-77bbbce114e8 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:53.200998 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683c7f4-99fc-4ff6-98d8-77bbbce114e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:53.220109 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8683c7f4-99fc-4ff6-98d8-77bbbce114e8 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:07:53.221342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8683c7f4-99fc-4ff6-98d8-77bbbce114e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:07:53.285979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 599/1221] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:07:53 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:07:53.308263 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ab5a9-3e87-46e3-bee1-3912ea65ad8a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:53.411005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ab5a9-3e87-46e3-bee1-3912ea65ad8a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:53.444116 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5597a8-a450-4df5-b63a-21b42e4b4b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:53.444706 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5597a8-a450-4df5-b63a-21b42e4b4b77 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:53.444992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5597a8-a450-4df5-b63a-21b42e4b4b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:53.445268 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5597a8-a450-4df5-b63a-21b42e4b4b77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:53.455734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5597a8-a450-4df5-b63a-21b42e4b4b77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:07:53.460626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-cd5597a8-a450-4df5-b63a-21b42e4b4b77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:07:53.460626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:07:53.460626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:07:53.460626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:07:53.460626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:07:53.460626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:07:53.460626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:07:53.460626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:07:53.460626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:07:53.460626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:07:53.460626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:07:53.460626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:07:53.460626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:07:53.460626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:07:53.460626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:07:53.460626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:07:53.461708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:07:53.461708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:07:53.461708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:07:53.461708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:07:53.461708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:07:53.461708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:07:53.461708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:07:53.461708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:07:53.461708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:07:53.461708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:07:53.461708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:07:53.461708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:07:53.461708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:07:53.461708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:07:53.461708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:07:53.461708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:07:53.462858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:07:53.462858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:07:53.462858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:07:53.462858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:07:53.462858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:07:53.462858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:07:53.462858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:07:53.462858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:07:53.462858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:07:53.462858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:07:53.462858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:07:53.462858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:07:53.462858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 623/1222] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:07:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:07:53.467883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683c7f4-99fc-4ff6-98d8-77bbbce114e8 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:53.566675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683c7f4-99fc-4ff6-98d8-77bbbce114e8 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:53.589688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:53.600508 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d1cce-2356-472b-807c-5bc5d672b0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:53.601158 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d1cce-2356-472b-807c-5bc5d672b0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:53.601441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d1cce-2356-472b-807c-5bc5d672b0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:53.601715 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d1cce-2356-472b-807c-5bc5d672b0e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:53.602455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d1cce-2356-472b-807c-5bc5d672b0e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:07:53.602760 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d1cce-2356-472b-807c-5bc5d672b0e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:53.604181 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d1cce-2356-472b-807c-5bc5d672b0e6 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:53.614447 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 600/1223] 10.222.0.141 () {56 vars in 1108 bytes} [Tue Jul 26 16:07:53 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:07:53.620383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5597a8-a450-4df5-b63a-21b42e4b4b77 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:53.665062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:53.720033 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5597a8-a450-4df5-b63a-21b42e4b4b77 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:53.752896 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895be5e-a3bf-4ea0-b0d6-6681e1b19ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:53.753524 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895be5e-a3bf-4ea0-b0d6-6681e1b19ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:53.753823 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895be5e-a3bf-4ea0-b0d6-6681e1b19ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:53.754121 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895be5e-a3bf-4ea0-b0d6-6681e1b19ce7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:53.763716 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895be5e-a3bf-4ea0-b0d6-6681e1b19ce7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:53.765792 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895be5e-a3bf-4ea0-b0d6-6681e1b19ce7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:53.781368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-b895be5e-a3bf-4ea0-b0d6-6681e1b19ce7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:07:53.781368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:07:53.781368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:07:53.781368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:07:53.781368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:07:53.781368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:07:53.781368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:07:53.781368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:07:53.781368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:07:53.781368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:07:53.781368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:07:53.781368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:07:53.781368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:07:53.781368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:07:53.781368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:07:53.782473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:07:53.782473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:07:53.782473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:07:53.782473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:07:53.782473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:07:53.782473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:07:53.782473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:07:53.782473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:07:53.782473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:07:53.782473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:07:53.782473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:07:53.782473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:07:53.782473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:07:53.782473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:07:53.782473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:07:53.782473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:07:53.782473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:07:53.784074 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:07:53.784074 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:07:53.784074 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:07:53.784074 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:07:53.784823 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 624/1224] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:07:53.788554 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d1cce-2356-472b-807c-5bc5d672b0e6 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:53.887927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d1cce-2356-472b-807c-5bc5d672b0e6 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:53.921730 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35ba28-3a51-4b59-8189-6d3f0b2dddb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:53.922346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35ba28-3a51-4b59-8189-6d3f0b2dddb9 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:53.922625 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35ba28-3a51-4b59-8189-6d3f0b2dddb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:53.922898 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35ba28-3a51-4b59-8189-6d3f0b2dddb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:53.923578 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35ba28-3a51-4b59-8189-6d3f0b2dddb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:07:53.923879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35ba28-3a51-4b59-8189-6d3f0b2dddb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:53.925265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35ba28-3a51-4b59-8189-6d3f0b2dddb9 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:53.937554 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 601/1225] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:07:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:07:53.943228 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895be5e-a3bf-4ea0-b0d6-6681e1b19ce7 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:54.034322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:54.040708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895be5e-a3bf-4ea0-b0d6-6681e1b19ce7 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:54.074910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387c5b6-1ac7-48d3-a8f6-b104150aade3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:54.075540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387c5b6-1ac7-48d3-a8f6-b104150aade3 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:54.075822 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387c5b6-1ac7-48d3-a8f6-b104150aade3 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:54.076098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387c5b6-1ac7-48d3-a8f6-b104150aade3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:54.083591 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387c5b6-1ac7-48d3-a8f6-b104150aade3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:54.085112 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387c5b6-1ac7-48d3-a8f6-b104150aade3 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:54.096256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-c387c5b6-1ac7-48d3-a8f6-b104150aade3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 16:07:54.096256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:07:54.096256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:07:54.096256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:07:54.096256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:07:54.096256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:07:54.096256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:07:54.096256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:07:54.096256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:07:54.096256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:07:54.096256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:07:54.096256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:07:54.096256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:07:54.096256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:07:54.096256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:07:54.096256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:07:54.097281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:07:54.097281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:07:54.097281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:07:54.097281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:07:54.097281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:07:54.097281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:07:54.097281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:07:54.097281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:07:54.097281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:07:54.097281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:07:54.097281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:07:54.097281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:07:54.097281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:07:54.097281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:07:54.097281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:07:54.097281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:07:54.097281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:07:54.097281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:07:54.098226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:07:54.098226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:07:54.098226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:07:54.098226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:07:54.098226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:07:54.098226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:07:54.098226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:07:54.098226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:07:54.098226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 16:07:54.098226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:07:54.098226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 625/1226] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:07:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:07:54.103629 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35ba28-3a51-4b59-8189-6d3f0b2dddb9 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:54.149433 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:54.200265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35ba28-3a51-4b59-8189-6d3f0b2dddb9 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:54.233303 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0c394-7b8b-4fb1-ab53-aa4f16b61ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:54.234417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0c394-7b8b-4fb1-ab53-aa4f16b61ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:54.234706 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0c394-7b8b-4fb1-ab53-aa4f16b61ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:54.234976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0c394-7b8b-4fb1-ab53-aa4f16b61ed7 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:54.235746 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0c394-7b8b-4fb1-ab53-aa4f16b61ed7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:07:54.236049 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0c394-7b8b-4fb1-ab53-aa4f16b61ed7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:54.237510 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0c394-7b8b-4fb1-ab53-aa4f16b61ed7 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:54.255426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 602/1227] 10.222.0.141 () {56 vars in 1148 bytes} [Tue Jul 26 16:07:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:07:54.261563 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387c5b6-1ac7-48d3-a8f6-b104150aade3 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:54.357521 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387c5b6-1ac7-48d3-a8f6-b104150aade3 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:54.391098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e709e-3d3f-4601-9402-2aff276367b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:54.391746 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e709e-3d3f-4601-9402-2aff276367b8 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:54.392026 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e709e-3d3f-4601-9402-2aff276367b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:54.392298 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e709e-3d3f-4601-9402-2aff276367b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:54.402774 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e709e-3d3f-4601-9402-2aff276367b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:54.405197 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e709e-3d3f-4601-9402-2aff276367b8 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:54.418671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-325e709e-3d3f-4601-9402-2aff276367b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:07:54.418671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:07:54.418671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:07:54.418671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:07:54.418671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:07:54.418671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:07:54.418671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:07:54.418671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:07:54.418671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:07:54.418671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:07:54.418671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:07:54.418671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:07:54.418671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:07:54.418671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:07:54.418671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:07:54.419710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:07:54.419710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:07:54.419710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:07:54.419710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:07:54.419710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:07:54.419710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:07:54.419710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:07:54.419710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:07:54.419710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:07:54.419710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:07:54.419710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:07:54.419710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:07:54.419710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:07:54.419710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:07:54.419710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:07:54.419710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:07:54.419710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:07:54.420921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:07:54.420921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:07:54.420921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:07:54.420921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:07:54.420921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 626/1228] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:07:54.426508 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0c394-7b8b-4fb1-ab53-aa4f16b61ed7 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:54.521702 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0c394-7b8b-4fb1-ab53-aa4f16b61ed7 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:54.523941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:54.555104 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d7078-51af-475d-a35f-8bd03c9ccda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:54.555711 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d7078-51af-475d-a35f-8bd03c9ccda8 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:54.555991 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d7078-51af-475d-a35f-8bd03c9ccda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:54.556264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d7078-51af-475d-a35f-8bd03c9ccda8 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:54.556976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d7078-51af-475d-a35f-8bd03c9ccda8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:07:54.557280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d7078-51af-475d-a35f-8bd03c9ccda8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:54.558637 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d7078-51af-475d-a35f-8bd03c9ccda8 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:54.569529 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 603/1229] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:07:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:07:54.575337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e709e-3d3f-4601-9402-2aff276367b8 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:54.585902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:54.675737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e709e-3d3f-4601-9402-2aff276367b8 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:54.709458 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67b264-e275-48e9-864b-47689727136c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:54.710088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67b264-e275-48e9-864b-47689727136c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:54.710395 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67b264-e275-48e9-864b-47689727136c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:54.710670 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67b264-e275-48e9-864b-47689727136c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:54.717187 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67b264-e275-48e9-864b-47689727136c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:54.719220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67b264-e275-48e9-864b-47689727136c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:54.730209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-ec67b264-e275-48e9-864b-47689727136c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:07:54.730209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:07:54.730209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:07:54.730209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:07:54.730209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:07:54.730209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:07:54.730209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:07:54.730209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:07:54.730209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:07:54.730209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:07:54.730209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:07:54.730209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:07:54.730209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:07:54.730209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:07:54.730209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:07:54.731256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:07:54.731256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:07:54.731256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:07:54.731256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:07:54.731256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:07:54.731256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:07:54.731256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:07:54.731256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:07:54.731256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:07:54.731256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:07:54.731256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:07:54.731256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:07:54.731256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:07:54.731256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:07:54.731256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:07:54.731256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:07:54.731256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:07:54.732140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:07:54.732140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:07:54.732140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:07:54.732140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:07:54.732140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:07:54.732140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:07:54.732140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:07:54.732140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:07:54.732140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 627/1230] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:07:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:07:54.737383 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d7078-51af-475d-a35f-8bd03c9ccda8 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:54.834764 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d7078-51af-475d-a35f-8bd03c9ccda8 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:54.867305 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e4ce3-2195-4ca5-a000-bf52c865316b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:54.867911 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e4ce3-2195-4ca5-a000-bf52c865316b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:54.868193 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e4ce3-2195-4ca5-a000-bf52c865316b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:54.868498 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e4ce3-2195-4ca5-a000-bf52c865316b None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:54.869275 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e4ce3-2195-4ca5-a000-bf52c865316b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:07:54.869584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e4ce3-2195-4ca5-a000-bf52c865316b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:54.871011 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e4ce3-2195-4ca5-a000-bf52c865316b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:54.882525 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 604/1231] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:07:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:07:54.888514 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67b264-e275-48e9-864b-47689727136c None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:54.953641 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:54.987747 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67b264-e275-48e9-864b-47689727136c None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:55.020469 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547e8a0-fde0-44c3-b051-557e50d9e51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:55.021234 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547e8a0-fde0-44c3-b051-557e50d9e51f None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:55.021519 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547e8a0-fde0-44c3-b051-557e50d9e51f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:55.021795 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547e8a0-fde0-44c3-b051-557e50d9e51f None admin] PATH_INFO: `/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/fda05b7b9675423e992470819d1c150a/roles/6540af5baf2c4ff78d0fedfc4bea4e46` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:55.036745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547e8a0-fde0-44c3-b051-557e50d9e51f None admin] RBAC: Authorizing `identity:create_grant(project_id=3747e176cdf2495d9b31a1afae618f68, user_id=fda05b7b9675423e992470819d1c150a, role_id=6540af5baf2c4ff78d0fedfc4bea4e46)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:55.038244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547e8a0-fde0-44c3-b051-557e50d9e51f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:55.119571 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 628/1232] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:07:54 2022] PUT /identity/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/fda05b7b9675423e992470819d1c150a/roles/6540af5baf2c4ff78d0fedfc4bea4e46 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:07:57.098508 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd2423-112e-4103-b8be-edd30190f910 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:57.099030 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd2423-112e-4103-b8be-edd30190f910 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:57.099030 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd2423-112e-4103-b8be-edd30190f910 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:57.100391 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 605/1233] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:07:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:07:57.105729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9434c10-2e5e-4f28-9b05-f2484ddadf74 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:57.106162 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9434c10-2e5e-4f28-9b05-f2484ddadf74 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:57.106280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9434c10-2e5e-4f28-9b05-f2484ddadf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:57.124755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a9434c10-2e5e-4f28-9b05-f2484ddadf74 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:07:57.125947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a9434c10-2e5e-4f28-9b05-f2484ddadf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:07:57.191413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 629/1234] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:07:57 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:07:57.214645 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd2423-112e-4103-b8be-edd30190f910 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:57.241292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:57.315678 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd2423-112e-4103-b8be-edd30190f910 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:57.347808 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaadf3b-2c9e-4fdd-9c37-0a87ce006493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:57.348433 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaadf3b-2c9e-4fdd-9c37-0a87ce006493 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:57.349414 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaadf3b-2c9e-4fdd-9c37-0a87ce006493 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:57.349414 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaadf3b-2c9e-4fdd-9c37-0a87ce006493 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:57.359269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaadf3b-2c9e-4fdd-9c37-0a87ce006493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:07:57.364056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-aeaadf3b-2c9e-4fdd-9c37-0a87ce006493 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:07:57.364056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:07:57.364056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:07:57.364056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:07:57.364056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:07:57.364056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:07:57.364056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:07:57.364056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:07:57.364056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:07:57.364056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:07:57.364056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:07:57.364056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:07:57.364056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:07:57.364056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:07:57.364056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:07:57.364056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:07:57.365178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:07:57.365178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:07:57.365178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:07:57.365178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:07:57.365178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:07:57.365178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:07:57.365178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:07:57.365178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:07:57.365178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:07:57.365178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:07:57.365178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:07:57.365178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:07:57.365178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:07:57.365178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:07:57.365178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:07:57.365178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:07:57.369762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:07:57.369762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:07:57.369762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:07:57.369762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:07:57.369762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:07:57.369762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:07:57.369762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:07:57.369762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:07:57.369762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:07:57.369762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:07:57.369762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 16:07:57.369762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:07:57.369762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 606/1235] 10.222.0.141 () {56 vars in 1107 bytes} [Tue Jul 26 16:07:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:07:57.371300 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9434c10-2e5e-4f28-9b05-f2484ddadf74 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:57.416390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:57.467193 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9434c10-2e5e-4f28-9b05-f2484ddadf74 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:57.500095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3557e-74c9-4791-bad2-0067aff5a542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:57.500728 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3557e-74c9-4791-bad2-0067aff5a542 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:57.501011 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3557e-74c9-4791-bad2-0067aff5a542 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:57.501288 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3557e-74c9-4791-bad2-0067aff5a542 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:57.501988 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3557e-74c9-4791-bad2-0067aff5a542 None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:07:57.502291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3557e-74c9-4791-bad2-0067aff5a542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:57.503648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3557e-74c9-4791-bad2-0067aff5a542 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:57.511140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 630/1236] 10.222.0.141 () {56 vars in 1108 bytes} [Tue Jul 26 16:07:57 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:07:57.517064 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaadf3b-2c9e-4fdd-9c37-0a87ce006493 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:57.598960 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:57.614726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaadf3b-2c9e-4fdd-9c37-0a87ce006493 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:57.646546 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49dbfa-b3c6-4c9d-8301-f741d0a34e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:57.647174 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49dbfa-b3c6-4c9d-8301-f741d0a34e2a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:57.647454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49dbfa-b3c6-4c9d-8301-f741d0a34e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:57.647771 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49dbfa-b3c6-4c9d-8301-f741d0a34e2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:57.658066 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49dbfa-b3c6-4c9d-8301-f741d0a34e2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:57.659505 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49dbfa-b3c6-4c9d-8301-f741d0a34e2a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:57.674484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-7b49dbfa-b3c6-4c9d-8301-f741d0a34e2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:07:57.674484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:07:57.674484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:07:57.674484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:07:57.674484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:07:57.674484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:07:57.674484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:07:57.674484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:07:57.674484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:07:57.674484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:07:57.674484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:07:57.674484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:07:57.674484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:07:57.674484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:07:57.674484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:07:57.675521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:07:57.675521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:07:57.675521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:07:57.675521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:07:57.675521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:07:57.675521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:07:57.675521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:07:57.675521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:07:57.675521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:07:57.675521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:07:57.675521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:07:57.675521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:07:57.675521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:07:57.675521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:07:57.675521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:07:57.675521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:07:57.675521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:07:57.676627 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:07:57.676627 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:07:57.676627 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:07:57.676627 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:07:57.676627 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 607/1237] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:07:57.681399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3557e-74c9-4791-bad2-0067aff5a542 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:57.780026 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3557e-74c9-4791-bad2-0067aff5a542 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:57.788737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:57.813888 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d8aa2-9f6f-4ca8-ac68-617400cd1ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:57.814505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d8aa2-9f6f-4ca8-ac68-617400cd1ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:57.814785 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d8aa2-9f6f-4ca8-ac68-617400cd1ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:57.815061 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d8aa2-9f6f-4ca8-ac68-617400cd1ed7 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:57.815743 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d8aa2-9f6f-4ca8-ac68-617400cd1ed7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:07:57.816049 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d8aa2-9f6f-4ca8-ac68-617400cd1ed7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:57.817491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d8aa2-9f6f-4ca8-ac68-617400cd1ed7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:57.829749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 631/1238] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:07:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:07:57.835453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49dbfa-b3c6-4c9d-8301-f741d0a34e2a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:57.935998 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49dbfa-b3c6-4c9d-8301-f741d0a34e2a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:57.969231 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1a095-bd85-43c6-965b-9ccaed1f0a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:57.969860 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1a095-bd85-43c6-965b-9ccaed1f0a06 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:57.970143 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1a095-bd85-43c6-965b-9ccaed1f0a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:57.970415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1a095-bd85-43c6-965b-9ccaed1f0a06 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:57.973099 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:57.978196 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1a095-bd85-43c6-965b-9ccaed1f0a06 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:57.979676 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1a095-bd85-43c6-965b-9ccaed1f0a06 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:57.992528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-86d1a095-bd85-43c6-965b-9ccaed1f0a06 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 16:07:57.992528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:07:57.992528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:07:57.992528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:07:57.992528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:07:57.992528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:07:57.992528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:07:57.992528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:07:57.992528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:07:57.992528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:07:57.992528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:07:57.992528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:07:57.992528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:07:57.992528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:07:57.992528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:07:57.992528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:07:57.995350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:07:57.995350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:07:57.995350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:07:57.995350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:07:57.995350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:07:57.995350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:07:57.995350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:07:57.995350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:07:57.995350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:07:57.995350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:07:57.995350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:07:57.995350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:07:57.995350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:07:57.995350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:07:57.995350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:07:57.995350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:07:57.995350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:07:57.995350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:07:57.996583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:07:57.996583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:07:57.996583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:07:57.996583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:07:57.996583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:07:57.996583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:07:57.996583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:07:57.996583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:07:57.996583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 16:07:57.996583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:07:57.996583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 608/1239] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:07:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:07:57.999537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d8aa2-9f6f-4ca8-ac68-617400cd1ed7 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:58.097792 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d8aa2-9f6f-4ca8-ac68-617400cd1ed7 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:58.132586 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a4c20-0850-4935-a471-daf1d27184ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:58.133387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a4c20-0850-4935-a471-daf1d27184ab None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:58.133558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a4c20-0850-4935-a471-daf1d27184ab None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:58.133811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a4c20-0850-4935-a471-daf1d27184ab None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:58.134596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a4c20-0850-4935-a471-daf1d27184ab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:07:58.134904 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a4c20-0850-4935-a471-daf1d27184ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:58.136320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a4c20-0850-4935-a471-daf1d27184ab None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:58.153051 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 632/1240] 10.222.0.141 () {56 vars in 1148 bytes} [Tue Jul 26 16:07:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:07:58.159360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1a095-bd85-43c6-965b-9ccaed1f0a06 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:58.256654 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1a095-bd85-43c6-965b-9ccaed1f0a06 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:58.289241 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f06bc-10e5-4e1a-a96c-02b41d02af5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:58.289850 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f06bc-10e5-4e1a-a96c-02b41d02af5c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:58.290132 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f06bc-10e5-4e1a-a96c-02b41d02af5c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:58.290402 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f06bc-10e5-4e1a-a96c-02b41d02af5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:58.350201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:58.356344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f06bc-10e5-4e1a-a96c-02b41d02af5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:58.357860 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f06bc-10e5-4e1a-a96c-02b41d02af5c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:58.453373 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 609/1241] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:07:58 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 16:07:58.459165 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a4c20-0850-4935-a471-daf1d27184ab None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:58.486401 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:58.556528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a4c20-0850-4935-a471-daf1d27184ab None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:58.588756 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bdd2e-0857-4afd-84e4-2a5d24894364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:58.589385 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bdd2e-0857-4afd-84e4-2a5d24894364 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:58.589662 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bdd2e-0857-4afd-84e4-2a5d24894364 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:58.589935 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bdd2e-0857-4afd-84e4-2a5d24894364 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:58.600114 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bdd2e-0857-4afd-84e4-2a5d24894364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:58.602203 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bdd2e-0857-4afd-84e4-2a5d24894364 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:58.617610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-974bdd2e-0857-4afd-84e4-2a5d24894364 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:07:58.617610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:07:58.617610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:07:58.617610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:07:58.617610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:07:58.617610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:07:58.617610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:07:58.617610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:07:58.617610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:07:58.617610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:07:58.617610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:07:58.617610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:07:58.617610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:07:58.617610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:07:58.617610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:07:58.618648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:07:58.618648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:07:58.618648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:07:58.618648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:07:58.618648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:07:58.618648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:07:58.618648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:07:58.618648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:07:58.618648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:07:58.618648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:07:58.618648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:07:58.618648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:07:58.618648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:07:58.618648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:07:58.618648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:07:58.618648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:07:58.618648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:07:58.619735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:07:58.619735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:07:58.619735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:07:58.619735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:07:58.619735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 633/1242] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:07:58.624619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f06bc-10e5-4e1a-a96c-02b41d02af5c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:58.717358 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:58.722951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f06bc-10e5-4e1a-a96c-02b41d02af5c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:58.756007 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603a501-bf2d-4748-878b-13c4d19e3c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:58.756616 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603a501-bf2d-4748-878b-13c4d19e3c6f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:58.756928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603a501-bf2d-4748-878b-13c4d19e3c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:58.757204 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603a501-bf2d-4748-878b-13c4d19e3c6f None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:58.757887 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603a501-bf2d-4748-878b-13c4d19e3c6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:07:58.758191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603a501-bf2d-4748-878b-13c4d19e3c6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:58.759620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603a501-bf2d-4748-878b-13c4d19e3c6f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:58.770401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 610/1243] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:07:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:07:58.776189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bdd2e-0857-4afd-84e4-2a5d24894364 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:58.855286 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:07:58.876246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bdd2e-0857-4afd-84e4-2a5d24894364 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:58.908887 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fca0e-0150-4c2d-8caa-d8248218ae06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:58.909539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fca0e-0150-4c2d-8caa-d8248218ae06 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:58.909874 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fca0e-0150-4c2d-8caa-d8248218ae06 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:58.910148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fca0e-0150-4c2d-8caa-d8248218ae06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:58.916774 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909fca0e-0150-4c2d-8caa-d8248218ae06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:58.918359 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909fca0e-0150-4c2d-8caa-d8248218ae06 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:58.930820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-909fca0e-0150-4c2d-8caa-d8248218ae06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:07:58.930820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:07:58.930820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:07:58.930820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:07:58.930820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:07:58.930820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:07:58.930820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:07:58.930820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:07:58.930820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:07:58.930820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:07:58.930820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:07:58.930820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:07:58.930820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:07:58.930820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:07:58.930820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:07:58.931870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:07:58.931870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:07:58.931870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:07:58.931870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:07:58.931870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:07:58.931870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:07:58.931870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:07:58.931870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:07:58.931870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:07:58.931870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:07:58.931870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:07:58.931870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:07:58.931870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:07:58.931870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:07:58.931870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:07:58.931870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:07:58.931870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:07:58.933596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:07:58.933596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:07:58.933596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:07:58.933596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:07:58.933596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:07:58.933596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:07:58.933596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:07:58.933596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:07:58.933596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 634/1244] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:07:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:07:58.937869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603a501-bf2d-4748-878b-13c4d19e3c6f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:59.036280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603a501-bf2d-4748-878b-13c4d19e3c6f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:59.069084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d29493-df86-42dd-a479-73306bde592d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:59.069692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d29493-df86-42dd-a479-73306bde592d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:59.069971 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d29493-df86-42dd-a479-73306bde592d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:59.070246 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d29493-df86-42dd-a479-73306bde592d None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:59.070981 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d29493-df86-42dd-a479-73306bde592d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:07:59.071287 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d29493-df86-42dd-a479-73306bde592d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:59.073023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d29493-df86-42dd-a479-73306bde592d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:59.085080 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 611/1245] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:07:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:07:59.091137 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fca0e-0150-4c2d-8caa-d8248218ae06 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:07:59.191368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fca0e-0150-4c2d-8caa-d8248218ae06 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:07:59.224769 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8c12d-f6a1-4c07-966f-d765b8d3782a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:07:59.225374 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8c12d-f6a1-4c07-966f-d765b8d3782a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:07:59.225653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8c12d-f6a1-4c07-966f-d765b8d3782a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:07:59.225923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8c12d-f6a1-4c07-966f-d765b8d3782a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:07:59.226699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8c12d-f6a1-4c07-966f-d765b8d3782a None admin] RBAC: Adding query filter params (role.id=6540af5baf2c4ff78d0fedfc4bea4e46, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=fda05b7b9675423e992470819d1c150a) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:07:59.227005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8c12d-f6a1-4c07-966f-d765b8d3782a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:07:59.228430 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8c12d-f6a1-4c07-966f-d765b8d3782a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:07:59.234078 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 635/1246] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:07:59 2022] GET /identity/v3/role_assignments?user.id=fda05b7b9675423e992470819d1c150a&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=6540af5baf2c4ff78d0fedfc4bea4e46 => generated 610 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:01.278322 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbe06d-5e03-4e94-b1ef-75380ca60eb2 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:01.278873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbe06d-5e03-4e94-b1ef-75380ca60eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:01.278873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbe06d-5e03-4e94-b1ef-75380ca60eb2 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:01.280893 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 612/1247] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:08:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:08:01.286047 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c593e-e301-4dcb-b32c-0acb519af740 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:01.286533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c593e-e301-4dcb-b32c-0acb519af740 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:01.286627 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c593e-e301-4dcb-b32c-0acb519af740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:01.292894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:01.306591 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-702c593e-e301-4dcb-b32c-0acb519af740 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:08:01.307800 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-702c593e-e301-4dcb-b32c-0acb519af740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:08:01.376976 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 636/1248] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:08:01 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:08:01.400129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbe06d-5e03-4e94-b1ef-75380ca60eb2 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:01.418554 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:01.498982 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbe06d-5e03-4e94-b1ef-75380ca60eb2 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:01.533001 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341eaf4-5a1b-4107-b5da-ad61da778fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:01.533571 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341eaf4-5a1b-4107-b5da-ad61da778fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:01.533944 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341eaf4-5a1b-4107-b5da-ad61da778fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:01.534181 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341eaf4-5a1b-4107-b5da-ad61da778fa2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:01.544551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341eaf4-5a1b-4107-b5da-ad61da778fa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:08:01.549763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-6341eaf4-5a1b-4107-b5da-ad61da778fa2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:08:01.549763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:08:01.549763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:08:01.549763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:08:01.549763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:08:01.549763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:08:01.549763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:08:01.549763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:08:01.549763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:08:01.549763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:08:01.549763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:08:01.549763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:08:01.549763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:08:01.549763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:08:01.549763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:08:01.549763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:08:01.550984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:08:01.550984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:08:01.550984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:08:01.550984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:08:01.550984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:08:01.550984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:08:01.550984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:08:01.550984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:08:01.550984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:08:01.550984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:08:01.550984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:08:01.550984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:08:01.550984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:08:01.550984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:08:01.550984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:08:01.550984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:08:01.552095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:08:01.552095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:08:01.552095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:08:01.552095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:08:01.552095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:08:01.552095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:08:01.552095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:08:01.552095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:08:01.552095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:08:01.552095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:08:01.552095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:08:01.552095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:08:01.552095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 613/1249] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:08:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:08:01.557049 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c593e-e301-4dcb-b32c-0acb519af740 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:01.654742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c593e-e301-4dcb-b32c-0acb519af740 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:01.684471 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:01.689858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef257a9-2c66-4669-a8c8-e7cc1f45e758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:01.690473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef257a9-2c66-4669-a8c8-e7cc1f45e758 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:01.690752 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef257a9-2c66-4669-a8c8-e7cc1f45e758 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:01.691027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef257a9-2c66-4669-a8c8-e7cc1f45e758 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:01.691732 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef257a9-2c66-4669-a8c8-e7cc1f45e758 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:01.692033 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef257a9-2c66-4669-a8c8-e7cc1f45e758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:01.693472 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef257a9-2c66-4669-a8c8-e7cc1f45e758 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:01.701235 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 637/1250] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:08:01 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:01.707055 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341eaf4-5a1b-4107-b5da-ad61da778fa2 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:01.783068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:01.805592 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341eaf4-5a1b-4107-b5da-ad61da778fa2 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:01.836986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aebdfa-4aed-449a-a075-1c29b4c7124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:01.837671 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aebdfa-4aed-449a-a075-1c29b4c7124f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:01.837894 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aebdfa-4aed-449a-a075-1c29b4c7124f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:01.838175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aebdfa-4aed-449a-a075-1c29b4c7124f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:01.848653 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aebdfa-4aed-449a-a075-1c29b4c7124f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:01.850127 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aebdfa-4aed-449a-a075-1c29b4c7124f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:01.865191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-91aebdfa-4aed-449a-a075-1c29b4c7124f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:08:01.865191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:08:01.865191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:08:01.865191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:08:01.865191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:08:01.865191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:08:01.865191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:08:01.865191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:08:01.865191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:08:01.865191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:08:01.865191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:08:01.865191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:08:01.865191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:08:01.865191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:08:01.865191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:08:01.866293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:08:01.866293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:08:01.866293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:08:01.866293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:08:01.866293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:08:01.866293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:08:01.866293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:08:01.866293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:08:01.866293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:08:01.866293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:08:01.866293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:08:01.866293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:08:01.866293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:08:01.866293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:08:01.866293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:08:01.866293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:08:01.866293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:08:01.867547 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:08:01.867547 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:08:01.867547 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:08:01.867547 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:08:01.867547 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 614/1251] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:08:01.872142 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef257a9-2c66-4669-a8c8-e7cc1f45e758 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:01.971862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef257a9-2c66-4669-a8c8-e7cc1f45e758 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:02.005140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026c843-fc10-4b2b-954b-5a869e859840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:02.005769 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026c843-fc10-4b2b-954b-5a869e859840 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:02.006127 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026c843-fc10-4b2b-954b-5a869e859840 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:02.013871 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026c843-fc10-4b2b-954b-5a869e859840 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:02.013871 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026c843-fc10-4b2b-954b-5a869e859840 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:02.013871 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026c843-fc10-4b2b-954b-5a869e859840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:02.013871 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026c843-fc10-4b2b-954b-5a869e859840 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:02.020578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 638/1252] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:08:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:08:02.026300 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aebdfa-4aed-449a-a075-1c29b4c7124f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:02.123555 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aebdfa-4aed-449a-a075-1c29b4c7124f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:02.149918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:02.157681 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5115457-d15a-41d7-9e2c-75d77bb26a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:02.158307 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5115457-d15a-41d7-9e2c-75d77bb26a32 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:02.158590 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5115457-d15a-41d7-9e2c-75d77bb26a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:02.158865 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5115457-d15a-41d7-9e2c-75d77bb26a32 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:02.166147 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5115457-d15a-41d7-9e2c-75d77bb26a32 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:02.167575 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5115457-d15a-41d7-9e2c-75d77bb26a32 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:02.179751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-e5115457-d15a-41d7-9e2c-75d77bb26a32 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 16:08:02.179751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:08:02.179751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:08:02.179751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:08:02.179751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:08:02.179751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:08:02.179751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:08:02.179751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:08:02.179751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:08:02.179751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:08:02.179751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:08:02.179751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:08:02.179751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:08:02.179751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:08:02.179751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:08:02.179751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:08:02.184912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:08:02.184912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:08:02.184912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:08:02.184912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:08:02.184912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:08:02.184912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:08:02.184912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:08:02.184912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:08:02.184912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:08:02.184912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:08:02.184912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:08:02.184912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:08:02.184912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:08:02.184912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:08:02.184912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:08:02.184912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:08:02.184912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:08:02.184912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:08:02.186052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:08:02.186052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:08:02.186052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:08:02.186052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:08:02.186052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:08:02.186052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:08:02.186052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:08:02.186052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:08:02.186052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 16:08:02.186052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:08:02.186052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 615/1253] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:08:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:08:02.187337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026c843-fc10-4b2b-954b-5a869e859840 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:02.241808 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:02.285751 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026c843-fc10-4b2b-954b-5a869e859840 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:02.319606 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f6b61-14d2-44ee-ba43-da3024451642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:02.330603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f6b61-14d2-44ee-ba43-da3024451642 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:02.330603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f6b61-14d2-44ee-ba43-da3024451642 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:02.330603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f6b61-14d2-44ee-ba43-da3024451642 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:02.330603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f6b61-14d2-44ee-ba43-da3024451642 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:02.330603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f6b61-14d2-44ee-ba43-da3024451642 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:02.330603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f6b61-14d2-44ee-ba43-da3024451642 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:02.339608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 639/1254] 10.222.0.141 () {56 vars in 1148 bytes} [Tue Jul 26 16:08:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:02.345443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5115457-d15a-41d7-9e2c-75d77bb26a32 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:02.443201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5115457-d15a-41d7-9e2c-75d77bb26a32 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:02.475973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44df283-fab1-4982-8790-0e861d468b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:02.476582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44df283-fab1-4982-8790-0e861d468b12 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:02.476895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44df283-fab1-4982-8790-0e861d468b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:02.477173 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44df283-fab1-4982-8790-0e861d468b12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:02.531385 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:02.543106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44df283-fab1-4982-8790-0e861d468b12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:02.544561 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44df283-fab1-4982-8790-0e861d468b12 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:02.640656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 616/1255] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:08:02 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 16:08:02.646542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f6b61-14d2-44ee-ba43-da3024451642 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:02.747496 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f6b61-14d2-44ee-ba43-da3024451642 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:02.759223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:02.779470 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40502e3f-43f2-4f6e-bd77-f1cd15f8d3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:02.780690 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40502e3f-43f2-4f6e-bd77-f1cd15f8d3bc None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:02.780964 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40502e3f-43f2-4f6e-bd77-f1cd15f8d3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:02.781239 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40502e3f-43f2-4f6e-bd77-f1cd15f8d3bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:02.790991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40502e3f-43f2-4f6e-bd77-f1cd15f8d3bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:02.799121 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40502e3f-43f2-4f6e-bd77-f1cd15f8d3bc None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:02.808343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-40502e3f-43f2-4f6e-bd77-f1cd15f8d3bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:08:02.808343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:08:02.808343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:08:02.808343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:08:02.808343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:08:02.808343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:08:02.808343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:08:02.808343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:08:02.808343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:08:02.808343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:08:02.808343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:08:02.808343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:08:02.808343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:08:02.808343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:08:02.808343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:08:02.809424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:08:02.809424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:08:02.809424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:08:02.809424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:08:02.809424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:08:02.809424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:08:02.809424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:08:02.809424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:08:02.809424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:08:02.809424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:08:02.809424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:08:02.809424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:08:02.809424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:08:02.809424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:08:02.809424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:08:02.809424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:08:02.809424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:08:02.810553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:08:02.810553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:08:02.810553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:08:02.810553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:08:02.810553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 640/1256] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:08:02.815394 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44df283-fab1-4982-8790-0e861d468b12 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:02.900645 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:02.912810 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44df283-fab1-4982-8790-0e861d468b12 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:02.946417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324be64-4429-4fbc-9215-61b2fc86488c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:02.947026 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324be64-4429-4fbc-9215-61b2fc86488c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:02.947303 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324be64-4429-4fbc-9215-61b2fc86488c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:02.947572 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324be64-4429-4fbc-9215-61b2fc86488c None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:02.948305 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324be64-4429-4fbc-9215-61b2fc86488c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:02.948605 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324be64-4429-4fbc-9215-61b2fc86488c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:02.950033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324be64-4429-4fbc-9215-61b2fc86488c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:02.961422 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 617/1257] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:08:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:02.967271 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40502e3f-43f2-4f6e-bd77-f1cd15f8d3bc None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:03.067241 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40502e3f-43f2-4f6e-bd77-f1cd15f8d3bc None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:03.100974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66702ec-4593-488e-80b1-8aa2af4114cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:03.101616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66702ec-4593-488e-80b1-8aa2af4114cc None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:03.101899 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66702ec-4593-488e-80b1-8aa2af4114cc None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:03.102174 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66702ec-4593-488e-80b1-8aa2af4114cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:03.108722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66702ec-4593-488e-80b1-8aa2af4114cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:03.110160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66702ec-4593-488e-80b1-8aa2af4114cc None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:03.121323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-e66702ec-4593-488e-80b1-8aa2af4114cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:08:03.121323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:08:03.121323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:08:03.121323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:08:03.121323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:08:03.121323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:08:03.121323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:08:03.121323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:08:03.121323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:08:03.121323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:08:03.121323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:08:03.121323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:08:03.121323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:08:03.121323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:08:03.121323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:08:03.122412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:08:03.122412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:08:03.122412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:08:03.122412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:08:03.122412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:08:03.122412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:08:03.122412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:08:03.122412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:08:03.122412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:08:03.122412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:08:03.122412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:08:03.122412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:08:03.122412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:08:03.122412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:08:03.122412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:08:03.122412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:08:03.122412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:08:03.123713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:08:03.123713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:08:03.123713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:08:03.123713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:08:03.123713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:08:03.123713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:08:03.123713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:08:03.123713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:08:03.123713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 641/1258] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:08:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:08:03.128296 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324be64-4429-4fbc-9215-61b2fc86488c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:03.226296 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324be64-4429-4fbc-9215-61b2fc86488c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:03.259519 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f133a-ec58-4b3a-962c-2aa1df3b9f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:03.260127 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f133a-ec58-4b3a-962c-2aa1df3b9f7d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:03.260424 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f133a-ec58-4b3a-962c-2aa1df3b9f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:03.260727 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f133a-ec58-4b3a-962c-2aa1df3b9f7d None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:03.261471 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f133a-ec58-4b3a-962c-2aa1df3b9f7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:03.261780 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f133a-ec58-4b3a-962c-2aa1df3b9f7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:03.263287 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f133a-ec58-4b3a-962c-2aa1df3b9f7d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:03.275089 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 618/1259] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:08:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:03.281812 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66702ec-4593-488e-80b1-8aa2af4114cc None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:03.307879 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:03.379365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66702ec-4593-488e-80b1-8aa2af4114cc None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:03.412493 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757dc130-6f27-4dae-a0ef-1f060e644933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:03.413131 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dc130-6f27-4dae-a0ef-1f060e644933 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:03.413410 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dc130-6f27-4dae-a0ef-1f060e644933 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:03.413682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dc130-6f27-4dae-a0ef-1f060e644933 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:03.414455 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757dc130-6f27-4dae-a0ef-1f060e644933 None admin] RBAC: Adding query filter params (role.id=94ecbd6c86a84b75bdb0c57fc27a9a07, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=fda05b7b9675423e992470819d1c150a) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:03.414776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757dc130-6f27-4dae-a0ef-1f060e644933 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:03.416164 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757dc130-6f27-4dae-a0ef-1f060e644933 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:03.423212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 642/1260] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:08:03 2022] GET /identity/v3/role_assignments?user.id=fda05b7b9675423e992470819d1c150a&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 260 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:05.409755 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6e70c-da03-4c59-8326-b0ebca9c4d03 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:05.410318 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6e70c-da03-4c59-8326-b0ebca9c4d03 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:05.410318 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6e70c-da03-4c59-8326-b0ebca9c4d03 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:05.411698 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 619/1261] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:08:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:08:05.417061 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea139c3-167b-4657-9840-fd8ce447cf7c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:05.417463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea139c3-167b-4657-9840-fd8ce447cf7c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:05.417615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea139c3-167b-4657-9840-fd8ce447cf7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:05.437023 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6ea139c3-167b-4657-9840-fd8ce447cf7c None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:08:05.438223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6ea139c3-167b-4657-9840-fd8ce447cf7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:08:05.504413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 643/1262] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:08:05 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:08:05.526842 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6e70c-da03-4c59-8326-b0ebca9c4d03 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:05.538338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:05.628344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6e70c-da03-4c59-8326-b0ebca9c4d03 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:05.661642 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ddb5b-a16a-40f6-968b-cbf9402f5094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:05.662266 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ddb5b-a16a-40f6-968b-cbf9402f5094 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:05.662552 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ddb5b-a16a-40f6-968b-cbf9402f5094 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:05.662830 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ddb5b-a16a-40f6-968b-cbf9402f5094 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:05.673798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ddb5b-a16a-40f6-968b-cbf9402f5094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:08:05.678723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-f10ddb5b-a16a-40f6-968b-cbf9402f5094 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:08:05.678723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:08:05.678723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:08:05.678723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:08:05.678723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:08:05.678723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:08:05.678723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:08:05.678723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:08:05.678723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:08:05.678723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:08:05.678723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:08:05.678723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:08:05.678723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:08:05.678723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:08:05.678723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:08:05.678723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:08:05.679814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:08:05.679814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:08:05.679814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:08:05.679814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:08:05.679814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:08:05.679814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:08:05.679814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:08:05.679814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:08:05.679814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:08:05.679814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:08:05.679814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:08:05.679814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:08:05.679814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:08:05.679814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:08:05.679814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:08:05.679814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:08:05.681033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:08:05.681033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:08:05.681033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:08:05.681033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:08:05.681033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:08:05.681033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:08:05.681033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:08:05.681033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:08:05.681033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:08:05.681033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:08:05.681033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:08:05.681033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:08:05.681033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 620/1263] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:08:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:08:05.686098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea139c3-167b-4657-9840-fd8ce447cf7c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:05.704456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:05.783427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea139c3-167b-4657-9840-fd8ce447cf7c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:05.817033 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81323a24-b5e8-47a5-976d-43891359835a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:05.817860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81323a24-b5e8-47a5-976d-43891359835a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:05.818744 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81323a24-b5e8-47a5-976d-43891359835a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:05.819019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81323a24-b5e8-47a5-976d-43891359835a None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:05.819723 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81323a24-b5e8-47a5-976d-43891359835a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:05.820025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81323a24-b5e8-47a5-976d-43891359835a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:05.821560 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81323a24-b5e8-47a5-976d-43891359835a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:05.829447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 644/1264] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:08:05 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:05.835234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ddb5b-a16a-40f6-968b-cbf9402f5094 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:05.900853 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:05.936604 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ddb5b-a16a-40f6-968b-cbf9402f5094 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:05.971083 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d73d06-1395-4933-93ef-9943907fddc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:05.971718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d73d06-1395-4933-93ef-9943907fddc2 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:05.972004 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d73d06-1395-4933-93ef-9943907fddc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:05.972367 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d73d06-1395-4933-93ef-9943907fddc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:05.982296 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d73d06-1395-4933-93ef-9943907fddc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:05.983762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d73d06-1395-4933-93ef-9943907fddc2 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:05.999129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-14d73d06-1395-4933-93ef-9943907fddc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:08:05.999129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:08:05.999129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:08:05.999129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:08:05.999129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:08:05.999129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:08:05.999129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:08:05.999129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:08:05.999129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:08:05.999129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:08:05.999129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:08:05.999129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:08:05.999129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:08:05.999129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:08:05.999129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:08:06.000172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:08:06.000172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:08:06.000172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:08:06.000172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:08:06.000172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:08:06.000172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:08:06.000172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:08:06.000172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:08:06.000172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:08:06.000172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:08:06.000172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:08:06.000172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:08:06.000172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:08:06.000172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:08:06.000172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:08:06.000172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:08:06.000172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:08:06.001139 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:08:06.001139 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:08:06.001139 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:08:06.001139 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:08:06.001139 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 621/1265] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:08:06.006283 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81323a24-b5e8-47a5-976d-43891359835a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:06.087021 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:06.105684 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81323a24-b5e8-47a5-976d-43891359835a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:06.138307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b2164-0b3c-43fe-8dbf-e7667b02cbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:06.138916 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b2164-0b3c-43fe-8dbf-e7667b02cbd9 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:06.139195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b2164-0b3c-43fe-8dbf-e7667b02cbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:06.139984 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b2164-0b3c-43fe-8dbf-e7667b02cbd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:06.140687 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b2164-0b3c-43fe-8dbf-e7667b02cbd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:06.140997 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b2164-0b3c-43fe-8dbf-e7667b02cbd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:06.142351 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b2164-0b3c-43fe-8dbf-e7667b02cbd9 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:06.155633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 645/1266] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:08:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:06.161243 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d73d06-1395-4933-93ef-9943907fddc2 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:06.262773 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d73d06-1395-4933-93ef-9943907fddc2 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:06.281813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:06.294942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b83dd-b52f-469c-81c4-d1dc78a6b150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:06.296356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b83dd-b52f-469c-81c4-d1dc78a6b150 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:06.296686 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b83dd-b52f-469c-81c4-d1dc78a6b150 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:06.296974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b83dd-b52f-469c-81c4-d1dc78a6b150 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:06.304175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b83dd-b52f-469c-81c4-d1dc78a6b150 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:06.317614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b83dd-b52f-469c-81c4-d1dc78a6b150 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:06.317614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-de0b83dd-b52f-469c-81c4-d1dc78a6b150 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 16:08:06.317614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:08:06.317614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:08:06.317614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:08:06.317614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:08:06.317614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:08:06.317614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:08:06.317614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:08:06.317614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:08:06.317614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:08:06.317614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:08:06.317614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:08:06.317614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:08:06.318633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:08:06.318633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:08:06.318633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:08:06.318633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:08:06.318633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:08:06.318633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:08:06.318633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:08:06.318633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:08:06.318633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:08:06.318633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:08:06.318633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:08:06.318633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:08:06.318633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:08:06.318633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:08:06.318633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:08:06.318633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:08:06.318633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:08:06.318633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:08:06.319564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:08:06.319564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:08:06.319564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:08:06.319564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:08:06.319564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:08:06.319564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:08:06.319564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:08:06.319564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:08:06.319564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:08:06.319564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:08:06.319564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:08:06.319564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 16:08:06.319564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:08:06.319564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 622/1267] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:08:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:08:06.323344 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b2164-0b3c-43fe-8dbf-e7667b02cbd9 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:06.422807 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b2164-0b3c-43fe-8dbf-e7667b02cbd9 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:06.455995 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d57b62-4b74-49ee-a1ab-2ef83684ad27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:06.456615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d57b62-4b74-49ee-a1ab-2ef83684ad27 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:06.456926 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d57b62-4b74-49ee-a1ab-2ef83684ad27 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:06.457205 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d57b62-4b74-49ee-a1ab-2ef83684ad27 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:06.457987 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d57b62-4b74-49ee-a1ab-2ef83684ad27 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:06.458296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d57b62-4b74-49ee-a1ab-2ef83684ad27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:06.459731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d57b62-4b74-49ee-a1ab-2ef83684ad27 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:06.468879 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:06.477188 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 646/1268] 10.222.0.141 () {56 vars in 1148 bytes} [Tue Jul 26 16:08:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:06.482888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b83dd-b52f-469c-81c4-d1dc78a6b150 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:06.581072 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b83dd-b52f-469c-81c4-d1dc78a6b150 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:06.615894 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0381ecb-1120-47c8-b4ad-8a97881719a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:06.616552 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0381ecb-1120-47c8-b4ad-8a97881719a3 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:06.616866 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0381ecb-1120-47c8-b4ad-8a97881719a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:06.617144 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0381ecb-1120-47c8-b4ad-8a97881719a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:06.627462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0381ecb-1120-47c8-b4ad-8a97881719a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:06.628947 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0381ecb-1120-47c8-b4ad-8a97881719a3 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:06.642979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-a0381ecb-1120-47c8-b4ad-8a97881719a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:08:06.642979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:08:06.642979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:08:06.642979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:08:06.642979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:08:06.642979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:08:06.642979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:08:06.642979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:08:06.642979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:08:06.642979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:08:06.642979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:08:06.642979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:08:06.642979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:08:06.642979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:08:06.642979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:08:06.644044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:08:06.644044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:08:06.644044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:08:06.644044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:08:06.644044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:08:06.644044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:08:06.644044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:08:06.644044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:08:06.644044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:08:06.644044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:08:06.644044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:08:06.644044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:08:06.644044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:08:06.644044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:08:06.644044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:08:06.644044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:08:06.644044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:08:06.645063 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:08:06.645063 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:08:06.645063 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:08:06.645063 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:08:06.645063 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 623/1269] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:08:06.649865 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d57b62-4b74-49ee-a1ab-2ef83684ad27 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:06.752216 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d57b62-4b74-49ee-a1ab-2ef83684ad27 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:06.786177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c137a9-819c-4eb2-bd28-0456d77a35d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:06.786783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c137a9-819c-4eb2-bd28-0456d77a35d5 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:06.787060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c137a9-819c-4eb2-bd28-0456d77a35d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:06.787328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c137a9-819c-4eb2-bd28-0456d77a35d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:06.788032 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c137a9-819c-4eb2-bd28-0456d77a35d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:06.788330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c137a9-819c-4eb2-bd28-0456d77a35d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:06.789707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c137a9-819c-4eb2-bd28-0456d77a35d5 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:06.800843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 647/1270] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:08:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:06.806783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0381ecb-1120-47c8-b4ad-8a97881719a3 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:06.840778 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:06.907564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0381ecb-1120-47c8-b4ad-8a97881719a3 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:06.941226 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e049b36-d449-49b4-9b11-0e7be352682e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:06.941900 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e049b36-d449-49b4-9b11-0e7be352682e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:06.942195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e049b36-d449-49b4-9b11-0e7be352682e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:06.942472 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e049b36-d449-49b4-9b11-0e7be352682e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:06.949005 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e049b36-d449-49b4-9b11-0e7be352682e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:06.950447 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e049b36-d449-49b4-9b11-0e7be352682e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:06.962928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-0e049b36-d449-49b4-9b11-0e7be352682e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:08:06.962928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:08:06.962928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:08:06.962928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:08:06.962928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:08:06.962928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:08:06.962928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:08:06.962928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:08:06.962928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:08:06.962928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:08:06.962928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:08:06.962928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:08:06.962928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:08:06.962928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:08:06.962928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:08:06.965502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:08:06.965502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:08:06.965502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:08:06.965502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:08:06.965502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:08:06.965502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:08:06.965502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:08:06.965502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:08:06.965502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:08:06.965502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:08:06.965502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:08:06.965502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:08:06.965502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:08:06.965502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:08:06.965502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:08:06.965502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:08:06.965502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:08:06.966614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:08:06.966614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:08:06.966614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:08:06.966614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:08:06.966614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:08:06.966614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:08:06.966614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:08:06.966614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:08:06.966614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 624/1271] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:08:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:08:06.970597 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c137a9-819c-4eb2-bd28-0456d77a35d5 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:07.027852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:07.068455 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c137a9-819c-4eb2-bd28-0456d77a35d5 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:07.102450 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e90a3-5af8-4886-9595-766e9900be02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:07.103049 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e90a3-5af8-4886-9595-766e9900be02 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:07.103338 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e90a3-5af8-4886-9595-766e9900be02 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:07.103613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e90a3-5af8-4886-9595-766e9900be02 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:07.104372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e90a3-5af8-4886-9595-766e9900be02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:07.104697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e90a3-5af8-4886-9595-766e9900be02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:07.106134 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e90a3-5af8-4886-9595-766e9900be02 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:07.118571 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 648/1272] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:08:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:07.125106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e049b36-d449-49b4-9b11-0e7be352682e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:07.215444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:07.223861 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e049b36-d449-49b4-9b11-0e7be352682e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:07.259543 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc46d50-a52a-49c7-bb07-1ac080979527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:07.260201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc46d50-a52a-49c7-bb07-1ac080979527 None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:07.260483 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc46d50-a52a-49c7-bb07-1ac080979527 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:07.260783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc46d50-a52a-49c7-bb07-1ac080979527 None admin] PATH_INFO: `/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/fda05b7b9675423e992470819d1c150a/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:07.262739 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc46d50-a52a-49c7-bb07-1ac080979527 None admin] RBAC: Authorizing `identity:create_grant(project_id=3747e176cdf2495d9b31a1afae618f68, user_id=fda05b7b9675423e992470819d1c150a, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:07.269235 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc46d50-a52a-49c7-bb07-1ac080979527 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:07.366059 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 625/1273] 10.222.0.141 () {58 vars in 1444 bytes} [Tue Jul 26 16:08:07 2022] PUT /identity/v3/projects/3747e176cdf2495d9b31a1afae618f68/users/fda05b7b9675423e992470819d1c150a/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:08:09.356350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62644e2-f2bd-4fc9-a174-76e46a4b85bb None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:09.356973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62644e2-f2bd-4fc9-a174-76e46a4b85bb None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:09.356973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62644e2-f2bd-4fc9-a174-76e46a4b85bb None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:09.358919 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 649/1274] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:08:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:08:09.364142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191f439-07c2-4223-b89f-55e154e2e7d0 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:09.364525 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191f439-07c2-4223-b89f-55e154e2e7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:09.364726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191f439-07c2-4223-b89f-55e154e2e7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:09.382377 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b191f439-07c2-4223-b89f-55e154e2e7d0 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:08:09.383565 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b191f439-07c2-4223-b89f-55e154e2e7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:08:09.449009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 626/1275] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:08:09 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:08:09.472234 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62644e2-f2bd-4fc9-a174-76e46a4b85bb None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:09.572894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62644e2-f2bd-4fc9-a174-76e46a4b85bb None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:09.589872 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:09.606653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ba847-7987-48f5-a078-1b449a6983d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:09.607228 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ba847-7987-48f5-a078-1b449a6983d7 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:09.607509 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ba847-7987-48f5-a078-1b449a6983d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:09.607780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ba847-7987-48f5-a078-1b449a6983d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:09.618811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ba847-7987-48f5-a078-1b449a6983d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 16:08:09.623735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-e00ba847-7987-48f5-a078-1b449a6983d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:08:09.623735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:08:09.623735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:08:09.623735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:08:09.623735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:08:09.623735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:08:09.623735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:08:09.623735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:08:09.623735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:08:09.623735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:08:09.623735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:08:09.623735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:08:09.623735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 16:08:09.623735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 16:08:09.623735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 16:08:09.623735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 16:08:09.624833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 16:08:09.624833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 16:08:09.624833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 16:08:09.624833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 16:08:09.624833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:08:09.624833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:08:09.624833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:08:09.624833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:08:09.624833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:08:09.624833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:08:09.624833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:08:09.624833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:08:09.624833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:08:09.624833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:08:09.624833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:08:09.624833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:08:09.625734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:08:09.625734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:08:09.625734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:08:09.625734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:08:09.625734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 16:08:09.625734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 16:08:09.625734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 16:08:09.625734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 16:08:09.625734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 16:08:09.625734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 16:08:09.625734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 16:08:09.625734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:08:09.625734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 650/1276] 10.222.0.141 () {56 vars in 1101 bytes} [Tue Jul 26 16:08:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:08:09.630973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191f439-07c2-4223-b89f-55e154e2e7d0 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:09.711651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:09.729056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191f439-07c2-4223-b89f-55e154e2e7d0 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:09.760895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728187b8-ffbc-44b2-9c4e-ac4c102387fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:09.761508 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728187b8-ffbc-44b2-9c4e-ac4c102387fe None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:09.761789 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728187b8-ffbc-44b2-9c4e-ac4c102387fe None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:09.762063 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728187b8-ffbc-44b2-9c4e-ac4c102387fe None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:09.762766 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728187b8-ffbc-44b2-9c4e-ac4c102387fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:09.763071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728187b8-ffbc-44b2-9c4e-ac4c102387fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:09.764993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728187b8-ffbc-44b2-9c4e-ac4c102387fe None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:09.772703 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 627/1277] 10.222.0.141 () {56 vars in 1104 bytes} [Tue Jul 26 16:08:09 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:09.778686 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ba847-7987-48f5-a078-1b449a6983d7 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:09.881099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ba847-7987-48f5-a078-1b449a6983d7 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:09.913772 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655b79a-8ec1-44db-918f-fe29f3a1c0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:09.914404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655b79a-8ec1-44db-918f-fe29f3a1c0fe None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:09.914711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655b79a-8ec1-44db-918f-fe29f3a1c0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:09.914989 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655b79a-8ec1-44db-918f-fe29f3a1c0fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:09.925983 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655b79a-8ec1-44db-918f-fe29f3a1c0fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:09.927430 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655b79a-8ec1-44db-918f-fe29f3a1c0fe None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:09.942764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-7655b79a-8ec1-44db-918f-fe29f3a1c0fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:08:09.942764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:08:09.942764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:08:09.942764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:08:09.942764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:08:09.942764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:08:09.942764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:08:09.942764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:08:09.942764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:08:09.942764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:08:09.942764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:08:09.942764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:08:09.942764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:08:09.942764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:08:09.942764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:08:09.943797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:08:09.943797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:08:09.943797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:08:09.943797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:08:09.943797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:08:09.943797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:08:09.943797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:08:09.943797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:08:09.943797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:08:09.943797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:08:09.943797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:08:09.943797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:08:09.943797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:08:09.943797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:08:09.943797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:08:09.943797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:08:09.943797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:08:09.944793 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:08:09.944793 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:08:09.944793 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:08:09.944793 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:08:09.944793 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 651/1278] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:08:09.949831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728187b8-ffbc-44b2-9c4e-ac4c102387fe None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:10.047518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728187b8-ffbc-44b2-9c4e-ac4c102387fe None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:10.078800 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9cc3d-6a26-42fa-9e96-5e5dc5faf0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:10.079379 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9cc3d-6a26-42fa-9e96-5e5dc5faf0dd None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:10.079660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9cc3d-6a26-42fa-9e96-5e5dc5faf0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:10.079933 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9cc3d-6a26-42fa-9e96-5e5dc5faf0dd None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:10.080607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9cc3d-6a26-42fa-9e96-5e5dc5faf0dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:10.080937 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9cc3d-6a26-42fa-9e96-5e5dc5faf0dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:10.082288 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9cc3d-6a26-42fa-9e96-5e5dc5faf0dd None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:10.093907 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 628/1279] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:08:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:10.099710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655b79a-8ec1-44db-918f-fe29f3a1c0fe None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:10.130189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:10.196723 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655b79a-8ec1-44db-918f-fe29f3a1c0fe None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:10.229059 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3a1d2-23b5-4608-a582-79019db19d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:10.233733 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3a1d2-23b5-4608-a582-79019db19d24 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:10.233733 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3a1d2-23b5-4608-a582-79019db19d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:10.233733 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3a1d2-23b5-4608-a582-79019db19d24 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:10.238401 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3a1d2-23b5-4608-a582-79019db19d24 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:10.239836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3a1d2-23b5-4608-a582-79019db19d24 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:10.250737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-36a3a1d2-23b5-4608-a582-79019db19d24 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 16:08:10.250737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:08:10.250737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:08:10.250737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:08:10.250737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:08:10.250737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:08:10.250737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:08:10.250737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:08:10.250737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:08:10.250737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:08:10.250737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:08:10.250737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:08:10.250737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 16:08:10.250737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 16:08:10.250737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 16:08:10.250737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 16:08:10.251844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:08:10.251844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:08:10.251844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 16:08:10.251844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:08:10.251844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 16:08:10.251844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 16:08:10.251844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:08:10.251844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:08:10.251844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:08:10.251844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:08:10.251844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:08:10.251844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:08:10.251844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:08:10.251844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:08:10.251844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:08:10.251844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:08:10.251844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:08:10.251844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:08:10.252794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:08:10.252794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:08:10.252794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 16:08:10.252794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 16:08:10.252794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 16:08:10.252794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 16:08:10.252794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 16:08:10.252794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 16:08:10.252794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 16:08:10.252794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:08:10.252794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 652/1280] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:08:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:08:10.257860 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9cc3d-6a26-42fa-9e96-5e5dc5faf0dd None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:10.262284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:10.356303 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9cc3d-6a26-42fa-9e96-5e5dc5faf0dd None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:10.389910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b4236-68a2-4d26-971c-cb7361303cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:10.390557 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b4236-68a2-4d26-971c-cb7361303cae None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:10.390791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b4236-68a2-4d26-971c-cb7361303cae None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:10.391112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b4236-68a2-4d26-971c-cb7361303cae None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:10.391933 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b4236-68a2-4d26-971c-cb7361303cae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:10.392241 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b4236-68a2-4d26-971c-cb7361303cae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:10.393695 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b4236-68a2-4d26-971c-cb7361303cae None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:10.412749 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 629/1281] 10.222.0.141 () {56 vars in 1148 bytes} [Tue Jul 26 16:08:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:10.418611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3a1d2-23b5-4608-a582-79019db19d24 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:10.507836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:10.518070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3a1d2-23b5-4608-a582-79019db19d24 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:10.552002 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b89a1-aa61-43c1-a2f3-f4c202e30dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:10.552604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b89a1-aa61-43c1-a2f3-f4c202e30dad None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:10.552908 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b89a1-aa61-43c1-a2f3-f4c202e30dad None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:10.553178 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b89a1-aa61-43c1-a2f3-f4c202e30dad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:10.620913 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b89a1-aa61-43c1-a2f3-f4c202e30dad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:10.622362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b89a1-aa61-43c1-a2f3-f4c202e30dad None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:10.709718 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:10.720511 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 653/1282] 10.222.0.141 () {58 vars in 1287 bytes} [Tue Jul 26 16:08:10 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 16:08:10.726430 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b4236-68a2-4d26-971c-cb7361303cae None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:10.787555 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:10.826412 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b4236-68a2-4d26-971c-cb7361303cae None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:10.858722 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5bef6-f540-45f5-9729-48023df3c7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:10.859355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5bef6-f540-45f5-9729-48023df3c7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:10.859637 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5bef6-f540-45f5-9729-48023df3c7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:10.859909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5bef6-f540-45f5-9729-48023df3c7c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:10.869926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5bef6-f540-45f5-9729-48023df3c7c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:10.871371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5bef6-f540-45f5-9729-48023df3c7c9 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:10.885651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-d7f5bef6-f540-45f5-9729-48023df3c7c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:08:10.885651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:08:10.885651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:08:10.885651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:08:10.885651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:08:10.885651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:08:10.885651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:08:10.885651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:08:10.885651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:08:10.885651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:08:10.885651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:08:10.885651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:08:10.885651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 16:08:10.885651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 16:08:10.885651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 16:08:10.886726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 16:08:10.886726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:08:10.886726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:08:10.886726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:08:10.886726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:08:10.886726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:08:10.886726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:08:10.886726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:08:10.886726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:08:10.886726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:08:10.886726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:08:10.886726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:08:10.886726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:08:10.886726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:08:10.886726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:08:10.886726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:08:10.886726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:08:10.887813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 16:08:10.887813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 16:08:10.887813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 16:08:10.887813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:08:10.887813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 630/1283] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:08:10.892823 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b89a1-aa61-43c1-a2f3-f4c202e30dad None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:10.991965 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b89a1-aa61-43c1-a2f3-f4c202e30dad None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:11.026865 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0140a-3a37-4a5b-a684-9855dc9e3a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:11.027470 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0140a-3a37-4a5b-a684-9855dc9e3a2f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:11.027752 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0140a-3a37-4a5b-a684-9855dc9e3a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:11.028018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0140a-3a37-4a5b-a684-9855dc9e3a2f None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:11.028720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0140a-3a37-4a5b-a684-9855dc9e3a2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:11.029021 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0140a-3a37-4a5b-a684-9855dc9e3a2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:11.030387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0140a-3a37-4a5b-a684-9855dc9e3a2f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:11.041265 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 654/1284] 10.222.0.141 () {56 vars in 1114 bytes} [Tue Jul 26 16:08:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:11.047181 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5bef6-f540-45f5-9729-48023df3c7c9 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:11.146652 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5bef6-f540-45f5-9729-48023df3c7c9 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:11.159986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:11.179701 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f5ef3-7bdc-4e54-9fa0-8fddd275c225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:11.180331 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f5ef3-7bdc-4e54-9fa0-8fddd275c225 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:11.180614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f5ef3-7bdc-4e54-9fa0-8fddd275c225 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:11.180914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f5ef3-7bdc-4e54-9fa0-8fddd275c225 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:11.187883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f5ef3-7bdc-4e54-9fa0-8fddd275c225 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:11.189357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f5ef3-7bdc-4e54-9fa0-8fddd275c225 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:11.200371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-339f5ef3-7bdc-4e54-9fa0-8fddd275c225 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:08:11.200371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:08:11.200371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:08:11.200371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:08:11.200371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:08:11.200371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:08:11.200371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:08:11.200371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:08:11.200371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:08:11.200371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:08:11.200371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:08:11.200371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:08:11.200371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 16:08:11.200371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 16:08:11.200371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 16:08:11.201409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 16:08:11.201409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:08:11.201409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:08:11.201409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:08:11.201409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:08:11.201409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:08:11.201409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:08:11.201409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:08:11.201409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( Jul 26 16:08:11.201409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:08:11.201409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:08:11.201409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:08:11.201409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:08:11.201409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:08:11.201409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:08:11.201409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:08:11.201409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:08:11.202541 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 16:08:11.202541 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 16:08:11.202541 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 16:08:11.202541 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 16:08:11.202541 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 16:08:11.202541 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 16:08:11.202541 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 16:08:11.202541 dv-cinder-851042-1-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Jul 26 16:08:11.202541 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 631/1285] 10.222.0.141 () {56 vars in 1116 bytes} [Tue Jul 26 16:08:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:08:11.207392 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0140a-3a37-4a5b-a684-9855dc9e3a2f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:11.257742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:11.308058 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0140a-3a37-4a5b-a684-9855dc9e3a2f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:11.341256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443f64a-7792-4647-8247-f3dfbf0abf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:11.341914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443f64a-7792-4647-8247-f3dfbf0abf95 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:11.342197 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443f64a-7792-4647-8247-f3dfbf0abf95 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:11.343039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443f64a-7792-4647-8247-f3dfbf0abf95 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:11.343779 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443f64a-7792-4647-8247-f3dfbf0abf95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:11.344081 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443f64a-7792-4647-8247-f3dfbf0abf95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:11.345521 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443f64a-7792-4647-8247-f3dfbf0abf95 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:11.357212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 655/1286] 10.222.0.141 () {56 vars in 1153 bytes} [Tue Jul 26 16:08:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:11.363390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f5ef3-7bdc-4e54-9fa0-8fddd275c225 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:11.460753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f5ef3-7bdc-4e54-9fa0-8fddd275c225 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:11.493760 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac13c46-45d0-499d-a9f6-1a722e937d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:11.494364 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac13c46-45d0-499d-a9f6-1a722e937d4d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:11.494639 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac13c46-45d0-499d-a9f6-1a722e937d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:11.494909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac13c46-45d0-499d-a9f6-1a722e937d4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:11.495680 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac13c46-45d0-499d-a9f6-1a722e937d4d None admin] RBAC: Adding query filter params (role.id=94ecbd6c86a84b75bdb0c57fc27a9a07, scope.project.id=3747e176cdf2495d9b31a1afae618f68, user.id=fda05b7b9675423e992470819d1c150a) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:11.495983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac13c46-45d0-499d-a9f6-1a722e937d4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:11.497500 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac13c46-45d0-499d-a9f6-1a722e937d4d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:11.503170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 632/1287] 10.222.0.141 () {56 vars in 1379 bytes} [Tue Jul 26 16:08:11 2022] GET /identity/v3/role_assignments?user.id=fda05b7b9675423e992470819d1c150a&scope.project.id=3747e176cdf2495d9b31a1afae618f68&role.id=94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 610 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:13.547495 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203eaaa-a433-4edf-a312-3d4f0daaa721 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:13.548018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203eaaa-a433-4edf-a312-3d4f0daaa721 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:13.548112 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203eaaa-a433-4edf-a312-3d4f0daaa721 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:13.549456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 656/1288] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:08:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:08:13.554782 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f48e00-6d3c-499e-bc08-97f4f85589a4 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:13.555232 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f48e00-6d3c-499e-bc08-97f4f85589a4 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:13.555340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f48e00-6d3c-499e-bc08-97f4f85589a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:13.573978 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-02f48e00-6d3c-499e-bc08-97f4f85589a4 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:08:13.575232 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-02f48e00-6d3c-499e-bc08-97f4f85589a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:08:13.603900 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:13.640554 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 633/1289] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:08:13 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:08:13.662290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203eaaa-a433-4edf-a312-3d4f0daaa721 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:13.764059 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203eaaa-a433-4edf-a312-3d4f0daaa721 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:13.774555 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:13.800360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad5521-7a6b-4b96-9d04-6fee76951371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:13.800945 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad5521-7a6b-4b96-9d04-6fee76951371 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:13.801222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad5521-7a6b-4b96-9d04-6fee76951371 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:13.801491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad5521-7a6b-4b96-9d04-6fee76951371 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:13.802101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad5521-7a6b-4b96-9d04-6fee76951371 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:13.803441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad5521-7a6b-4b96-9d04-6fee76951371 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:13.813611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-0cad5521-7a6b-4b96-9d04-6fee76951371 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 16:08:13.813611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:08:13.813611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:08:13.813611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:08:13.813611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:08:13.813611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:08:13.813611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:08:13.813611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:08:13.813611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 16:08:13.813611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:08:13.813611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:08:13.813611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:08:13.813611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:08:13.813611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:08:13.813611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:08:13.813611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:08:13.813611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:08:13.814804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:08:13.814804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:08:13.814804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:08:13.814804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:08:13.814804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:08:13.814804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:08:13.814804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:08:13.814804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:08:13.814804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:08:13.814804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:08:13.814804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:08:13.814804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:08:13.814804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:08:13.814804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:08:13.814804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:08:13.814804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:08:13.815749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:08:13.815749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:08:13.815749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:08:13.815749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:08:13.815749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:08:13.815749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:08:13.815749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:08:13.815749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:08:13.815749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:08:13.815749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:08:13.815749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:08:13.815749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:08:13.815749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 16:08:13.815749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:08:13.815749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 657/1290] 10.222.0.141 () {56 vars in 1122 bytes} [Tue Jul 26 16:08:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:08:13.821029 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f48e00-6d3c-499e-bc08-97f4f85589a4 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:13.918756 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f48e00-6d3c-499e-bc08-97f4f85589a4 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:13.953001 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9dc63-7d58-4b7d-8174-c70b6b8cfae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:13.953628 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9dc63-7d58-4b7d-8174-c70b6b8cfae3 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:13.953904 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9dc63-7d58-4b7d-8174-c70b6b8cfae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:13.954167 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9dc63-7d58-4b7d-8174-c70b6b8cfae3 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:13.954839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9dc63-7d58-4b7d-8174-c70b6b8cfae3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:13.955143 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9dc63-7d58-4b7d-8174-c70b6b8cfae3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:13.956500 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9dc63-7d58-4b7d-8174-c70b6b8cfae3 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:13.961221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 634/1291] 10.222.0.141 () {56 vars in 1121 bytes} [Tue Jul 26 16:08:13 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:13.967045 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad5521-7a6b-4b96-9d04-6fee76951371 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:14.065235 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad5521-7a6b-4b96-9d04-6fee76951371 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:14.098312 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a192d76-60b2-48db-91ad-dc75471d9535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:14.098929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a192d76-60b2-48db-91ad-dc75471d9535 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:14.099211 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a192d76-60b2-48db-91ad-dc75471d9535 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:14.099487 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a192d76-60b2-48db-91ad-dc75471d9535 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:14.100163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a192d76-60b2-48db-91ad-dc75471d9535 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:14.100471 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a192d76-60b2-48db-91ad-dc75471d9535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:14.101871 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a192d76-60b2-48db-91ad-dc75471d9535 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:14.106330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 658/1292] 10.222.0.141 () {56 vars in 1121 bytes} [Tue Jul 26 16:08:13 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:16.095460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa94ab1-23b3-43a4-99f2-86dfa6618a87 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:16.096009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa94ab1-23b3-43a4-99f2-86dfa6618a87 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:16.096009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa94ab1-23b3-43a4-99f2-86dfa6618a87 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:16.097400 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 635/1293] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:08:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:08:16.102446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d68ef3-a5ad-4a52-868a-c6c3465ddad2 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:16.102822 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d68ef3-a5ad-4a52-868a-c6c3465ddad2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:16.103084 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d68ef3-a5ad-4a52-868a-c6c3465ddad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:16.121422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-b9d68ef3-a5ad-4a52-868a-c6c3465ddad2 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:08:16.122626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b9d68ef3-a5ad-4a52-868a-c6c3465ddad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:08:16.151277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:16.188123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 659/1294] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:08:16 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:08:16.210184 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa94ab1-23b3-43a4-99f2-86dfa6618a87 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:16.242190 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:16.312316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa94ab1-23b3-43a4-99f2-86dfa6618a87 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:16.346383 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d39056-978d-49d3-9c27-79c6e4060d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:16.347013 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d39056-978d-49d3-9c27-79c6e4060d35 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:16.347296 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d39056-978d-49d3-9c27-79c6e4060d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:16.347655 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d39056-978d-49d3-9c27-79c6e4060d35 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:16.348336 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d39056-978d-49d3-9c27-79c6e4060d35 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:16.349751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d39056-978d-49d3-9c27-79c6e4060d35 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:16.429467 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 636/1295] 10.222.0.141 () {60 vars in 1146 bytes} [Tue Jul 26 16:08:16 2022] POST /identity/v3/services => generated 247 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:08:18.472965 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e485978-c0eb-4761-8a93-9c460ac6b6d4 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:18.473554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e485978-c0eb-4761-8a93-9c460ac6b6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:18.473554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e485978-c0eb-4761-8a93-9c460ac6b6d4 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:18.474902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 660/1296] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:08:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:08:18.480130 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb95e8-8155-4fe0-b212-11ffdd0caa86 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:18.480553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb95e8-8155-4fe0-b212-11ffdd0caa86 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:18.480736 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb95e8-8155-4fe0-b212-11ffdd0caa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:18.498310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a4fb95e8-8155-4fe0-b212-11ffdd0caa86 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:08:18.499999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a4fb95e8-8155-4fe0-b212-11ffdd0caa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:08:18.571519 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 637/1297] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:08:18 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:08:18.594336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e485978-c0eb-4761-8a93-9c460ac6b6d4 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:18.695838 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e485978-c0eb-4761-8a93-9c460ac6b6d4 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:18.729501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d44dd6-884b-4a3a-ba25-aed7523ac468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:18.729501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d44dd6-884b-4a3a-ba25-aed7523ac468 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:18.729501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d44dd6-884b-4a3a-ba25-aed7523ac468 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:18.729501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d44dd6-884b-4a3a-ba25-aed7523ac468 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:18.730127 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d44dd6-884b-4a3a-ba25-aed7523ac468 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:18.731491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d44dd6-884b-4a3a-ba25-aed7523ac468 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:18.740697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-48d44dd6-884b-4a3a-ba25-aed7523ac468 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 16:08:18.740697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:08:18.740697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:08:18.740697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:08:18.740697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:08:18.740697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:08:18.740697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:08:18.740697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:08:18.740697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 16:08:18.740697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:08:18.740697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:08:18.740697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:08:18.740697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:08:18.740697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:08:18.740697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:08:18.740697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:08:18.740697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:08:18.741923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:08:18.741923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:08:18.741923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:08:18.741923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:08:18.741923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:08:18.741923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:08:18.741923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:08:18.741923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:08:18.741923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:08:18.741923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:08:18.741923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:08:18.741923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:08:18.741923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:08:18.741923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:08:18.741923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:08:18.741923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:08:18.742811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:08:18.742811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:08:18.742811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:08:18.742811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:08:18.742811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:08:18.742811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:08:18.742811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:08:18.742811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:08:18.742811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:08:18.742811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:08:18.742811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:08:18.742811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:08:18.742811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 16:08:18.742811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:08:18.742811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 661/1298] 10.222.0.141 () {56 vars in 1122 bytes} [Tue Jul 26 16:08:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:08:18.748056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb95e8-8155-4fe0-b212-11ffdd0caa86 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:18.766499 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:18.842738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb95e8-8155-4fe0-b212-11ffdd0caa86 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:18.876948 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56d0bf-1946-444e-9fc7-b34745e518cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:18.877565 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56d0bf-1946-444e-9fc7-b34745e518cd None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:18.877845 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56d0bf-1946-444e-9fc7-b34745e518cd None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:18.878120 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56d0bf-1946-444e-9fc7-b34745e518cd None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:18.878791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56d0bf-1946-444e-9fc7-b34745e518cd None admin] RBAC: Adding query filter params (name=placement) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:18.879226 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56d0bf-1946-444e-9fc7-b34745e518cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:18.880762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56d0bf-1946-444e-9fc7-b34745e518cd None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:18.886045 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 638/1299] 10.222.0.141 () {56 vars in 1121 bytes} [Tue Jul 26 16:08:18 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:18.892231 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d44dd6-884b-4a3a-ba25-aed7523ac468 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:18.924563 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:18.992077 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d44dd6-884b-4a3a-ba25-aed7523ac468 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:19.025046 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d16b2d-38e0-4195-b200-0a3bd26e14eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:19.025656 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d16b2d-38e0-4195-b200-0a3bd26e14eb None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:19.025937 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d16b2d-38e0-4195-b200-0a3bd26e14eb None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:19.026214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d16b2d-38e0-4195-b200-0a3bd26e14eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:19.026959 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d16b2d-38e0-4195-b200-0a3bd26e14eb None admin] RBAC: Adding query filter params (interface=public, service_id=4ac879e1f03848d1a458d93ba0e48882, region_id=RegionOne) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:19.027269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d16b2d-38e0-4195-b200-0a3bd26e14eb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:19.028639 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d16b2d-38e0-4195-b200-0a3bd26e14eb None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:19.034122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 662/1300] 10.222.0.141 () {56 vars in 1256 bytes} [Tue Jul 26 16:08:18 2022] GET /identity/v3/endpoints?service_id=4ac879e1f03848d1a458d93ba0e48882&interface=public®ion_id=RegionOne => generated 195 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:19.040078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56d0bf-1946-444e-9fc7-b34745e518cd None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:19.120388 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:19.138004 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56d0bf-1946-444e-9fc7-b34745e518cd None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:19.172402 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e213fe0-7603-476e-a28d-9e1b916b17b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:19.173055 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e213fe0-7603-476e-a28d-9e1b916b17b2 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:19.173339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e213fe0-7603-476e-a28d-9e1b916b17b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:19.173639 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e213fe0-7603-476e-a28d-9e1b916b17b2 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:19.174290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e213fe0-7603-476e-a28d-9e1b916b17b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:19.175669 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e213fe0-7603-476e-a28d-9e1b916b17b2 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:19.182649 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 639/1301] 10.222.0.141 () {56 vars in 1092 bytes} [Tue Jul 26 16:08:19 2022] GET /identity/v3/services => generated 2201 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:08:21.179973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ae513-b5af-4b4b-a339-71e51647c062 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:21.180539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ae513-b5af-4b4b-a339-71e51647c062 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:21.180539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ae513-b5af-4b4b-a339-71e51647c062 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:21.182537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 663/1302] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:08:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:08:21.188253 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe3f99-bba0-48a9-9473-afa1ad0c283a None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:21.188679 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe3f99-bba0-48a9-9473-afa1ad0c283a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:21.188891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe3f99-bba0-48a9-9473-afa1ad0c283a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:21.206652 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-9abe3f99-bba0-48a9-9473-afa1ad0c283a None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:08:21.207813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9abe3f99-bba0-48a9-9473-afa1ad0c283a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:08:21.273839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 640/1303] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:08:21 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 16:08:21.296639 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ae513-b5af-4b4b-a339-71e51647c062 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:21.390229 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:21.396716 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ae513-b5af-4b4b-a339-71e51647c062 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:21.429323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fc4e7-e1a7-4bae-8653-4a8ad9e77f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:21.429941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fc4e7-e1a7-4bae-8653-4a8ad9e77f03 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:21.430220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fc4e7-e1a7-4bae-8653-4a8ad9e77f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:21.430488 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fc4e7-e1a7-4bae-8653-4a8ad9e77f03 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:21.431095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fc4e7-e1a7-4bae-8653-4a8ad9e77f03 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:21.432452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fc4e7-e1a7-4bae-8653-4a8ad9e77f03 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:21.441173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-7f3fc4e7-e1a7-4bae-8653-4a8ad9e77f03 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 16:08:21.441173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:08:21.441173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 16:08:21.441173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 16:08:21.441173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 16:08:21.441173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 16:08:21.441173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 16:08:21.441173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:08:21.441173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 16:08:21.441173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:08:21.441173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 16:08:21.441173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:08:21.441173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 16:08:21.441173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 16:08:21.441173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 16:08:21.441173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 16:08:21.441173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 16:08:21.442427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 16:08:21.442427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 16:08:21.442427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 16:08:21.442427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 16:08:21.442427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 16:08:21.442427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 16:08:21.442427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 16:08:21.442427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 16:08:21.442427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 16:08:21.442427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 16:08:21.442427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 16:08:21.442427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 16:08:21.442427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 16:08:21.442427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 16:08:21.442427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 16:08:21.442427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 16:08:21.443381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 16:08:21.443381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( Jul 26 16:08:21.443381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 16:08:21.443381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() Jul 26 16:08:21.443381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 16:08:21.443381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 16:08:21.443381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 16:08:21.443381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() Jul 26 16:08:21.443381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 16:08:21.443381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( Jul 26 16:08:21.443381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 16:08:21.443381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 16:08:21.443381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 16:08:21.443381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Jul 26 16:08:21.443381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 664/1304] 10.222.0.141 () {56 vars in 1122 bytes} [Tue Jul 26 16:08:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 16:08:21.448285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe3f99-bba0-48a9-9473-afa1ad0c283a None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:21.525716 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:21.548907 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe3f99-bba0-48a9-9473-afa1ad0c283a None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:21.580389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247ffbc-4ae7-44c3-aa70-89ba0d275c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:21.581034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247ffbc-4ae7-44c3-aa70-89ba0d275c84 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:21.581313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247ffbc-4ae7-44c3-aa70-89ba0d275c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:21.581586 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247ffbc-4ae7-44c3-aa70-89ba0d275c84 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:21.582259 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247ffbc-4ae7-44c3-aa70-89ba0d275c84 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:08:21.582562 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247ffbc-4ae7-44c3-aa70-89ba0d275c84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:21.583925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247ffbc-4ae7-44c3-aa70-89ba0d275c84 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:21.588892 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 641/1305] 10.222.0.141 () {56 vars in 1121 bytes} [Tue Jul 26 16:08:21 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:08:21.595256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fc4e7-e1a7-4bae-8653-4a8ad9e77f03 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:08:21.692646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fc4e7-e1a7-4bae-8653-4a8ad9e77f03 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:08:21.725961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb9a8d-e517-42fc-8305-7b3f548ac862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:08:21.726567 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb9a8d-e517-42fc-8305-7b3f548ac862 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:08:21.726846 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb9a8d-e517-42fc-8305-7b3f548ac862 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:08:21.727118 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb9a8d-e517-42fc-8305-7b3f548ac862 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:08:21.727816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb9a8d-e517-42fc-8305-7b3f548ac862 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:08:21.729217 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb9a8d-e517-42fc-8305-7b3f548ac862 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:08:21.817459 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 665/1306] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:08:21 2022] POST /identity/v3/endpoints => generated 333 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:08:31.606380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=30 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:08:31.812982 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:14:31.682771 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93223899-07a6-4484-a155-c1a562517898 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:31.683288 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93223899-07a6-4484-a155-c1a562517898 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:31.683622 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93223899-07a6-4484-a155-c1a562517898 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:31.691006 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684e27f-e925-413f-87b7-71a247932749 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:31.691439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684e27f-e925-413f-87b7-71a247932749 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:31.691566 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684e27f-e925-413f-87b7-71a247932749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:31.694529 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 642/1307] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:14:31 2022] GET /identity => generated 271 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:14:31.777490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-1684e27f-e925-413f-87b7-71a247932749 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:14:31.779224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1684e27f-e925-413f-87b7-71a247932749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:31.902166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 666/1308] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:14:31.954305 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629dfaa7-6cbc-4bca-a9eb-068905dd44f2 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:31.954795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629dfaa7-6cbc-4bca-a9eb-068905dd44f2 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:31.955086 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629dfaa7-6cbc-4bca-a9eb-068905dd44f2 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:31.958462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 643/1309] 10.222.0.141 () {54 vars in 970 bytes} [Tue Jul 26 16:14:31 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:14:31.967837 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807a3c6-c8e0-4a91-868d-fa5e907836c3 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:31.968034 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807a3c6-c8e0-4a91-868d-fa5e907836c3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:31.968307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807a3c6-c8e0-4a91-868d-fa5e907836c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:32.063021 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-4807a3c6-c8e0-4a91-868d-fa5e907836c3 None None] MFA Rules not processed for user `d1a99faad91b4357973f4bbb6632c724`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:14:32.064231 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4807a3c6-c8e0-4a91-868d-fa5e907836c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:32.095926 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:14:32.171496 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 667/1310] 10.222.0.141 () {58 vars in 1067 bytes} [Tue Jul 26 16:14:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:14:32.172173 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629dfaa7-6cbc-4bca-a9eb-068905dd44f2 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:14:32.174364 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-629dfaa7-6cbc-4bca-a9eb-068905dd44f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:32.307544 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629dfaa7-6cbc-4bca-a9eb-068905dd44f2 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:14:32.392497 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04a843-e1c5-4551-98f2-396148384c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:14:32.393269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04a843-e1c5-4551-98f2-396148384c52 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:32.393615 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04a843-e1c5-4551-98f2-396148384c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:32.393963 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04a843-e1c5-4551-98f2-396148384c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:32.395681 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4a04a843-e1c5-4551-98f2-396148384c52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:32.455118 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:14:32.515251 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04a843-e1c5-4551-98f2-396148384c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:14:32.516734 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04a843-e1c5-4551-98f2-396148384c52 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:14:32.536784 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 644/1311] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:14:34.956229 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab294a-d175-4e1f-86ab-00efc588bc9f None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:34.956733 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab294a-d175-4e1f-86ab-00efc588bc9f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:34.956842 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab294a-d175-4e1f-86ab-00efc588bc9f None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:34.958462 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 668/1312] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:14:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:14:34.963600 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83059b0a-184f-43eb-b8c1-2361c82f0fae None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:34.964022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83059b0a-184f-43eb-b8c1-2361c82f0fae None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:34.964264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83059b0a-184f-43eb-b8c1-2361c82f0fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:35.033713 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-83059b0a-184f-43eb-b8c1-2361c82f0fae None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:14:35.034905 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-83059b0a-184f-43eb-b8c1-2361c82f0fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:35.130652 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 645/1313] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:14:35.188340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbd235-c5f8-441f-8f2e-7ca8bcb7c699 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:35.188539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbd235-c5f8-441f-8f2e-7ca8bcb7c699 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:35.188848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbd235-c5f8-441f-8f2e-7ca8bcb7c699 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:35.190294 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 669/1314] 10.222.0.141 () {54 vars in 970 bytes} [Tue Jul 26 16:14:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:14:35.197141 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db242f11-0352-44c4-9bb6-738c228612ca None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:35.197424 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db242f11-0352-44c4-9bb6-738c228612ca None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:35.197699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db242f11-0352-44c4-9bb6-738c228612ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:35.210207 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:14:35.282533 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-db242f11-0352-44c4-9bb6-738c228612ca None None] MFA Rules not processed for user `d1a99faad91b4357973f4bbb6632c724`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:14:35.283814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-db242f11-0352-44c4-9bb6-738c228612ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:35.361878 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 646/1315] 10.222.0.141 () {58 vars in 1067 bytes} [Tue Jul 26 16:14:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:14:35.370875 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbd235-c5f8-441f-8f2e-7ca8bcb7c699 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:14:35.373061 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7bcbd235-c5f8-441f-8f2e-7ca8bcb7c699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:35.479244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbd235-c5f8-441f-8f2e-7ca8bcb7c699 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:14:35.553924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:14:35.556615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4e9a6-80eb-4320-8fd2-51f61ec91b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:14:35.557277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4e9a6-80eb-4320-8fd2-51f61ec91b74 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:35.557558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4e9a6-80eb-4320-8fd2-51f61ec91b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:35.557828 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4e9a6-80eb-4320-8fd2-51f61ec91b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:35.559604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0ec4e9a6-80eb-4320-8fd2-51f61ec91b74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:35.669560 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4e9a6-80eb-4320-8fd2-51f61ec91b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:14:35.670995 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4e9a6-80eb-4320-8fd2-51f61ec91b74 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:14:35.689536 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 670/1316] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:14:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:14:38.588983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dba2c7-f576-4ccf-a325-4d17ac804567 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:38.589557 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dba2c7-f576-4ccf-a325-4d17ac804567 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:38.589557 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dba2c7-f576-4ccf-a325-4d17ac804567 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:38.591433 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 647/1317] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:14:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:14:38.596415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd832e2-3867-46e3-a7d4-0131b45bf079 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:38.596880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd832e2-3867-46e3-a7d4-0131b45bf079 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:38.596992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd832e2-3867-46e3-a7d4-0131b45bf079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:38.660740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-dfd832e2-3867-46e3-a7d4-0131b45bf079 None None] MFA Rules not processed for user `c4c00af7c7f1415b949cfc5553ea08d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:14:38.661936 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dfd832e2-3867-46e3-a7d4-0131b45bf079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:38.711973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:14:38.755858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 671/1318] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:14:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:14:38.796764 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dba2c7-f576-4ccf-a325-4d17ac804567 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:14:38.798573 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c9dba2c7-f576-4ccf-a325-4d17ac804567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:38.899284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dba2c7-f576-4ccf-a325-4d17ac804567 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:14:38.902093 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:14:38.972655 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c54cb-ea53-478a-ac83-e5f65afc9339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:14:38.973298 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c54cb-ea53-478a-ac83-e5f65afc9339 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:38.973578 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c54cb-ea53-478a-ac83-e5f65afc9339 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:38.973848 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c54cb-ea53-478a-ac83-e5f65afc9339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:38.975474 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-190c54cb-ea53-478a-ac83-e5f65afc9339 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:39.088444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c54cb-ea53-478a-ac83-e5f65afc9339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:14:39.089931 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c54cb-ea53-478a-ac83-e5f65afc9339 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:14:39.109082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 648/1319] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:14:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:14:42.195113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd471b9-0ed1-4ec9-aa16-0e2990e28519 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:42.195668 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd471b9-0ed1-4ec9-aa16-0e2990e28519 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:42.195668 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd471b9-0ed1-4ec9-aa16-0e2990e28519 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:42.196952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 672/1320] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:14:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:14:42.202794 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013ee34-f38b-47f8-be28-ab555b6e58c4 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:42.203262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013ee34-f38b-47f8-be28-ab555b6e58c4 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:42.203364 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013ee34-f38b-47f8-be28-ab555b6e58c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:42.242833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:14:42.268615 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d013ee34-f38b-47f8-be28-ab555b6e58c4 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:14:42.270017 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d013ee34-f38b-47f8-be28-ab555b6e58c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:42.369042 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 649/1321] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:14:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:14:42.408022 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd471b9-0ed1-4ec9-aa16-0e2990e28519 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:14:42.409594 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6fd471b9-0ed1-4ec9-aa16-0e2990e28519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:42.511662 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd471b9-0ed1-4ec9-aa16-0e2990e28519 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:14:42.582972 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5373559-183b-4514-9de0-e1d4064f7340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:14:42.583581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5373559-183b-4514-9de0-e1d4064f7340 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:42.583862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5373559-183b-4514-9de0-e1d4064f7340 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:42.584137 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5373559-183b-4514-9de0-e1d4064f7340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:42.585780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c5373559-183b-4514-9de0-e1d4064f7340 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:42.593262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:14:42.702838 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5373559-183b-4514-9de0-e1d4064f7340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:14:42.704255 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5373559-183b-4514-9de0-e1d4064f7340 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:14:42.721787 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 673/1322] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:14:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:14:45.779632 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3ff13-04b3-4390-ad52-982104414327 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:45.780155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3ff13-04b3-4390-ad52-982104414327 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:45.780274 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3ff13-04b3-4390-ad52-982104414327 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:45.781721 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 650/1323] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:14:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:14:45.786709 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68710dc4-ffdc-46f4-a731-99b3a5c6b02a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:45.787158 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68710dc4-ffdc-46f4-a731-99b3a5c6b02a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:45.787262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68710dc4-ffdc-46f4-a731-99b3a5c6b02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:45.854707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-68710dc4-ffdc-46f4-a731-99b3a5c6b02a None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:14:45.855807 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-68710dc4-ffdc-46f4-a731-99b3a5c6b02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:45.911856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:14:45.952019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 674/1324] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:14:45.989096 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3ff13-04b3-4390-ad52-982104414327 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:14:45.990634 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-83d3ff13-04b3-4390-ad52-982104414327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:46.100635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3ff13-04b3-4390-ad52-982104414327 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:14:46.114655 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:14:46.180994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc8a99-a8e7-4d38-92ef-5cb1127e6ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:14:46.181621 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc8a99-a8e7-4d38-92ef-5cb1127e6ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:46.181903 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc8a99-a8e7-4d38-92ef-5cb1127e6ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:46.182177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc8a99-a8e7-4d38-92ef-5cb1127e6ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:46.183842 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-86cc8a99-a8e7-4d38-92ef-5cb1127e6ff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:46.296120 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc8a99-a8e7-4d38-92ef-5cb1127e6ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:14:46.297883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc8a99-a8e7-4d38-92ef-5cb1127e6ff6 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:14:46.316265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 651/1325] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:14:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:14:48.383583 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9c0ec-3f64-4d44-82ff-92f6ad314118 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:48.384156 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9c0ec-3f64-4d44-82ff-92f6ad314118 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:48.384404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9c0ec-3f64-4d44-82ff-92f6ad314118 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:48.386020 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 675/1326] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:14:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:14:48.393963 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9acf3-5cb4-41f0-9d51-c3ad6509c733 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:48.394439 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9acf3-5cb4-41f0-9d51-c3ad6509c733 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:48.394654 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9acf3-5cb4-41f0-9d51-c3ad6509c733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:48.443915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:14:48.461774 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-39f9acf3-5cb4-41f0-9d51-c3ad6509c733 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:14:48.463043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-39f9acf3-5cb4-41f0-9d51-c3ad6509c733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:48.558357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 652/1327] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:14:48.594417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9c0ec-3f64-4d44-82ff-92f6ad314118 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:14:48.595933 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0eb9c0ec-3f64-4d44-82ff-92f6ad314118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:48.700863 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9c0ec-3f64-4d44-82ff-92f6ad314118 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:14:48.775633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74708721-4cf1-4d19-b6b6-944f100d1e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:14:48.776255 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74708721-4cf1-4d19-b6b6-944f100d1e84 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:48.776538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74708721-4cf1-4d19-b6b6-944f100d1e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:48.776852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74708721-4cf1-4d19-b6b6-944f100d1e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:48.779099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-74708721-4cf1-4d19-b6b6-944f100d1e84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:48.796503 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:14:48.893625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74708721-4cf1-4d19-b6b6-944f100d1e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:14:48.895111 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74708721-4cf1-4d19-b6b6-944f100d1e84 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:14:48.915799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 676/1328] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:14:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:14:50.987454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324c597-44c8-41e9-9059-9e59ed309604 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:50.988058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324c597-44c8-41e9-9059-9e59ed309604 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:50.988058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324c597-44c8-41e9-9059-9e59ed309604 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:50.989401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 653/1329] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:14:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:14:50.994793 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe7dbf-86f2-4621-a385-a877a6b25c21 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:50.995258 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe7dbf-86f2-4621-a385-a877a6b25c21 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:50.995357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe7dbf-86f2-4621-a385-a877a6b25c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:51.064727 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-78fe7dbf-86f2-4621-a385-a877a6b25c21 None None] MFA Rules not processed for user `c4c00af7c7f1415b949cfc5553ea08d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:14:51.065925 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-78fe7dbf-86f2-4621-a385-a877a6b25c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:51.130169 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:14:51.161809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 677/1330] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:14:50 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:14:51.199263 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324c597-44c8-41e9-9059-9e59ed309604 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:14:51.201540 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3324c597-44c8-41e9-9059-9e59ed309604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:51.312579 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324c597-44c8-41e9-9059-9e59ed309604 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:14:51.335346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:14:51.390036 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a394c-8243-452a-bad2-7ca93525789d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:14:51.390656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a394c-8243-452a-bad2-7ca93525789d service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:51.391103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a394c-8243-452a-bad2-7ca93525789d service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:51.391384 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a394c-8243-452a-bad2-7ca93525789d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:51.393049 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-cb1a394c-8243-452a-bad2-7ca93525789d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:51.502623 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a394c-8243-452a-bad2-7ca93525789d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:14:51.503987 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a394c-8243-452a-bad2-7ca93525789d service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:14:51.522401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 654/1331] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:14:51 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:14:54.127202 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d55ec-6f40-4151-9ce4-b3743e22cece None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:54.127742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d55ec-6f40-4151-9ce4-b3743e22cece None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:54.127742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d55ec-6f40-4151-9ce4-b3743e22cece None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:54.129170 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 678/1332] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:14:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:14:54.134455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79311e2-c36c-4b76-933f-a1a63811f47a None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:54.134905 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79311e2-c36c-4b76-933f-a1a63811f47a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:54.135011 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79311e2-c36c-4b76-933f-a1a63811f47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:54.197602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:14:54.200830 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e79311e2-c36c-4b76-933f-a1a63811f47a None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:14:54.202041 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e79311e2-c36c-4b76-933f-a1a63811f47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:54.296491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 655/1333] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:14:54.333764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d55ec-6f40-4151-9ce4-b3743e22cece None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:14:54.335354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-022d55ec-6f40-4151-9ce4-b3743e22cece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:54.436898 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d55ec-6f40-4151-9ce4-b3743e22cece None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:14:54.509110 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd10e7a-8ae3-4f2d-8498-71904cb223ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:14:54.509729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd10e7a-8ae3-4f2d-8498-71904cb223ff service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:54.510013 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd10e7a-8ae3-4f2d-8498-71904cb223ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:54.510288 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd10e7a-8ae3-4f2d-8498-71904cb223ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:54.511940 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fdd10e7a-8ae3-4f2d-8498-71904cb223ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:54.538181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:14:54.618760 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd10e7a-8ae3-4f2d-8498-71904cb223ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:14:54.620201 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd10e7a-8ae3-4f2d-8498-71904cb223ff service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:14:54.639294 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 679/1334] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:14:56.687049 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cabd3-1faa-46b9-ba10-c9d2759a5117 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:56.687609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cabd3-1faa-46b9-ba10-c9d2759a5117 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:56.687609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cabd3-1faa-46b9-ba10-c9d2759a5117 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:56.689017 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 656/1335] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:14:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:14:56.694257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d053310-88c1-4640-a3ed-16dc4db30d75 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:56.694647 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d053310-88c1-4640-a3ed-16dc4db30d75 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:56.694836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d053310-88c1-4640-a3ed-16dc4db30d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:56.759910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2d053310-88c1-4640-a3ed-16dc4db30d75 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:14:56.761133 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2d053310-88c1-4640-a3ed-16dc4db30d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:56.834455 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:14:56.858628 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 680/1336] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:14:56.898995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cabd3-1faa-46b9-ba10-c9d2759a5117 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:14:56.900523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c38cabd3-1faa-46b9-ba10-c9d2759a5117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:57.003134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cabd3-1faa-46b9-ba10-c9d2759a5117 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:14:57.032491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:14:57.076586 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ae1b5-a3f2-47ee-8b6d-b48c4a6a0389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:14:57.077232 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ae1b5-a3f2-47ee-8b6d-b48c4a6a0389 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:57.077515 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ae1b5-a3f2-47ee-8b6d-b48c4a6a0389 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:57.077789 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ae1b5-a3f2-47ee-8b6d-b48c4a6a0389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:57.079416 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-021ae1b5-a3f2-47ee-8b6d-b48c4a6a0389 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:57.185808 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ae1b5-a3f2-47ee-8b6d-b48c4a6a0389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:14:57.187241 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ae1b5-a3f2-47ee-8b6d-b48c4a6a0389 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:14:57.205407 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 657/1337] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:14:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:14:59.884305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e68054-5c08-4beb-bffe-694f34e46771 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:59.884873 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e68054-5c08-4beb-bffe-694f34e46771 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:59.884873 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e68054-5c08-4beb-bffe-694f34e46771 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:59.886237 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 681/1338] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:14:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:14:59.891498 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c618136-7dba-4cad-abdf-1c57285d7c6f None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:14:59.891930 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c618136-7dba-4cad-abdf-1c57285d7c6f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:14:59.892116 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c618136-7dba-4cad-abdf-1c57285d7c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:14:59.958360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-6c618136-7dba-4cad-abdf-1c57285d7c6f None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:14:59.959553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6c618136-7dba-4cad-abdf-1c57285d7c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:14:59.967635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:00.055593 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 658/1339] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:14:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:00.092955 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e68054-5c08-4beb-bffe-694f34e46771 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:15:00.094542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b5e68054-5c08-4beb-bffe-694f34e46771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:00.196578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e68054-5c08-4beb-bffe-694f34e46771 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:15:00.268903 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a829f-dee8-44b0-9bcc-8f2e0000d34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:15:00.269517 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a829f-dee8-44b0-9bcc-8f2e0000d34b service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:00.269800 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a829f-dee8-44b0-9bcc-8f2e0000d34b service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:00.270073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a829f-dee8-44b0-9bcc-8f2e0000d34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:00.271688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-873a829f-dee8-44b0-9bcc-8f2e0000d34b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:00.306275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:00.381004 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a829f-dee8-44b0-9bcc-8f2e0000d34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:15:00.382432 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a829f-dee8-44b0-9bcc-8f2e0000d34b service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:15:00.400962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 682/1340] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:15:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:15:04.701654 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767f1d1-7555-4201-ae4e-a40afa4e6053 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:04.702181 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767f1d1-7555-4201-ae4e-a40afa4e6053 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:04.702181 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767f1d1-7555-4201-ae4e-a40afa4e6053 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:04.703570 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 659/1341] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:15:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:04.708961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825e175-10d9-4eaa-ac5a-14301dd57045 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:04.709482 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825e175-10d9-4eaa-ac5a-14301dd57045 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:04.709580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825e175-10d9-4eaa-ac5a-14301dd57045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:04.780093 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d825e175-10d9-4eaa-ac5a-14301dd57045 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:04.781766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d825e175-10d9-4eaa-ac5a-14301dd57045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:04.877680 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:04.891193 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 683/1342] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:04.930422 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767f1d1-7555-4201-ae4e-a40afa4e6053 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:15:04.932432 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b767f1d1-7555-4201-ae4e-a40afa4e6053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:05.044375 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767f1d1-7555-4201-ae4e-a40afa4e6053 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:15:05.083226 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:05.119531 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65b3e7-e32c-4563-bb6f-e1548771f3e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:15:05.120145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65b3e7-e32c-4563-bb6f-e1548771f3e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:05.120422 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65b3e7-e32c-4563-bb6f-e1548771f3e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:05.120710 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65b3e7-e32c-4563-bb6f-e1548771f3e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:05.122934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7e65b3e7-e32c-4563-bb6f-e1548771f3e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:05.229543 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65b3e7-e32c-4563-bb6f-e1548771f3e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:15:05.231413 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65b3e7-e32c-4563-bb6f-e1548771f3e3 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:15:05.250440 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 660/1343] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:15:08.188227 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507878d-165a-4644-bc3f-b7fb0d9a239a None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:08.188762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507878d-165a-4644-bc3f-b7fb0d9a239a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:08.188762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507878d-165a-4644-bc3f-b7fb0d9a239a None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:08.190144 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 684/1344] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:15:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:08.195960 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b43286-4426-4f49-acf6-0e80b9249647 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:08.196449 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b43286-4426-4f49-acf6-0e80b9249647 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:08.196550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b43286-4426-4f49-acf6-0e80b9249647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:08.267685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-21b43286-4426-4f49-acf6-0e80b9249647 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:08.268989 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-21b43286-4426-4f49-acf6-0e80b9249647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:08.288914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:08.367802 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 661/1345] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:15:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:08.406310 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507878d-165a-4644-bc3f-b7fb0d9a239a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:15:08.407856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e507878d-165a-4644-bc3f-b7fb0d9a239a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:08.515662 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507878d-165a-4644-bc3f-b7fb0d9a239a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:15:08.590253 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e215d-dca5-498a-8b8f-ba14e24f4374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:15:08.590874 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e215d-dca5-498a-8b8f-ba14e24f4374 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:08.591157 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e215d-dca5-498a-8b8f-ba14e24f4374 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:08.591432 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e215d-dca5-498a-8b8f-ba14e24f4374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:08.593082 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b41e215d-dca5-498a-8b8f-ba14e24f4374 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:08.635709 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:08.704030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e215d-dca5-498a-8b8f-ba14e24f4374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:15:08.705823 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e215d-dca5-498a-8b8f-ba14e24f4374 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:15:08.724418 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 685/1346] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:15:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:15:12.963499 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1d6eb-a000-4406-b28d-a76ed2a79b8f None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:12.964087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1d6eb-a000-4406-b28d-a76ed2a79b8f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:12.964087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1d6eb-a000-4406-b28d-a76ed2a79b8f None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:12.966022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 662/1347] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:15:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:12.971593 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4a50b-8fa4-4e51-b3c6-f21c3f4d184f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:12.971593 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4a50b-8fa4-4e51-b3c6-f21c3f4d184f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:12.973370 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4a50b-8fa4-4e51-b3c6-f21c3f4d184f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:13.038091 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-23c4a50b-8fa4-4e51-b3c6-f21c3f4d184f None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:13.039310 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-23c4a50b-8fa4-4e51-b3c6-f21c3f4d184f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:13.164607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:13.173648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 686/1348] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:13.206011 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1d6eb-a000-4406-b28d-a76ed2a79b8f None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:15:13.207563 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-bdf1d6eb-a000-4406-b28d-a76ed2a79b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:13.320134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1d6eb-a000-4406-b28d-a76ed2a79b8f None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:15:13.370547 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:13.397734 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14164551-29ef-4dfe-84d9-cb812908d0e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:15:13.398394 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14164551-29ef-4dfe-84d9-cb812908d0e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:13.398684 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14164551-29ef-4dfe-84d9-cb812908d0e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:13.399001 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14164551-29ef-4dfe-84d9-cb812908d0e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:13.400624 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-14164551-29ef-4dfe-84d9-cb812908d0e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:13.514990 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14164551-29ef-4dfe-84d9-cb812908d0e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:15:13.516469 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14164551-29ef-4dfe-84d9-cb812908d0e7 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:15:13.536554 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 663/1349] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:15:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:15:18.458024 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e89d8-6c74-4614-bca5-57538b2d8754 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:18.458473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e89d8-6c74-4614-bca5-57538b2d8754 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:18.458766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e89d8-6c74-4614-bca5-57538b2d8754 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:18.460404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 687/1350] 10.222.0.141 () {54 vars in 926 bytes} [Tue Jul 26 16:15:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:18.466435 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62329e90-45d3-4cdf-a077-46a05a5527cb None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:18.467349 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62329e90-45d3-4cdf-a077-46a05a5527cb None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:18.467803 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62329e90-45d3-4cdf-a077-46a05a5527cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:18.576795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-62329e90-45d3-4cdf-a077-46a05a5527cb None None] MFA Rules not processed for user `fda05b7b9675423e992470819d1c150a`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:18.578486 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-62329e90-45d3-4cdf-a077-46a05a5527cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:18.619206 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:18.732031 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 664/1351] 10.222.0.141 () {58 vars in 1023 bytes} [Tue Jul 26 16:15:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:15:22.902469 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f51fb-0674-4d6e-ad8b-bddcfee221b7 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:22.903322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f51fb-0674-4d6e-ad8b-bddcfee221b7 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:22.903798 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f51fb-0674-4d6e-ad8b-bddcfee221b7 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:22.905398 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 688/1352] 10.222.0.141 () {54 vars in 926 bytes} [Tue Jul 26 16:15:22 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:22.910352 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d6b1c-39b4-4136-8a32-6210b325c5ed None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:22.911395 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d6b1c-39b4-4136-8a32-6210b325c5ed None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:22.911892 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d6b1c-39b4-4136-8a32-6210b325c5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:23.003155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a26d6b1c-39b4-4136-8a32-6210b325c5ed None None] MFA Rules not processed for user `fda05b7b9675423e992470819d1c150a`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:23.005288 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a26d6b1c-39b4-4136-8a32-6210b325c5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:23.080956 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:23.122624 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 665/1353] 10.222.0.141 () {58 vars in 1023 bytes} [Tue Jul 26 16:15:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:24.436070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4a090-17ae-4021-b222-f2e86e7b228b None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:24.436590 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4a090-17ae-4021-b222-f2e86e7b228b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:24.436590 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4a090-17ae-4021-b222-f2e86e7b228b None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:24.437990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 689/1354] 10.222.0.141 () {54 vars in 926 bytes} [Tue Jul 26 16:15:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:24.442847 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad80b9-aa9c-4273-84d3-9c44c9b2ad68 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:24.443277 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad80b9-aa9c-4273-84d3-9c44c9b2ad68 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:24.443526 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad80b9-aa9c-4273-84d3-9c44c9b2ad68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:24.521744 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-faad80b9-aa9c-4273-84d3-9c44c9b2ad68 None None] MFA Rules not processed for user `fda05b7b9675423e992470819d1c150a`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:24.522966 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-faad80b9-aa9c-4273-84d3-9c44c9b2ad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:24.632225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 666/1355] 10.222.0.141 () {58 vars in 1023 bytes} [Tue Jul 26 16:15:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:28.024704 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf2b8d-14fe-4fb9-9b1f-2583f59301cf None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:28.025203 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf2b8d-14fe-4fb9-9b1f-2583f59301cf None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:28.025203 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf2b8d-14fe-4fb9-9b1f-2583f59301cf None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:28.027066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 690/1356] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:15:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:28.032652 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baf202-0e59-4e3a-90df-8b49ae58f5e4 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:28.033491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baf202-0e59-4e3a-90df-8b49ae58f5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:28.033983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baf202-0e59-4e3a-90df-8b49ae58f5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:28.081833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:28.113760 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d2baf202-0e59-4e3a-90df-8b49ae58f5e4 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:28.114977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d2baf202-0e59-4e3a-90df-8b49ae58f5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:28.219837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 667/1357] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:28.275148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68280c-f2f6-4c3f-9130-a5411c461e50 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:28.276134 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68280c-f2f6-4c3f-9130-a5411c461e50 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:28.277165 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68280c-f2f6-4c3f-9130-a5411c461e50 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:28.280582 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 691/1358] 10.222.0.141 () {54 vars in 967 bytes} [Tue Jul 26 16:15:28 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:28.287771 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a345e81-ab46-4035-8e62-7ab00812bb77 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:28.293647 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a345e81-ab46-4035-8e62-7ab00812bb77 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:28.293647 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a345e81-ab46-4035-8e62-7ab00812bb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:28.374163 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-1a345e81-ab46-4035-8e62-7ab00812bb77 None None] MFA Rules not processed for user `f7eac931cabf4921b6dbd42f63b9300f`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:28.375449 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1a345e81-ab46-4035-8e62-7ab00812bb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:28.429666 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:28.501076 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 668/1359] 10.222.0.141 () {58 vars in 1064 bytes} [Tue Jul 26 16:15:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:15:28.508941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68280c-f2f6-4c3f-9130-a5411c461e50 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:15:28.511026 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7f68280c-f2f6-4c3f-9130-a5411c461e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:28.669150 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68280c-f2f6-4c3f-9130-a5411c461e50 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:15:28.753072 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:28.811434 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb9089-0ab2-4656-9dfd-52a9959f6055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:15:28.812097 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb9089-0ab2-4656-9dfd-52a9959f6055 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:28.812380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb9089-0ab2-4656-9dfd-52a9959f6055 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:28.812674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb9089-0ab2-4656-9dfd-52a9959f6055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:28.814357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-eddb9089-0ab2-4656-9dfd-52a9959f6055 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:28.915485 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb9089-0ab2-4656-9dfd-52a9959f6055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:15:28.915742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb9089-0ab2-4656-9dfd-52a9959f6055 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:15:28.936635 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 692/1360] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:15:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:15:31.158706 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab4e9d-6a76-4795-b55a-fa2b5b43378d None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:31.159349 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab4e9d-6a76-4795-b55a-fa2b5b43378d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:31.159349 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab4e9d-6a76-4795-b55a-fa2b5b43378d None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:31.160636 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 669/1361] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:15:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:31.166414 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd0707-6736-43ea-862e-ba2a41815585 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:31.166944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd0707-6736-43ea-862e-ba2a41815585 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:31.167149 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd0707-6736-43ea-862e-ba2a41815585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:31.237256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-25bd0707-6736-43ea-862e-ba2a41815585 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:31.238465 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-25bd0707-6736-43ea-862e-ba2a41815585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:31.277498 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:31.339778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 693/1362] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:31.387101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab4e9d-6a76-4795-b55a-fa2b5b43378d None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:15:31.388818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a4ab4e9d-6a76-4795-b55a-fa2b5b43378d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:31.571881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab4e9d-6a76-4795-b55a-fa2b5b43378d None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:15:31.581316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:31.707191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077be5a-f49f-4096-9329-e769b56f1349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:15:31.707811 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077be5a-f49f-4096-9329-e769b56f1349 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:31.708091 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077be5a-f49f-4096-9329-e769b56f1349 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:31.708363 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077be5a-f49f-4096-9329-e769b56f1349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:31.710005 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7077be5a-f49f-4096-9329-e769b56f1349 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:31.805768 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077be5a-f49f-4096-9329-e769b56f1349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:15:31.807413 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077be5a-f49f-4096-9329-e769b56f1349 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:15:31.825968 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 670/1363] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:15:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:15:34.302136 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dea1f7-4e11-45b4-8330-cdde199f5d55 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:34.302637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dea1f7-4e11-45b4-8330-cdde199f5d55 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:34.302637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dea1f7-4e11-45b4-8330-cdde199f5d55 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:34.308702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 694/1364] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:15:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:34.309906 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d3654-682d-45f4-a4b6-54282e2f5a23 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:34.311891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d3654-682d-45f4-a4b6-54282e2f5a23 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:34.311891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d3654-682d-45f4-a4b6-54282e2f5a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:34.332232 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:34.390323 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-f98d3654-682d-45f4-a4b6-54282e2f5a23 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:34.391658 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f98d3654-682d-45f4-a4b6-54282e2f5a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:34.494203 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 671/1365] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:34.540021 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b0861-0020-49bf-9a32-14d507a9624c None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:34.541024 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b0861-0020-49bf-9a32-14d507a9624c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:34.541686 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b0861-0020-49bf-9a32-14d507a9624c None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:34.543637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 695/1366] 10.222.0.141 () {54 vars in 967 bytes} [Tue Jul 26 16:15:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:34.548604 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebe9ed-3f47-4d95-a794-fb15a7cdfae1 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:34.548917 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebe9ed-3f47-4d95-a794-fb15a7cdfae1 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:34.549196 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebe9ed-3f47-4d95-a794-fb15a7cdfae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:34.631668 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ccebe9ed-3f47-4d95-a794-fb15a7cdfae1 None None] MFA Rules not processed for user `f7eac931cabf4921b6dbd42f63b9300f`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:34.634663 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ccebe9ed-3f47-4d95-a794-fb15a7cdfae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:34.669316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:34.755090 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 672/1367] 10.222.0.141 () {58 vars in 1064 bytes} [Tue Jul 26 16:15:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:34.763282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b0861-0020-49bf-9a32-14d507a9624c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:15:34.764860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c56b0861-0020-49bf-9a32-14d507a9624c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:34.930690 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b0861-0020-49bf-9a32-14d507a9624c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:15:34.950014 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:35.046358 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993ff09-85b3-4d12-bd47-1e045449062f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:15:35.046976 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993ff09-85b3-4d12-bd47-1e045449062f service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:35.047508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993ff09-85b3-4d12-bd47-1e045449062f service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:35.047780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993ff09-85b3-4d12-bd47-1e045449062f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:35.049446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c993ff09-85b3-4d12-bd47-1e045449062f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:35.146703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993ff09-85b3-4d12-bd47-1e045449062f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:15:35.149348 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993ff09-85b3-4d12-bd47-1e045449062f service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:15:35.170011 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 696/1368] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:15:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:15:36.143558 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bca6a-60bc-49c3-aa6d-ac42d3295187 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:36.144096 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bca6a-60bc-49c3-aa6d-ac42d3295187 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:36.144096 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bca6a-60bc-49c3-aa6d-ac42d3295187 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:36.145651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 673/1369] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:15:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:36.150692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9389f04-5eda-4b4a-bda5-18f90c772da4 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:36.151204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9389f04-5eda-4b4a-bda5-18f90c772da4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:36.151454 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9389f04-5eda-4b4a-bda5-18f90c772da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:36.191425 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:36.226977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-e9389f04-5eda-4b4a-bda5-18f90c772da4 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:36.228356 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e9389f04-5eda-4b4a-bda5-18f90c772da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:36.332498 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 697/1370] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:36.685773 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d77a4f-d4ca-4747-a0d0-058a4888c2d7 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:36.685773 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d77a4f-d4ca-4747-a0d0-058a4888c2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:36.685773 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d77a4f-d4ca-4747-a0d0-058a4888c2d7 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:36.687787 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 674/1371] 10.222.0.141 () {54 vars in 969 bytes} [Tue Jul 26 16:15:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:36.691590 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcc122-9a3b-4112-97a1-ce6560138e38 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:36.691986 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcc122-9a3b-4112-97a1-ce6560138e38 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:36.692369 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcc122-9a3b-4112-97a1-ce6560138e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:36.777171 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-bdbcc122-9a3b-4112-97a1-ce6560138e38 None None] MFA Rules not processed for user `bb13d9d5d05a456fb2cb33a380c505f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:36.778650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-bdbcc122-9a3b-4112-97a1-ce6560138e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:36.831625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:36.864124 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 698/1372] 10.222.0.141 () {58 vars in 1066 bytes} [Tue Jul 26 16:15:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:15:36.872094 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d77a4f-d4ca-4747-a0d0-058a4888c2d7 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:15:36.873737 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b0d77a4f-d4ca-4747-a0d0-058a4888c2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:36.997105 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d77a4f-d4ca-4747-a0d0-058a4888c2d7 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:15:37.039031 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:37.076640 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13575196-bbaa-40a2-a826-67d6bd8e7c64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:15:37.077509 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13575196-bbaa-40a2-a826-67d6bd8e7c64 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:37.077786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13575196-bbaa-40a2-a826-67d6bd8e7c64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:37.078060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13575196-bbaa-40a2-a826-67d6bd8e7c64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:37.079694 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-13575196-bbaa-40a2-a826-67d6bd8e7c64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:37.201753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13575196-bbaa-40a2-a826-67d6bd8e7c64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:15:37.203274 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13575196-bbaa-40a2-a826-67d6bd8e7c64 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:15:37.355233 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 675/1373] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:15:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:15:37.380512 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba3d55-4bb4-41b5-b1b6-1b6dab09b0b3 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:37.381050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba3d55-4bb4-41b5-b1b6-1b6dab09b0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:37.381437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba3d55-4bb4-41b5-b1b6-1b6dab09b0b3 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:37.385016 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 699/1374] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:15:37 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:37.388213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed4e36-a26a-4362-9628-f0a86f3a3e20 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:37.388516 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed4e36-a26a-4362-9628-f0a86f3a3e20 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:37.388806 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed4e36-a26a-4362-9628-f0a86f3a3e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:37.458736 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-67ed4e36-a26a-4362-9628-f0a86f3a3e20 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:37.459965 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-67ed4e36-a26a-4362-9628-f0a86f3a3e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:37.482477 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:37.561188 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 676/1375] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:37.602833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba3d55-4bb4-41b5-b1b6-1b6dab09b0b3 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:15:37.605512 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dbba3d55-4bb4-41b5-b1b6-1b6dab09b0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:37.759505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba3d55-4bb4-41b5-b1b6-1b6dab09b0b3 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:15:37.810129 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:37.872172 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ab204-d562-41dc-a491-f80f6f7782af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:15:37.872820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ab204-d562-41dc-a491-f80f6f7782af service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:37.873103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ab204-d562-41dc-a491-f80f6f7782af service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:37.873374 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ab204-d562-41dc-a491-f80f6f7782af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:37.875002 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dd8ab204-d562-41dc-a491-f80f6f7782af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:37.967402 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ab204-d562-41dc-a491-f80f6f7782af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:15:37.969035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ab204-d562-41dc-a491-f80f6f7782af service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:15:37.987786 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 700/1376] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:15:40.164553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25702ac-53a4-403f-a9be-0fde0e482cdf None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:40.165092 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25702ac-53a4-403f-a9be-0fde0e482cdf None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:40.165209 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25702ac-53a4-403f-a9be-0fde0e482cdf None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:40.167171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 677/1377] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:15:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:40.172818 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b0141-eb54-47e9-8b30-fe02c8f094e8 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:40.173245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b0141-eb54-47e9-8b30-fe02c8f094e8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:40.173379 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b0141-eb54-47e9-8b30-fe02c8f094e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:40.239669 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-de2b0141-eb54-47e9-8b30-fe02c8f094e8 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:40.240816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-de2b0141-eb54-47e9-8b30-fe02c8f094e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:40.247423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:40.344155 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 701/1378] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:40.388549 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25702ac-53a4-403f-a9be-0fde0e482cdf None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:15:40.390091 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d25702ac-53a4-403f-a9be-0fde0e482cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:40.556111 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25702ac-53a4-403f-a9be-0fde0e482cdf None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:15:40.559786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:40.675092 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6372613-4ab0-4242-b899-13dc0dc741cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:15:40.675712 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6372613-4ab0-4242-b899-13dc0dc741cb service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:40.675990 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6372613-4ab0-4242-b899-13dc0dc741cb service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:40.676260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6372613-4ab0-4242-b899-13dc0dc741cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:40.677905 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d6372613-4ab0-4242-b899-13dc0dc741cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:40.767550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6372613-4ab0-4242-b899-13dc0dc741cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:15:40.769730 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6372613-4ab0-4242-b899-13dc0dc741cb service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:15:40.787336 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 678/1379] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:15:42.997939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce6d95-923a-4682-83ae-77c1d0690000 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:42.998513 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce6d95-923a-4682-83ae-77c1d0690000 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:42.998513 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce6d95-923a-4682-83ae-77c1d0690000 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:42.999994 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 702/1380] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:15:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:43.005088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39886f9e-0e4c-4898-a826-152dc8e6a86d None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:43.005536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39886f9e-0e4c-4898-a826-152dc8e6a86d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:43.005639 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39886f9e-0e4c-4898-a826-152dc8e6a86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:43.017826 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:43.083493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-39886f9e-0e4c-4898-a826-152dc8e6a86d None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:43.084733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-39886f9e-0e4c-4898-a826-152dc8e6a86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:43.193434 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 679/1381] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:43.239967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce6d95-923a-4682-83ae-77c1d0690000 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:15:43.241499 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d9ce6d95-923a-4682-83ae-77c1d0690000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:43.389135 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:43.400369 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce6d95-923a-4682-83ae-77c1d0690000 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:15:43.523073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c405623-e52d-4728-8d49-948930a34337 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:15:43.523665 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c405623-e52d-4728-8d49-948930a34337 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:43.523971 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c405623-e52d-4728-8d49-948930a34337 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:43.524241 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c405623-e52d-4728-8d49-948930a34337 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:43.526501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7c405623-e52d-4728-8d49-948930a34337 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:43.621786 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c405623-e52d-4728-8d49-948930a34337 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:15:43.623416 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c405623-e52d-4728-8d49-948930a34337 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:15:43.634598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:43.643701 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 703/1382] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:15:45.850152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f5e35-7dc8-47ff-a2ef-1ce04076f6ec None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:45.850699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f5e35-7dc8-47ff-a2ef-1ce04076f6ec None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:45.850699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f5e35-7dc8-47ff-a2ef-1ce04076f6ec None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:45.852057 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 680/1383] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:15:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:45.857263 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e06504-57d0-46a4-a82f-84589b713d8e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:45.857784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e06504-57d0-46a4-a82f-84589b713d8e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:45.857958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e06504-57d0-46a4-a82f-84589b713d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:45.925825 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d5e06504-57d0-46a4-a82f-84589b713d8e None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:45.928830 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d5e06504-57d0-46a4-a82f-84589b713d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:46.027366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 704/1384] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:46.069449 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f5e35-7dc8-47ff-a2ef-1ce04076f6ec None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:15:46.070981 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7a6f5e35-7dc8-47ff-a2ef-1ce04076f6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:46.164270 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:46.225781 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f5e35-7dc8-47ff-a2ef-1ce04076f6ec None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:15:46.362258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e8aa2-0859-4516-963a-06d533c3f87a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:15:46.362906 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e8aa2-0859-4516-963a-06d533c3f87a service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:46.363251 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e8aa2-0859-4516-963a-06d533c3f87a service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:46.363570 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e8aa2-0859-4516-963a-06d533c3f87a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:46.365429 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9b9e8aa2-0859-4516-963a-06d533c3f87a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:46.423269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:46.470710 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e8aa2-0859-4516-963a-06d533c3f87a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:15:46.472300 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e8aa2-0859-4516-963a-06d533c3f87a service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:15:46.491329 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 681/1385] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:15:48.517177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea526f-e61b-430b-b8cb-fe8ccafc5968 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:48.517912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea526f-e61b-430b-b8cb-fe8ccafc5968 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:48.517912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea526f-e61b-430b-b8cb-fe8ccafc5968 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:48.519028 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 705/1386] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:15:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:48.524316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca68223-6e8d-4fea-80ef-002107947097 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:48.524898 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca68223-6e8d-4fea-80ef-002107947097 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:48.524898 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca68223-6e8d-4fea-80ef-002107947097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:48.591306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-aca68223-6e8d-4fea-80ef-002107947097 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:48.592553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-aca68223-6e8d-4fea-80ef-002107947097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:48.705950 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 682/1387] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:48.750116 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea526f-e61b-430b-b8cb-fe8ccafc5968 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:15:48.751637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1bea526f-e61b-430b-b8cb-fe8ccafc5968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:48.839272 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:48.923919 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea526f-e61b-430b-b8cb-fe8ccafc5968 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:15:49.050136 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb0ff5-e8c8-42e2-a903-26e5d256b44f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:15:49.050728 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb0ff5-e8c8-42e2-a903-26e5d256b44f service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:49.051086 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb0ff5-e8c8-42e2-a903-26e5d256b44f service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:49.051438 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb0ff5-e8c8-42e2-a903-26e5d256b44f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:49.053583 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-83fb0ff5-e8c8-42e2-a903-26e5d256b44f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:49.104957 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:49.164509 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb0ff5-e8c8-42e2-a903-26e5d256b44f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:15:49.167466 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb0ff5-e8c8-42e2-a903-26e5d256b44f service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:15:49.190483 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 706/1388] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:15:51.685475 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfa13e-7197-4ecd-b365-dab3b8a980f0 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:51.686018 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfa13e-7197-4ecd-b365-dab3b8a980f0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:51.686018 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfa13e-7197-4ecd-b365-dab3b8a980f0 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:51.687367 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 683/1389] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:15:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:51.692573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118b265-8d99-4871-9c7a-5f7f652744df None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:51.693049 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118b265-8d99-4871-9c7a-5f7f652744df None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:51.693162 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118b265-8d99-4871-9c7a-5f7f652744df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:51.758957 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-1118b265-8d99-4871-9c7a-5f7f652744df None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:51.760204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1118b265-8d99-4871-9c7a-5f7f652744df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:51.859397 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 707/1390] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:51.903401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfa13e-7197-4ecd-b365-dab3b8a980f0 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:15:51.904965 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a3bfa13e-7197-4ecd-b365-dab3b8a980f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:51.938810 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:52.051930 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfa13e-7197-4ecd-b365-dab3b8a980f0 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:15:52.152814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:52.164065 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5db7d0-3a32-4758-9e65-d4b38fc382da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:15:52.164738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5db7d0-3a32-4758-9e65-d4b38fc382da service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:52.167762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5db7d0-3a32-4758-9e65-d4b38fc382da service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:52.167762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5db7d0-3a32-4758-9e65-d4b38fc382da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:52.167762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4a5db7d0-3a32-4758-9e65-d4b38fc382da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:52.258585 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5db7d0-3a32-4758-9e65-d4b38fc382da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:15:52.260722 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5db7d0-3a32-4758-9e65-d4b38fc382da service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:15:52.279050 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 684/1391] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:15:52.726656 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da481d3f-a6a7-4b94-9e14-7d095c11c511 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:52.727167 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da481d3f-a6a7-4b94-9e14-7d095c11c511 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:52.727167 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da481d3f-a6a7-4b94-9e14-7d095c11c511 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:52.729171 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 708/1392] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:15:52 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:52.734561 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed180426-1905-4d4a-b316-8c526f124820 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:52.735035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed180426-1905-4d4a-b316-8c526f124820 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:52.735175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed180426-1905-4d4a-b316-8c526f124820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:52.804940 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ed180426-1905-4d4a-b316-8c526f124820 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:52.806156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ed180426-1905-4d4a-b316-8c526f124820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:52.865378 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:52.904486 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 685/1393] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:52.959440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bbaf9-de62-4a78-8e94-df5fdcf78ce3 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:52.959826 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bbaf9-de62-4a78-8e94-df5fdcf78ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:52.960106 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bbaf9-de62-4a78-8e94-df5fdcf78ce3 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:52.961702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 709/1394] 10.222.0.141 () {54 vars in 971 bytes} [Tue Jul 26 16:15:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:52.966647 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b49a97-aad5-40ad-891e-22ff6ac26508 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:52.967005 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b49a97-aad5-40ad-891e-22ff6ac26508 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:52.967340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b49a97-aad5-40ad-891e-22ff6ac26508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:53.042217 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-50b49a97-aad5-40ad-891e-22ff6ac26508 None None] MFA Rules not processed for user `5d25aebc2bbc47b5adb7200275c98d90`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:53.043379 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-50b49a97-aad5-40ad-891e-22ff6ac26508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:53.120415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 686/1395] 10.222.0.141 () {58 vars in 1068 bytes} [Tue Jul 26 16:15:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:53.127752 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bbaf9-de62-4a78-8e94-df5fdcf78ce3 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:15:53.129319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d07bbaf9-de62-4a78-8e94-df5fdcf78ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:53.142936 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:53.233530 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bbaf9-de62-4a78-8e94-df5fdcf78ce3 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:15:53.308860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c711e-5ca7-4a28-9dd5-586625d438c7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d25aebc2bbc47b5adb7200275c98d90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:15:53.309394 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c711e-5ca7-4a28-9dd5-586625d438c7 service glance] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:53.309724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c711e-5ca7-4a28-9dd5-586625d438c7 service glance] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:53.310026 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c711e-5ca7-4a28-9dd5-586625d438c7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:53.311657 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9c4c711e-5ca7-4a28-9dd5-586625d438c7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:53.380545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:53.422243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c711e-5ca7-4a28-9dd5-586625d438c7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:15:53.423693 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c711e-5ca7-4a28-9dd5-586625d438c7 service glance] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:15:53.441688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 710/1396] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:15:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:15:54.281870 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66b89b-d360-45e4-bc78-4ba02d86f5be None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:54.282337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66b89b-d360-45e4-bc78-4ba02d86f5be None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:54.282454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66b89b-d360-45e4-bc78-4ba02d86f5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:54.356072 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ba66b89b-d360-45e4-bc78-4ba02d86f5be None None] MFA Rules not processed for user `02af03095e48472d96a995a530e78035`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:54.357334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ba66b89b-d360-45e4-bc78-4ba02d86f5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:54.365961 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:54.448272 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 687/1397] 10.222.0.141 () {58 vars in 1014 bytes} [Tue Jul 26 16:15:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:54.474099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8afa5-504d-455f-99f9-3db21543a2a0 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:54.474099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8afa5-504d-455f-99f9-3db21543a2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:54.474099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8afa5-504d-455f-99f9-3db21543a2a0 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:54.474099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 711/1398] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:15:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:54.476622 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21aa80e-f591-400f-8545-480a7e6458f4 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:54.476938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21aa80e-f591-400f-8545-480a7e6458f4 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:54.477296 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21aa80e-f591-400f-8545-480a7e6458f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:54.491392 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99ed84-b3ff-458e-bae2-57ec384bf1c4 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:54.491703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99ed84-b3ff-458e-bae2-57ec384bf1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:54.491978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99ed84-b3ff-458e-bae2-57ec384bf1c4 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:54.493362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 712/1399] 10.222.0.141 () {54 vars in 948 bytes} [Tue Jul 26 16:15:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:54.500217 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f714acc-5268-4bee-8b9c-fca24a45ab60 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:54.500496 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f714acc-5268-4bee-8b9c-fca24a45ab60 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:54.500869 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f714acc-5268-4bee-8b9c-fca24a45ab60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:54.551353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e21aa80e-f591-400f-8545-480a7e6458f4 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:54.552484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e21aa80e-f591-400f-8545-480a7e6458f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:54.582349 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-8f714acc-5268-4bee-8b9c-fca24a45ab60 None None] MFA Rules not processed for user `6c5f92f21868436a99a5c7aaa1fc40b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:54.583901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8f714acc-5268-4bee-8b9c-fca24a45ab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:54.652618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 688/1400] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:54.691597 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 713/1401] 10.222.0.141 () {58 vars in 1045 bytes} [Tue Jul 26 16:15:54 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:54.698316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21aa80e-f591-400f-8545-480a7e6458f4 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:15:54.699563 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e21aa80e-f591-400f-8545-480a7e6458f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:54.700611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f714acc-5268-4bee-8b9c-fca24a45ab60 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:15:54.702156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:54.705353 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:54.710392 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f714acc-5268-4bee-8b9c-fca24a45ab60 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:15:54.815371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21aa80e-f591-400f-8545-480a7e6458f4 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:15:54.818673 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d301eec-1081-4963-bb58-8426eb50b942 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c5f92f21868436a99a5c7aaa1fc40b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:15:54.819291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d301eec-1081-4963-bb58-8426eb50b942 service swift] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:54.819565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d301eec-1081-4963-bb58-8426eb50b942 service swift] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:54.819833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d301eec-1081-4963-bb58-8426eb50b942 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:54.821517 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4d301eec-1081-4963-bb58-8426eb50b942 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:54.903891 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d301eec-1081-4963-bb58-8426eb50b942 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:15:54.905516 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d301eec-1081-4963-bb58-8426eb50b942 service swift] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:15:54.916345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 714/1402] 10.222.0.141 () {60 vars in 1389 bytes} [Tue Jul 26 16:15:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 16:15:54.936968 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:54.939691 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485ad93-1c94-4fb2-821f-a5837fe56b0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:15:54.940328 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485ad93-1c94-4fb2-821f-a5837fe56b0b service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:54.940613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485ad93-1c94-4fb2-821f-a5837fe56b0b service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:54.940996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485ad93-1c94-4fb2-821f-a5837fe56b0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:54.942638 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d485ad93-1c94-4fb2-821f-a5837fe56b0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:55.032932 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485ad93-1c94-4fb2-821f-a5837fe56b0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:15:55.034539 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485ad93-1c94-4fb2-821f-a5837fe56b0b service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:15:55.053236 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 689/1403] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:15:57.226531 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f3ee8-5cf8-45be-bf3c-78cd7921f240 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:57.227103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f3ee8-5cf8-45be-bf3c-78cd7921f240 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:57.227103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f3ee8-5cf8-45be-bf3c-78cd7921f240 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:57.228326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 715/1404] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:15:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:15:57.233527 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba4510-97d3-4209-b6cb-3acd4555c62e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:57.234314 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba4510-97d3-4209-b6cb-3acd4555c62e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:57.234596 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba4510-97d3-4209-b6cb-3acd4555c62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:57.312957 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ffba4510-97d3-4209-b6cb-3acd4555c62e None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:15:57.314332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ffba4510-97d3-4209-b6cb-3acd4555c62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:57.400326 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:57.430952 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 690/1405] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:15:57.477685 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f3ee8-5cf8-45be-bf3c-78cd7921f240 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:15:57.479956 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-445f3ee8-5cf8-45be-bf3c-78cd7921f240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:57.517083 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:57.703487 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f3ee8-5cf8-45be-bf3c-78cd7921f240 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:15:57.832861 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:15:57.846949 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32401e5-f273-4ac9-a3d0-bc9c99be28fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:15:57.847894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32401e5-f273-4ac9-a3d0-bc9c99be28fe service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:15:57.848170 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32401e5-f273-4ac9-a3d0-bc9c99be28fe service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:15:57.848444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32401e5-f273-4ac9-a3d0-bc9c99be28fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:15:57.850168 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a32401e5-f273-4ac9-a3d0-bc9c99be28fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:15:57.964093 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32401e5-f273-4ac9-a3d0-bc9c99be28fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:15:57.965982 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32401e5-f273-4ac9-a3d0-bc9c99be28fe service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:15:57.987100 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 716/1406] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:16:00.799245 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e8502-ca00-4758-97cf-18923e7ca201 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:00.799789 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e8502-ca00-4758-97cf-18923e7ca201 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:00.799789 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e8502-ca00-4758-97cf-18923e7ca201 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:00.801192 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 691/1407] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:16:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:16:00.806888 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd887b1-ed46-4ffa-9cf7-96971e08db41 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:00.807329 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd887b1-ed46-4ffa-9cf7-96971e08db41 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:00.807581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd887b1-ed46-4ffa-9cf7-96971e08db41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:00.883422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-1dd887b1-ed46-4ffa-9cf7-96971e08db41 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:16:00.884654 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1dd887b1-ed46-4ffa-9cf7-96971e08db41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:00.956405 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:01.000100 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 717/1408] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:16:01.045199 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e8502-ca00-4758-97cf-18923e7ca201 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:16:01.046743 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2e7e8502-ca00-4758-97cf-18923e7ca201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:01.212822 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e8502-ca00-4758-97cf-18923e7ca201 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:16:01.273104 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:01.340242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04506e66-857e-4da6-8966-fd9ed6f154a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:16:01.340827 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04506e66-857e-4da6-8966-fd9ed6f154a5 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:01.341111 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04506e66-857e-4da6-8966-fd9ed6f154a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:01.341502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04506e66-857e-4da6-8966-fd9ed6f154a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:01.343276 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-04506e66-857e-4da6-8966-fd9ed6f154a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:01.446393 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04506e66-857e-4da6-8966-fd9ed6f154a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:16:01.448525 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04506e66-857e-4da6-8966-fd9ed6f154a5 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:16:01.469101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 692/1409] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:16:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:16:10.998234 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=14 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:11.466951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=73 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:18.913919 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067cc34-bb45-4507-b743-873dbdce9973 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:18.914479 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067cc34-bb45-4507-b743-873dbdce9973 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:18.914479 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067cc34-bb45-4507-b743-873dbdce9973 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:18.915805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 718/1410] 10.222.0.141 () {54 vars in 923 bytes} [Tue Jul 26 16:16:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:16:18.921215 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c202d02-57df-4303-8433-d38933b66357 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:18.921614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c202d02-57df-4303-8433-d38933b66357 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:18.921751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c202d02-57df-4303-8433-d38933b66357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:18.998200 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-2c202d02-57df-4303-8433-d38933b66357 None None] MFA Rules not processed for user `fda05b7b9675423e992470819d1c150a`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:16:18.999332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2c202d02-57df-4303-8433-d38933b66357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:19.102070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 693/1411] 10.222.0.141 () {58 vars in 1020 bytes} [Tue Jul 26 16:16:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:16:19.116324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43066713-692f-41ef-b377-7267ac1f5b98 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:19.116611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43066713-692f-41ef-b377-7267ac1f5b98 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:19.116924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43066713-692f-41ef-b377-7267ac1f5b98 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:19.118797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 719/1412] 10.222.0.141 () {54 vars in 923 bytes} [Tue Jul 26 16:16:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:16:19.123492 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76118d0a-d876-4c5e-b0b0-a364a6d1a54b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:19.123779 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76118d0a-d876-4c5e-b0b0-a364a6d1a54b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:19.124055 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76118d0a-d876-4c5e-b0b0-a364a6d1a54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:19.194767 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:19.197893 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-76118d0a-d876-4c5e-b0b0-a364a6d1a54b None None] MFA Rules not processed for user `f7eac931cabf4921b6dbd42f63b9300f`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:16:19.199106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-76118d0a-d876-4c5e-b0b0-a364a6d1a54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:19.317013 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 694/1413] 10.222.0.141 () {58 vars in 1020 bytes} [Tue Jul 26 16:16:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:16:21.771022 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3332e06-63fc-4614-98b0-676e1c0047a0 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:21.771549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3332e06-63fc-4614-98b0-676e1c0047a0 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:21.771549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3332e06-63fc-4614-98b0-676e1c0047a0 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:21.772849 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 720/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 16:16:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:16:21.778790 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75364c70-a705-44fa-aa63-f682a4e17efc None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:21.779201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75364c70-a705-44fa-aa63-f682a4e17efc None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:21.779343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75364c70-a705-44fa-aa63-f682a4e17efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:21.846152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-75364c70-a705-44fa-aa63-f682a4e17efc None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:16:21.847362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-75364c70-a705-44fa-aa63-f682a4e17efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:21.901084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:21.943303 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 695/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 16:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:16:21.985561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3332e06-63fc-4614-98b0-676e1c0047a0 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:16:21.987073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d3332e06-63fc-4614-98b0-676e1c0047a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:22.130487 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3332e06-63fc-4614-98b0-676e1c0047a0 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:16:22.202694 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:22.242171 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ffedd-deae-46fd-a814-92032697dd43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:16:22.243417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ffedd-deae-46fd-a814-92032697dd43 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:22.243712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ffedd-deae-46fd-a814-92032697dd43 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:22.243987 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ffedd-deae-46fd-a814-92032697dd43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:22.245679 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-366ffedd-deae-46fd-a814-92032697dd43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:22.334101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ffedd-deae-46fd-a814-92032697dd43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:16:22.335733 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ffedd-deae-46fd-a814-92032697dd43 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:16:22.353765 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 721/1416] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:16:23.249443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299f34b-d860-4458-ac6b-237aecc4f387 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:23.249970 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299f34b-d860-4458-ac6b-237aecc4f387 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:23.249970 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299f34b-d860-4458-ac6b-237aecc4f387 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:23.251273 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 696/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 16:16:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:16:23.256132 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e6b44-1986-4c67-b9be-ca7035624940 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:23.256577 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e6b44-1986-4c67-b9be-ca7035624940 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:23.256690 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e6b44-1986-4c67-b9be-ca7035624940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:23.331718 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-110e6b44-1986-4c67-b9be-ca7035624940 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:16:23.332949 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-110e6b44-1986-4c67-b9be-ca7035624940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:23.359848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:23.429548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 722/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 16:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:16:23.583017 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299f34b-d860-4458-ac6b-237aecc4f387 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:16:23.584487 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3299f34b-d860-4458-ac6b-237aecc4f387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:23.733494 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299f34b-d860-4458-ac6b-237aecc4f387 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:16:23.772539 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:23.843284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e44b1-4e07-4bf7-9e51-e54d0c54b35f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:16:23.843814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e44b1-4e07-4bf7-9e51-e54d0c54b35f service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:23.844088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e44b1-4e07-4bf7-9e51-e54d0c54b35f service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:23.844353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e44b1-4e07-4bf7-9e51-e54d0c54b35f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:23.845992 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8a1e44b1-4e07-4bf7-9e51-e54d0c54b35f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:23.935622 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e44b1-4e07-4bf7-9e51-e54d0c54b35f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:16:23.937253 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e44b1-4e07-4bf7-9e51-e54d0c54b35f service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:16:23.954819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 697/1419] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:16:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:16:24.841090 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a552b5-24bd-44b9-a2e8-5a0edfec0e9c None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:24.841660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a552b5-24bd-44b9-a2e8-5a0edfec0e9c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:24.841660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a552b5-24bd-44b9-a2e8-5a0edfec0e9c None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:24.842997 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 723/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 16:16:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:16:24.847959 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537256d2-023e-47a3-94f5-bcf23685ab2c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:24.848341 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537256d2-023e-47a3-94f5-bcf23685ab2c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:24.848539 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537256d2-023e-47a3-94f5-bcf23685ab2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:24.904283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:24.926903 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-537256d2-023e-47a3-94f5-bcf23685ab2c None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:16:24.928140 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-537256d2-023e-47a3-94f5-bcf23685ab2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:25.026314 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 698/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 16:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:16:25.180243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a552b5-24bd-44b9-a2e8-5a0edfec0e9c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:16:25.182333 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e2a552b5-24bd-44b9-a2e8-5a0edfec0e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:25.325418 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a552b5-24bd-44b9-a2e8-5a0edfec0e9c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:16:25.337998 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:25.438130 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19651fe8-2baa-45c2-831c-4bdff537e703 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:16:25.438666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19651fe8-2baa-45c2-831c-4bdff537e703 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:25.438944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19651fe8-2baa-45c2-831c-4bdff537e703 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:25.439209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19651fe8-2baa-45c2-831c-4bdff537e703 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:25.440836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-19651fe8-2baa-45c2-831c-4bdff537e703 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:25.525930 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19651fe8-2baa-45c2-831c-4bdff537e703 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:16:25.527542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19651fe8-2baa-45c2-831c-4bdff537e703 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:16:25.545519 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 724/1422] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:16:26.406597 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01eb0dc-e340-4a2e-a517-5668702e01e4 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:26.407120 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01eb0dc-e340-4a2e-a517-5668702e01e4 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:26.407213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01eb0dc-e340-4a2e-a517-5668702e01e4 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:26.408566 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 699/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 16:16:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:16:26.413491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c067e-086d-4bde-bd04-37bd451bb6ae None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:26.413900 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c067e-086d-4bde-bd04-37bd451bb6ae None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:26.414046 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c067e-086d-4bde-bd04-37bd451bb6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:26.434387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:26.489691 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-de6c067e-086d-4bde-bd04-37bd451bb6ae None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:16:26.490891 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-de6c067e-086d-4bde-bd04-37bd451bb6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:26.586783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 725/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 16:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:16:26.738061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01eb0dc-e340-4a2e-a517-5668702e01e4 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:16:26.739524 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d01eb0dc-e340-4a2e-a517-5668702e01e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:26.847390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:26.883205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01eb0dc-e340-4a2e-a517-5668702e01e4 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:16:26.995110 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7b29d-e368-41d3-94a4-36e251677222 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:16:26.995661 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7b29d-e368-41d3-94a4-36e251677222 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:26.995940 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7b29d-e368-41d3-94a4-36e251677222 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:26.996213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7b29d-e368-41d3-94a4-36e251677222 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:26.997914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-aab7b29d-e368-41d3-94a4-36e251677222 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:27.073246 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:27.086481 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7b29d-e368-41d3-94a4-36e251677222 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:16:27.088620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7b29d-e368-41d3-94a4-36e251677222 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:16:27.107270 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 700/1425] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:16:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:16:27.960013 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b610f3-056f-416e-a31d-97acb69dc71b None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:27.960498 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b610f3-056f-416e-a31d-97acb69dc71b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:27.960602 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b610f3-056f-416e-a31d-97acb69dc71b None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:27.961955 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 726/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 16:16:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:16:27.966806 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039aa02-4b22-418a-abd6-688e6f50d093 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:27.967211 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039aa02-4b22-418a-abd6-688e6f50d093 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:27.967362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039aa02-4b22-418a-abd6-688e6f50d093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:28.042621 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8039aa02-4b22-418a-abd6-688e6f50d093 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:16:28.043839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8039aa02-4b22-418a-abd6-688e6f50d093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:28.138063 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 701/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 16:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:16:28.288600 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b610f3-056f-416e-a31d-97acb69dc71b None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:16:28.290062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-68b610f3-056f-416e-a31d-97acb69dc71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:28.492576 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:28.554345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b610f3-056f-416e-a31d-97acb69dc71b None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:16:28.666832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7a6a3-dca6-45aa-8845-bf67cc3b89b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:16:28.667451 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7a6a3-dca6-45aa-8845-bf67cc3b89b7 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:28.667733 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7a6a3-dca6-45aa-8845-bf67cc3b89b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:28.668003 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7a6a3-dca6-45aa-8845-bf67cc3b89b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:28.669667 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-28d7a6a3-dca6-45aa-8845-bf67cc3b89b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:28.719541 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:28.763327 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7a6a3-dca6-45aa-8845-bf67cc3b89b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:16:28.765036 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7a6a3-dca6-45aa-8845-bf67cc3b89b7 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:16:28.783816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 727/1428] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:16:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:16:29.640331 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e76a45-142a-44fa-a559-44a002f53847 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:29.640866 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e76a45-142a-44fa-a559-44a002f53847 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:29.640973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e76a45-142a-44fa-a559-44a002f53847 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:29.642271 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 702/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 16:16:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:16:29.647322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7266ca7-102d-4e84-ba60-6478980623fb None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:29.647769 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7266ca7-102d-4e84-ba60-6478980623fb None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:29.647883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7266ca7-102d-4e84-ba60-6478980623fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:29.723549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a7266ca7-102d-4e84-ba60-6478980623fb None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:16:29.724835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a7266ca7-102d-4e84-ba60-6478980623fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:29.821837 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 728/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 16:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:16:29.973761 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e76a45-142a-44fa-a559-44a002f53847 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:16:29.975276 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a6e76a45-142a-44fa-a559-44a002f53847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:30.023108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:30.121392 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e76a45-142a-44fa-a559-44a002f53847 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:16:30.233242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc32be7-79e1-4c1c-8415-347c13667b03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:16:30.233820 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc32be7-79e1-4c1c-8415-347c13667b03 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:30.234101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc32be7-79e1-4c1c-8415-347c13667b03 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:30.234400 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc32be7-79e1-4c1c-8415-347c13667b03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:30.236033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6fc32be7-79e1-4c1c-8415-347c13667b03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:30.243099 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:30.324335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc32be7-79e1-4c1c-8415-347c13667b03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:16:30.325965 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc32be7-79e1-4c1c-8415-347c13667b03 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:16:30.343899 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 703/1431] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:16:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:16:31.235797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d3c6c-a036-4134-a22e-6fd618ac398f None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:31.236353 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d3c6c-a036-4134-a22e-6fd618ac398f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:31.236353 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d3c6c-a036-4134-a22e-6fd618ac398f None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:31.237784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 729/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 16:16:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:16:31.242577 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba69d0-90c9-47a4-a5ab-f5cf3eeb5724 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:31.242971 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba69d0-90c9-47a4-a5ab-f5cf3eeb5724 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:31.243134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba69d0-90c9-47a4-a5ab-f5cf3eeb5724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:31.318595 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8cba69d0-90c9-47a4-a5ab-f5cf3eeb5724 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:16:31.319804 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8cba69d0-90c9-47a4-a5ab-f5cf3eeb5724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:31.387368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:31.416010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 704/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 16:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:16:31.565331 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d3c6c-a036-4134-a22e-6fd618ac398f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:16:31.566827 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-536d3c6c-a036-4134-a22e-6fd618ac398f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:31.585581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:31.712434 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d3c6c-a036-4134-a22e-6fd618ac398f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:16:31.798711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:31.824576 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dffe8-543f-4444-8fbc-fd2934105bcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:16:31.825155 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dffe8-543f-4444-8fbc-fd2934105bcf service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:31.825442 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dffe8-543f-4444-8fbc-fd2934105bcf service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:31.825761 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dffe8-543f-4444-8fbc-fd2934105bcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:31.827392 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8b9dffe8-543f-4444-8fbc-fd2934105bcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:31.914912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9dffe8-543f-4444-8fbc-fd2934105bcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:16:31.917085 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9dffe8-543f-4444-8fbc-fd2934105bcf service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:16:31.935295 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 730/1434] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:16:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:16:32.797832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4974e-d189-408b-a1c6-03203318b902 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:32.798397 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4974e-d189-408b-a1c6-03203318b902 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:32.798397 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4974e-d189-408b-a1c6-03203318b902 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:32.799724 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 705/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 16:16:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:16:32.804531 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f995231-e7d9-41b6-b772-a259e35314d6 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:32.804943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f995231-e7d9-41b6-b772-a259e35314d6 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:32.805118 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f995231-e7d9-41b6-b772-a259e35314d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:32.879757 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-3f995231-e7d9-41b6-b772-a259e35314d6 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:16:32.880976 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3f995231-e7d9-41b6-b772-a259e35314d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:32.923528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:32.977740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 731/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 16:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:16:33.127924 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4974e-d189-408b-a1c6-03203318b902 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:16:33.129522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-78b4974e-d189-408b-a1c6-03203318b902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:33.271457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4974e-d189-408b-a1c6-03203318b902 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:16:33.324215 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:33.384337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402ec0f-0ccb-43a5-8fc4-aa152223df96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:16:33.385502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402ec0f-0ccb-43a5-8fc4-aa152223df96 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:33.385790 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402ec0f-0ccb-43a5-8fc4-aa152223df96 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:33.386065 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402ec0f-0ccb-43a5-8fc4-aa152223df96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:33.387696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5402ec0f-0ccb-43a5-8fc4-aa152223df96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:33.474715 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402ec0f-0ccb-43a5-8fc4-aa152223df96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:16:33.476318 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402ec0f-0ccb-43a5-8fc4-aa152223df96 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:16:33.495007 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 706/1437] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:16:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:16:34.346541 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e92af-fbd1-4cd8-b67d-4317208caf69 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:34.347113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e92af-fbd1-4cd8-b67d-4317208caf69 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:34.347113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e92af-fbd1-4cd8-b67d-4317208caf69 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:34.348469 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 732/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 16:16:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:16:34.353529 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07a7d4-dc4b-4a42-8bc8-558e3439d7c7 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:34.353921 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07a7d4-dc4b-4a42-8bc8-558e3439d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:34.354076 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07a7d4-dc4b-4a42-8bc8-558e3439d7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:34.429734 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-3f07a7d4-dc4b-4a42-8bc8-558e3439d7c7 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:16:34.430938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3f07a7d4-dc4b-4a42-8bc8-558e3439d7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:34.432983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:34.525759 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 707/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 16:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:16:34.683103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e92af-fbd1-4cd8-b67d-4317208caf69 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:16:34.684728 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-441e92af-fbd1-4cd8-b67d-4317208caf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:34.828894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e92af-fbd1-4cd8-b67d-4317208caf69 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:16:34.855515 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:34.941222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9a36e-cf9b-4cb4-8a34-c8abe7ce4a31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:16:34.941775 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9a36e-cf9b-4cb4-8a34-c8abe7ce4a31 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:34.942050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9a36e-cf9b-4cb4-8a34-c8abe7ce4a31 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:34.942317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9a36e-cf9b-4cb4-8a34-c8abe7ce4a31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:34.943925 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c1d9a36e-cf9b-4cb4-8a34-c8abe7ce4a31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:35.032463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9a36e-cf9b-4cb4-8a34-c8abe7ce4a31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:16:35.034097 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9a36e-cf9b-4cb4-8a34-c8abe7ce4a31 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:16:35.052749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 733/1440] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:16:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:16:36.957087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62e73c-1d4b-41b5-b875-f0d486cb2e70 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:36.957633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62e73c-1d4b-41b5-b875-f0d486cb2e70 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:36.957633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62e73c-1d4b-41b5-b875-f0d486cb2e70 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:36.959004 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 708/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 16:16:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:16:36.964473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eaaac7-3c0e-41ba-a671-b013bb44fc04 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:36.964930 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eaaac7-3c0e-41ba-a671-b013bb44fc04 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:36.965046 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eaaac7-3c0e-41ba-a671-b013bb44fc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:37.010480 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:37.034867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-61eaaac7-3c0e-41ba-a671-b013bb44fc04 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:16:37.036070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-61eaaac7-3c0e-41ba-a671-b013bb44fc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:37.136271 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 734/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 16:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:16:37.174087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62e73c-1d4b-41b5-b875-f0d486cb2e70 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:16:37.175614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-dc62e73c-1d4b-41b5-b875-f0d486cb2e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:37.277847 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62e73c-1d4b-41b5-b875-f0d486cb2e70 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:16:37.311031 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:37.355155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6371626-527d-4f28-b01d-06aba955c03a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:16:37.355772 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6371626-527d-4f28-b01d-06aba955c03a service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:37.356056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6371626-527d-4f28-b01d-06aba955c03a service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:37.356332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6371626-527d-4f28-b01d-06aba955c03a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:37.357996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f6371626-527d-4f28-b01d-06aba955c03a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:37.464572 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6371626-527d-4f28-b01d-06aba955c03a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:16:37.466033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6371626-527d-4f28-b01d-06aba955c03a service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:16:37.484421 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 709/1443] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:16:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:16:39.632834 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67a10e-e666-412f-9e9f-42845ab690e3 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:39.633377 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67a10e-e666-412f-9e9f-42845ab690e3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:39.633377 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67a10e-e666-412f-9e9f-42845ab690e3 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:39.635251 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 735/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 16:16:39 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:16:39.642482 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abced862-2b4d-4131-bf04-a501480ae2e2 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:39.642482 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abced862-2b4d-4131-bf04-a501480ae2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:39.642482 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abced862-2b4d-4131-bf04-a501480ae2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:39.711981 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-abced862-2b4d-4131-bf04-a501480ae2e2 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:16:39.713936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-abced862-2b4d-4131-bf04-a501480ae2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:39.727219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:39.811167 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 710/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 16:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:16:39.848804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67a10e-e666-412f-9e9f-42845ab690e3 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:16:39.850389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4f67a10e-e666-412f-9e9f-42845ab690e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:39.953081 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67a10e-e666-412f-9e9f-42845ab690e3 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:16:39.965001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:40.025320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2758ba-2203-46bc-83b5-f1f002edbcd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:16:40.025926 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2758ba-2203-46bc-83b5-f1f002edbcd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:40.026202 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2758ba-2203-46bc-83b5-f1f002edbcd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:40.026470 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2758ba-2203-46bc-83b5-f1f002edbcd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:40.028079 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ea2758ba-2203-46bc-83b5-f1f002edbcd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:40.135858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2758ba-2203-46bc-83b5-f1f002edbcd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:16:40.137338 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2758ba-2203-46bc-83b5-f1f002edbcd6 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:16:40.155378 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 736/1446] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:16:42.498054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e95cef-03dd-45bf-bee4-11916e807aa9 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:42.498609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e95cef-03dd-45bf-bee4-11916e807aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:42.498609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e95cef-03dd-45bf-bee4-11916e807aa9 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:42.499977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 711/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 16:16:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:16:42.505216 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510e09f-0b67-40ee-ac0f-65b3b455842a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:42.505647 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510e09f-0b67-40ee-ac0f-65b3b455842a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:42.505803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510e09f-0b67-40ee-ac0f-65b3b455842a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:42.554803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:42.572380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-1510e09f-0b67-40ee-ac0f-65b3b455842a None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:16:42.573613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1510e09f-0b67-40ee-ac0f-65b3b455842a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:42.669282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 737/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 16:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:16:42.708230 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e95cef-03dd-45bf-bee4-11916e807aa9 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:16:42.709815 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-32e95cef-03dd-45bf-bee4-11916e807aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:42.811849 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e95cef-03dd-45bf-bee4-11916e807aa9 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:16:42.850434 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:42.883237 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c753be8-1538-4e5b-b87c-2977f7aadb53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:16:42.884502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c753be8-1538-4e5b-b87c-2977f7aadb53 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:42.884929 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c753be8-1538-4e5b-b87c-2977f7aadb53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:42.885537 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c753be8-1538-4e5b-b87c-2977f7aadb53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:42.887151 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9c753be8-1538-4e5b-b87c-2977f7aadb53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:42.994438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c753be8-1538-4e5b-b87c-2977f7aadb53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:16:42.996049 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c753be8-1538-4e5b-b87c-2977f7aadb53 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:16:43.014725 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 712/1449] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:16:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:16:45.132235 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a7c25-40a0-4d4b-88d9-7776fb3dc2b2 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:45.132788 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a7c25-40a0-4d4b-88d9-7776fb3dc2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:45.132906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a7c25-40a0-4d4b-88d9-7776fb3dc2b2 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:45.134812 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 738/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 16:16:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:16:45.140105 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cb19a-43a1-4de4-a026-d4bd8c3b093e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:45.140508 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cb19a-43a1-4de4-a026-d4bd8c3b093e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:45.140676 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cb19a-43a1-4de4-a026-d4bd8c3b093e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:45.206422 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-286cb19a-43a1-4de4-a026-d4bd8c3b093e None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:16:45.207546 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-286cb19a-43a1-4de4-a026-d4bd8c3b093e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:45.227562 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:45.302334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 713/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 16:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:16:45.341367 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a7c25-40a0-4d4b-88d9-7776fb3dc2b2 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:16:45.342925 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8c8a7c25-40a0-4d4b-88d9-7776fb3dc2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:45.445935 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a7c25-40a0-4d4b-88d9-7776fb3dc2b2 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:16:45.466087 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:45.518837 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe7d23-fe5f-4fbc-83c3-5a2c5b4af057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:16:45.519448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe7d23-fe5f-4fbc-83c3-5a2c5b4af057 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:45.519728 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe7d23-fe5f-4fbc-83c3-5a2c5b4af057 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:45.520031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe7d23-fe5f-4fbc-83c3-5a2c5b4af057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:45.521675 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-febe7d23-fe5f-4fbc-83c3-5a2c5b4af057 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:45.628800 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe7d23-fe5f-4fbc-83c3-5a2c5b4af057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:16:45.630240 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe7d23-fe5f-4fbc-83c3-5a2c5b4af057 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:16:45.648038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 739/1452] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:16:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:16:47.675992 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d580be-ae67-43f7-95b3-b17d37d52b3d None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:47.676440 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d580be-ae67-43f7-95b3-b17d37d52b3d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:47.676547 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d580be-ae67-43f7-95b3-b17d37d52b3d None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:47.677933 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 714/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 16:16:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:16:47.683549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa01e4-71a0-4238-8653-4feb7262dc67 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:47.684001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa01e4-71a0-4238-8653-4feb7262dc67 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:47.684112 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa01e4-71a0-4238-8653-4feb7262dc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:47.751201 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:47.753891 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-7caa01e4-71a0-4238-8653-4feb7262dc67 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:16:47.755112 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7caa01e4-71a0-4238-8653-4feb7262dc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:47.850269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 740/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 16:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:16:47.888591 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d580be-ae67-43f7-95b3-b17d37d52b3d None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:16:47.890170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-42d580be-ae67-43f7-95b3-b17d37d52b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:47.993978 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d580be-ae67-43f7-95b3-b17d37d52b3d None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:16:48.041913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:48.066885 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19595fc1-142c-4684-bdc7-81530b35be5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:16:48.067496 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19595fc1-142c-4684-bdc7-81530b35be5c service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:48.067775 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19595fc1-142c-4684-bdc7-81530b35be5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:48.068047 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19595fc1-142c-4684-bdc7-81530b35be5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:48.069696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-19595fc1-142c-4684-bdc7-81530b35be5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:48.174770 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19595fc1-142c-4684-bdc7-81530b35be5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:16:48.176191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19595fc1-142c-4684-bdc7-81530b35be5c service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:16:48.193927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 715/1455] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:16:50.257042 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287d7e4-e844-4625-9409-4673729dde04 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:50.257581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287d7e4-e844-4625-9409-4673729dde04 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:50.257581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287d7e4-e844-4625-9409-4673729dde04 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:50.259404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 741/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 16:16:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:16:50.264798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399d944-20ca-4a36-986e-1e0562e2cbdd None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:50.265238 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399d944-20ca-4a36-986e-1e0562e2cbdd None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:50.265340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399d944-20ca-4a36-986e-1e0562e2cbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:50.331520 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c399d944-20ca-4a36-986e-1e0562e2cbdd None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:16:50.332769 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c399d944-20ca-4a36-986e-1e0562e2cbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:50.361133 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:50.429312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 716/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 16:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:16:50.468025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287d7e4-e844-4625-9409-4673729dde04 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:16:50.469695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8287d7e4-e844-4625-9409-4673729dde04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:50.573574 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287d7e4-e844-4625-9409-4673729dde04 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:16:50.601135 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:50.647584 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6cd39-412a-4ceb-b087-d5f8f470c040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:16:50.648261 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6cd39-412a-4ceb-b087-d5f8f470c040 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:50.648539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6cd39-412a-4ceb-b087-d5f8f470c040 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:50.648859 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6cd39-412a-4ceb-b087-d5f8f470c040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:50.650475 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-27f6cd39-412a-4ceb-b087-d5f8f470c040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:50.757684 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6cd39-412a-4ceb-b087-d5f8f470c040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:16:50.759148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6cd39-412a-4ceb-b087-d5f8f470c040 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:16:50.777185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 742/1458] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:16:52.829625 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae206387-3ade-4027-a026-f13141414100 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:52.830206 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae206387-3ade-4027-a026-f13141414100 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:52.830206 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae206387-3ade-4027-a026-f13141414100 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:52.831513 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 717/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 16:16:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:16:52.836800 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd808842-a562-49c8-abc2-1f8d896cfe2e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:52.837222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd808842-a562-49c8-abc2-1f8d896cfe2e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:52.837344 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd808842-a562-49c8-abc2-1f8d896cfe2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:52.901263 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-cd808842-a562-49c8-abc2-1f8d896cfe2e None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:16:52.902462 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-cd808842-a562-49c8-abc2-1f8d896cfe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:52.910515 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:52.999473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 743/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 16:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:16:53.036347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae206387-3ade-4027-a026-f13141414100 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:16:53.037951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ae206387-3ade-4027-a026-f13141414100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:53.144107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae206387-3ade-4027-a026-f13141414100 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:16:53.199223 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:53.216890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5f2ac-61f4-48a4-b870-900e5d610998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:16:53.217504 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5f2ac-61f4-48a4-b870-900e5d610998 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:53.217786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5f2ac-61f4-48a4-b870-900e5d610998 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:53.218058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5f2ac-61f4-48a4-b870-900e5d610998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:53.219725 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-48f5f2ac-61f4-48a4-b870-900e5d610998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:53.327404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5f2ac-61f4-48a4-b870-900e5d610998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:16:53.328888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5f2ac-61f4-48a4-b870-900e5d610998 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:16:53.347477 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 718/1461] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:16:55.397261 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d29b6-f768-4355-980e-51062bc5916a None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:55.397802 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d29b6-f768-4355-980e-51062bc5916a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:55.397802 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d29b6-f768-4355-980e-51062bc5916a None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:55.399786 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 744/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 16:16:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:16:55.405227 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25877cf3-215e-4a34-916f-8f38f2847e61 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:55.405654 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25877cf3-215e-4a34-916f-8f38f2847e61 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:55.405799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25877cf3-215e-4a34-916f-8f38f2847e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:55.469849 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-25877cf3-215e-4a34-916f-8f38f2847e61 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:16:55.471104 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-25877cf3-215e-4a34-916f-8f38f2847e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:55.507674 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:55.565217 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 719/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 16:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:16:55.602736 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d29b6-f768-4355-980e-51062bc5916a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:16:55.604270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f80d29b6-f768-4355-980e-51062bc5916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:55.706809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d29b6-f768-4355-980e-51062bc5916a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:16:55.742522 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:55.778114 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96265f-d168-4709-8fbc-38b791e646e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:16:55.778718 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96265f-d168-4709-8fbc-38b791e646e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:55.778991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96265f-d168-4709-8fbc-38b791e646e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:55.779255 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96265f-d168-4709-8fbc-38b791e646e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:55.780879 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9f96265f-d168-4709-8fbc-38b791e646e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:55.897358 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96265f-d168-4709-8fbc-38b791e646e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:16:55.898788 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96265f-d168-4709-8fbc-38b791e646e4 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:16:55.916213 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 745/1464] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:16:57.931006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61148c44-ca31-43bb-b6f1-01001104c8ca None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:57.931503 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61148c44-ca31-43bb-b6f1-01001104c8ca None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:57.931503 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61148c44-ca31-43bb-b6f1-01001104c8ca None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:57.933001 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 720/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 16:16:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:16:57.938042 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdff32-1db3-4eaa-b3c3-e3ece88d8de9 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:57.938424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdff32-1db3-4eaa-b3c3-e3ece88d8de9 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:57.938581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdff32-1db3-4eaa-b3c3-e3ece88d8de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:58.002475 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-cccdff32-1db3-4eaa-b3c3-e3ece88d8de9 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:16:58.003665 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-cccdff32-1db3-4eaa-b3c3-e3ece88d8de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:58.021137 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:58.103269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 746/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 16:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:16:58.139023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61148c44-ca31-43bb-b6f1-01001104c8ca None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:16:58.140600 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-61148c44-ca31-43bb-b6f1-01001104c8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:58.243258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61148c44-ca31-43bb-b6f1-01001104c8ca None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:16:58.309341 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:16:58.316041 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97902023-743f-4b71-8a67-3927c9278566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:16:58.316686 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97902023-743f-4b71-8a67-3927c9278566 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:16:58.316963 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97902023-743f-4b71-8a67-3927c9278566 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:16:58.317238 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97902023-743f-4b71-8a67-3927c9278566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:16:58.318872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-97902023-743f-4b71-8a67-3927c9278566 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:16:58.426303 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97902023-743f-4b71-8a67-3927c9278566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:16:58.427743 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97902023-743f-4b71-8a67-3927c9278566 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:16:58.446253 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 721/1467] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:17:00.469573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961e652-00e5-488c-9b09-6bfe9b7f5f79 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:00.470222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961e652-00e5-488c-9b09-6bfe9b7f5f79 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:00.470222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961e652-00e5-488c-9b09-6bfe9b7f5f79 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:00.471472 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 747/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 16:17:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:17:00.476612 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9afde-f587-4654-8c1e-36c2d8c98c8d None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:00.477580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9afde-f587-4654-8c1e-36c2d8c98c8d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:00.477690 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9afde-f587-4654-8c1e-36c2d8c98c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:00.543072 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-bcb9afde-f587-4654-8c1e-36c2d8c98c8d None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:17:00.544290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-bcb9afde-f587-4654-8c1e-36c2d8c98c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:00.591716 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:17:00.640035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 722/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 16:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:17:00.677370 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961e652-00e5-488c-9b09-6bfe9b7f5f79 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:17:00.678903 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7961e652-00e5-488c-9b09-6bfe9b7f5f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:00.781331 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961e652-00e5-488c-9b09-6bfe9b7f5f79 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:17:00.828556 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:17:00.855176 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a20e1c-80be-407d-b1b1-c2bc2cffc309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:17:00.855792 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a20e1c-80be-407d-b1b1-c2bc2cffc309 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:00.856070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a20e1c-80be-407d-b1b1-c2bc2cffc309 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:00.856340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a20e1c-80be-407d-b1b1-c2bc2cffc309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:00.857994 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-99a20e1c-80be-407d-b1b1-c2bc2cffc309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:00.965563 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a20e1c-80be-407d-b1b1-c2bc2cffc309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:17:00.966999 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a20e1c-80be-407d-b1b1-c2bc2cffc309 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:17:00.987509 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 748/1470] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:17:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:17:10.649333 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=22 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:17:10.985105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=66 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:17:20.479854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98c172-9c59-43b8-9990-e019bd7cd722 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:20.480389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98c172-9c59-43b8-9990-e019bd7cd722 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:20.480389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98c172-9c59-43b8-9990-e019bd7cd722 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:20.481769 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 723/1471] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:17:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:17:20.486840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd8922-5d9f-4609-a948-d05e5cad2a29 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:20.487281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd8922-5d9f-4609-a948-d05e5cad2a29 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:20.487416 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd8922-5d9f-4609-a948-d05e5cad2a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:20.552448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-96fd8922-5d9f-4609-a948-d05e5cad2a29 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:17:20.553692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-96fd8922-5d9f-4609-a948-d05e5cad2a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:20.649369 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 749/1472] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:17:20.733580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f8f99-4dd6-4436-8cfc-d6c8903420a9 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:20.733805 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f8f99-4dd6-4436-8cfc-d6c8903420a9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:20.734080 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f8f99-4dd6-4436-8cfc-d6c8903420a9 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:20.735417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 724/1473] 10.222.0.141 () {54 vars in 971 bytes} [Tue Jul 26 16:17:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:17:20.740135 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb656a15-8aa9-4583-b15f-6ad4a2e2d041 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:20.740429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb656a15-8aa9-4583-b15f-6ad4a2e2d041 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:20.740733 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb656a15-8aa9-4583-b15f-6ad4a2e2d041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:20.815857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-eb656a15-8aa9-4583-b15f-6ad4a2e2d041 None None] MFA Rules not processed for user `5d25aebc2bbc47b5adb7200275c98d90`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:17:20.817074 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-eb656a15-8aa9-4583-b15f-6ad4a2e2d041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:20.837000 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:17:20.891379 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 750/1474] 10.222.0.141 () {58 vars in 1068 bytes} [Tue Jul 26 16:17:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:17:20.899088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f8f99-4dd6-4436-8cfc-d6c8903420a9 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:17:20.900587 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-db1f8f99-4dd6-4436-8cfc-d6c8903420a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:21.002120 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f8f99-4dd6-4436-8cfc-d6c8903420a9 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:17:21.073668 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31423b-1753-488b-b9df-b6d907058726 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d25aebc2bbc47b5adb7200275c98d90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:17:21.074276 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31423b-1753-488b-b9df-b6d907058726 service glance] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:21.074551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31423b-1753-488b-b9df-b6d907058726 service glance] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:21.074818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31423b-1753-488b-b9df-b6d907058726 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:21.076415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0e31423b-1753-488b-b9df-b6d907058726 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:21.129479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:17:21.183570 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31423b-1753-488b-b9df-b6d907058726 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:17:21.185034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31423b-1753-488b-b9df-b6d907058726 service glance] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:17:21.203852 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 725/1475] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:17:23.272800 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbafc8-7579-4875-b941-db4d2cb704ca None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:23.273323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbafc8-7579-4875-b941-db4d2cb704ca None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:23.273323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbafc8-7579-4875-b941-db4d2cb704ca None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:23.275249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 751/1476] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:17:23 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:17:23.280332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32a98c-4bd0-4d2f-97a9-ea27299abb4e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:23.280763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32a98c-4bd0-4d2f-97a9-ea27299abb4e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:23.280910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32a98c-4bd0-4d2f-97a9-ea27299abb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:23.346057 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ab32a98c-4bd0-4d2f-97a9-ea27299abb4e None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:17:23.347253 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ab32a98c-4bd0-4d2f-97a9-ea27299abb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:23.443250 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 726/1477] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:17:23.466863 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbafc8-7579-4875-b941-db4d2cb704ca None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:17:23.468386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a3bbafc8-7579-4875-b941-db4d2cb704ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:23.593394 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbafc8-7579-4875-b941-db4d2cb704ca None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:17:23.642531 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:17:23.686975 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57042a-9d21-4a4b-b6ea-0d5b929641d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:17:23.687588 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57042a-9d21-4a4b-b6ea-0d5b929641d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:23.687866 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57042a-9d21-4a4b-b6ea-0d5b929641d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:23.688134 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57042a-9d21-4a4b-b6ea-0d5b929641d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:23.688853 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57042a-9d21-4a4b-b6ea-0d5b929641d3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:17:23.690570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: WARNING py.warnings [None req-fb57042a-9d21-4a4b-b6ea-0d5b929641d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:17:23.690570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: warnings.warn(msg) Jul 26 16:17:23.690570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: Jul 26 16:17:23.691712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57042a-9d21-4a4b-b6ea-0d5b929641d3 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:17:23.710121 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 752/1478] 10.222.0.141 () {56 vars in 1113 bytes} [Tue Jul 26 16:17:23 2022] GET /identity/v3/projects => generated 2562 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:17:25.721408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ba74d-056b-413b-bcf2-87bc92c3a76c None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:25.721935 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ba74d-056b-413b-bcf2-87bc92c3a76c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:25.722047 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ba74d-056b-413b-bcf2-87bc92c3a76c None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:25.723357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 727/1479] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:17:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:17:25.729442 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa9637-75b0-4d26-afdf-dc72975dc5ad None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:25.729866 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa9637-75b0-4d26-afdf-dc72975dc5ad None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:25.730032 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa9637-75b0-4d26-afdf-dc72975dc5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:25.795240 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-16aa9637-75b0-4d26-afdf-dc72975dc5ad None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:17:25.796426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-16aa9637-75b0-4d26-afdf-dc72975dc5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:25.894125 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 753/1480] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:17:25.937438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ba74d-056b-413b-bcf2-87bc92c3a76c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:17:25.939011 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-883ba74d-056b-413b-bcf2-87bc92c3a76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:25.949330 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:17:26.085736 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ba74d-056b-413b-bcf2-87bc92c3a76c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:17:26.163497 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:17:26.195756 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e05c70-4801-4240-84a6-f6190f882996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:17:26.197029 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e05c70-4801-4240-84a6-f6190f882996 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:26.197515 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e05c70-4801-4240-84a6-f6190f882996 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:26.198076 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e05c70-4801-4240-84a6-f6190f882996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:26.199758 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-22e05c70-4801-4240-84a6-f6190f882996 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:26.285786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e05c70-4801-4240-84a6-f6190f882996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:17:26.287381 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e05c70-4801-4240-84a6-f6190f882996 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:17:26.305372 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 728/1481] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:17:28.501818 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883a29e-954d-4d2f-bd60-288b6b1380f9 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:28.502388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883a29e-954d-4d2f-bd60-288b6b1380f9 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:28.502504 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883a29e-954d-4d2f-bd60-288b6b1380f9 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:28.503794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 754/1482] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:17:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:17:28.508974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e623bf-332f-4691-9eef-83b218591990 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:28.509417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e623bf-332f-4691-9eef-83b218591990 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:28.509538 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e623bf-332f-4691-9eef-83b218591990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:28.576316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-55e623bf-332f-4691-9eef-83b218591990 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:17:28.577544 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-55e623bf-332f-4691-9eef-83b218591990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:28.623064 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:17:28.673651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 729/1483] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:17:28.710196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883a29e-954d-4d2f-bd60-288b6b1380f9 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:17:28.712267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c883a29e-954d-4d2f-bd60-288b6b1380f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:28.736352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:17:28.816776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883a29e-954d-4d2f-bd60-288b6b1380f9 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:17:28.890308 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddb976-9347-45be-a4dc-381c820369c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:17:28.890928 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddb976-9347-45be-a4dc-381c820369c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:28.891208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddb976-9347-45be-a4dc-381c820369c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:28.891479 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddb976-9347-45be-a4dc-381c820369c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:28.893134 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3dddb976-9347-45be-a4dc-381c820369c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:28.968143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:17:29.001989 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddb976-9347-45be-a4dc-381c820369c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:17:29.004172 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddb976-9347-45be-a4dc-381c820369c3 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:17:29.022832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 755/1484] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:17:31.090486 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806da14-bafe-4380-bdc6-10219b981731 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:31.091031 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806da14-bafe-4380-bdc6-10219b981731 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:31.091031 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806da14-bafe-4380-bdc6-10219b981731 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:31.092414 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 730/1485] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:17:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:17:31.097739 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b66cd-f9e8-4391-9e8c-b3fb5caa4778 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:31.098205 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b66cd-f9e8-4391-9e8c-b3fb5caa4778 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:31.098309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b66cd-f9e8-4391-9e8c-b3fb5caa4778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:31.164031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-427b66cd-f9e8-4391-9e8c-b3fb5caa4778 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:17:31.165324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-427b66cd-f9e8-4391-9e8c-b3fb5caa4778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:31.262087 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 756/1486] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:17:31.300407 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806da14-bafe-4380-bdc6-10219b981731 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:17:31.302006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1806da14-bafe-4380-bdc6-10219b981731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:31.404723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806da14-bafe-4380-bdc6-10219b981731 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:17:31.474580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:17:31.476346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c10980-43f9-44b6-b572-9f9be99701bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:17:31.476989 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c10980-43f9-44b6-b572-9f9be99701bd service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:31.477428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c10980-43f9-44b6-b572-9f9be99701bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:31.477713 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c10980-43f9-44b6-b572-9f9be99701bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:31.479331 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e1c10980-43f9-44b6-b572-9f9be99701bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:31.592155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c10980-43f9-44b6-b572-9f9be99701bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:17:31.593551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c10980-43f9-44b6-b572-9f9be99701bd service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:17:31.611234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 731/1487] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:17:33.713048 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c25c37-0461-426d-934f-66f1de72c65a None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:33.713552 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c25c37-0461-426d-934f-66f1de72c65a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:33.713667 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c25c37-0461-426d-934f-66f1de72c65a None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:33.714988 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 757/1488] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:17:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:17:33.720103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086c7ac-c4d2-4617-b501-22a90e7809d0 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:33.720544 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086c7ac-c4d2-4617-b501-22a90e7809d0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:33.720647 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086c7ac-c4d2-4617-b501-22a90e7809d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:33.787130 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8086c7ac-c4d2-4617-b501-22a90e7809d0 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:17:33.788266 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8086c7ac-c4d2-4617-b501-22a90e7809d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:33.840680 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:17:33.884964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 732/1489] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:17:33.926204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c25c37-0461-426d-934f-66f1de72c65a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:17:33.927791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c1c25c37-0461-426d-934f-66f1de72c65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:33.964297 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:17:34.032531 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c25c37-0461-426d-934f-66f1de72c65a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:17:34.106117 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b632cb-2133-43eb-867a-a7b8b8cc1fe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:17:34.106656 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b632cb-2133-43eb-867a-a7b8b8cc1fe2 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:34.106934 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b632cb-2133-43eb-867a-a7b8b8cc1fe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:34.107206 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b632cb-2133-43eb-867a-a7b8b8cc1fe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:34.108891 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-62b632cb-2133-43eb-867a-a7b8b8cc1fe2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:34.187034 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:17:34.218122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b632cb-2133-43eb-867a-a7b8b8cc1fe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:17:34.219549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b632cb-2133-43eb-867a-a7b8b8cc1fe2 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:17:34.237425 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 758/1490] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:17:36.629795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b23122-4a0a-45d8-9544-957b7fd9b8ee None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:36.630385 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b23122-4a0a-45d8-9544-957b7fd9b8ee None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:36.630385 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b23122-4a0a-45d8-9544-957b7fd9b8ee None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:36.631786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 733/1491] 10.222.0.141 () {54 vars in 931 bytes} [Tue Jul 26 16:17:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:17:36.637564 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669f42a-f1ab-4c14-a45e-a9932c95a866 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:36.638005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669f42a-f1ab-4c14-a45e-a9932c95a866 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:36.638143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669f42a-f1ab-4c14-a45e-a9932c95a866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:36.703768 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-0669f42a-f1ab-4c14-a45e-a9932c95a866 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:17:36.705010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0669f42a-f1ab-4c14-a45e-a9932c95a866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:36.800733 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 759/1492] 10.222.0.141 () {58 vars in 1028 bytes} [Tue Jul 26 16:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:17:36.840503 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b23122-4a0a-45d8-9544-957b7fd9b8ee None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:17:36.842164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-37b23122-4a0a-45d8-9544-957b7fd9b8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:36.944797 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b23122-4a0a-45d8-9544-957b7fd9b8ee None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:17:37.017929 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76ab7b-5b3f-40ab-9b26-7da5b0ea6ac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:17:37.018549 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76ab7b-5b3f-40ab-9b26-7da5b0ea6ac6 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:17:37.018827 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76ab7b-5b3f-40ab-9b26-7da5b0ea6ac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:17:37.019096 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76ab7b-5b3f-40ab-9b26-7da5b0ea6ac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:17:37.020755 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4e76ab7b-5b3f-40ab-9b26-7da5b0ea6ac6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:17:37.029740 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:17:37.128869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76ab7b-5b3f-40ab-9b26-7da5b0ea6ac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:17:37.130312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76ab7b-5b3f-40ab-9b26-7da5b0ea6ac6 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:17:37.147831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 734/1493] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:17:46.798922 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=82 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:17:47.145604 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=50 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:19:14.256848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b098deb-fd40-4465-8832-0a92316cf6ef None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:19:14.257432 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b098deb-fd40-4465-8832-0a92316cf6ef None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:19:14.257432 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b098deb-fd40-4465-8832-0a92316cf6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:19:14.332574 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-3b098deb-fd40-4465-8832-0a92316cf6ef None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:19:14.344495 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3b098deb-fd40-4465-8832-0a92316cf6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:19:14.431107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 760/1494] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:19:14.439347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e1216-4d63-4e04-85ed-e3e2797c4189 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:19:14.439829 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e1216-4d63-4e04-85ed-e3e2797c4189 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:19:14.439935 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e1216-4d63-4e04-85ed-e3e2797c4189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:19:14.517014 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b31e1216-4d63-4e04-85ed-e3e2797c4189 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:19:14.518134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b31e1216-4d63-4e04-85ed-e3e2797c4189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:19:14.611928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 735/1495] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:19:14.617190 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b098deb-fd40-4465-8832-0a92316cf6ef None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:19:14.618399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3b098deb-fd40-4465-8832-0a92316cf6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:19:14.629803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b098deb-fd40-4465-8832-0a92316cf6ef None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:19:14.691090 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:19:14.723404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adedc25-edf5-4e19-a3b9-d48e4ae50d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:19:14.724847 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adedc25-edf5-4e19-a3b9-d48e4ae50d09 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:19:14.725341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adedc25-edf5-4e19-a3b9-d48e4ae50d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:19:14.725910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adedc25-edf5-4e19-a3b9-d48e4ae50d09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:19:14.726613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adedc25-edf5-4e19-a3b9-d48e4ae50d09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:19:14.726921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adedc25-edf5-4e19-a3b9-d48e4ae50d09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:19:14.727927 dv-cinder-851042-1-smb devstack@keystone.service[80601]: WARNING py.warnings [None req-5adedc25-edf5-4e19-a3b9-d48e4ae50d09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:19:14.727927 dv-cinder-851042-1-smb devstack@keystone.service[80601]: warnings.warn(msg) Jul 26 16:19:14.727927 dv-cinder-851042-1-smb devstack@keystone.service[80601]: Jul 26 16:19:14.728869 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adedc25-edf5-4e19-a3b9-d48e4ae50d09 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:19:14.740475 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 761/1496] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:19:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:19:14.748623 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e1216-4d63-4e04-85ed-e3e2797c4189 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:19:14.757644 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e1216-4d63-4e04-85ed-e3e2797c4189 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:19:14.817708 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:19:14.850715 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92abf9-a04e-483a-bd7f-c611a7ce2d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:19:14.851326 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92abf9-a04e-483a-bd7f-c611a7ce2d4f admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:19:14.851606 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92abf9-a04e-483a-bd7f-c611a7ce2d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:19:14.851877 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92abf9-a04e-483a-bd7f-c611a7ce2d4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:19:14.852529 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92abf9-a04e-483a-bd7f-c611a7ce2d4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:19:14.854291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: WARNING py.warnings [None req-9c92abf9-a04e-483a-bd7f-c611a7ce2d4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:19:14.854291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: warnings.warn(msg) Jul 26 16:19:14.854291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: Jul 26 16:19:14.855483 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92abf9-a04e-483a-bd7f-c611a7ce2d4f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:19:14.991327 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 736/1497] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:19:14 2022] POST /identity/v3/projects => generated 380 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:19:14.995494 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adedc25-edf5-4e19-a3b9-d48e4ae50d09 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:19:14.997075 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5adedc25-edf5-4e19-a3b9-d48e4ae50d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:19:15.030953 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adedc25-edf5-4e19-a3b9-d48e4ae50d09 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:19:15.124237 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d902b-a802-493e-a8a3-7444c7e3f2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:19:15.124897 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d902b-a802-493e-a8a3-7444c7e3f2cd admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:19:15.125176 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d902b-a802-493e-a8a3-7444c7e3f2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:19:15.125447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d902b-a802-493e-a8a3-7444c7e3f2cd admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:19:15.126098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d902b-a802-493e-a8a3-7444c7e3f2cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:19:15.127104 dv-cinder-851042-1-smb devstack@keystone.service[80601]: WARNING py.warnings [None req-125d902b-a802-493e-a8a3-7444c7e3f2cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:19:15.127104 dv-cinder-851042-1-smb devstack@keystone.service[80601]: warnings.warn(msg) Jul 26 16:19:15.127104 dv-cinder-851042-1-smb devstack@keystone.service[80601]: Jul 26 16:19:15.128303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d902b-a802-493e-a8a3-7444c7e3f2cd admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:19:15.252494 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 762/1498] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:19:14 2022] POST /identity/v3/users => generated 291 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:19:15.256776 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92abf9-a04e-483a-bd7f-c611a7ce2d4f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:19:15.258215 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9c92abf9-a04e-483a-bd7f-c611a7ce2d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:19:15.319558 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92abf9-a04e-483a-bd7f-c611a7ce2d4f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:19:15.403770 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:19:15.413765 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e24967-ec76-4275-bf00-043ebc13d55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:19:15.414379 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e24967-ec76-4275-bf00-043ebc13d55e admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:19:15.414659 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e24967-ec76-4275-bf00-043ebc13d55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:19:15.414930 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e24967-ec76-4275-bf00-043ebc13d55e admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:19:15.415621 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e24967-ec76-4275-bf00-043ebc13d55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:19:15.416681 dv-cinder-851042-1-smb devstack@keystone.service[80602]: WARNING py.warnings [None req-98e24967-ec76-4275-bf00-043ebc13d55e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:19:15.416681 dv-cinder-851042-1-smb devstack@keystone.service[80602]: warnings.warn(msg) Jul 26 16:19:15.416681 dv-cinder-851042-1-smb devstack@keystone.service[80602]: Jul 26 16:19:15.417561 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e24967-ec76-4275-bf00-043ebc13d55e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:19:15.430030 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 737/1499] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:19:15 2022] GET /identity/v3/roles => generated 1427 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:19:15.434057 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d902b-a802-493e-a8a3-7444c7e3f2cd admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:19:15.435609 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-125d902b-a802-493e-a8a3-7444c7e3f2cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:19:15.447468 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d902b-a802-493e-a8a3-7444c7e3f2cd admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:19:15.472810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:19:15.542109 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bb867-3fd7-43f1-8a5b-90eba4074c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:19:15.542998 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bb867-3fd7-43f1-8a5b-90eba4074c6d admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:19:15.543504 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bb867-3fd7-43f1-8a5b-90eba4074c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:19:15.543827 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bb867-3fd7-43f1-8a5b-90eba4074c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:19:15.544991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bb867-3fd7-43f1-8a5b-90eba4074c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:19:15.546319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: WARNING py.warnings [None req-171bb867-3fd7-43f1-8a5b-90eba4074c6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:19:15.546319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: warnings.warn(msg) Jul 26 16:19:15.546319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: Jul 26 16:19:15.547225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bb867-3fd7-43f1-8a5b-90eba4074c6d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:19:15.559819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 763/1500] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:19:15 2022] GET /identity/v3/roles => generated 1427 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:19:15.564035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e24967-ec76-4275-bf00-043ebc13d55e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:19:15.565591 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-98e24967-ec76-4275-bf00-043ebc13d55e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:19:15.599360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e24967-ec76-4275-bf00-043ebc13d55e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:19:15.690930 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29229529-d8da-40c1-9edf-e49d4c0ae94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:19:15.691525 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29229529-d8da-40c1-9edf-e49d4c0ae94f admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:19:15.691806 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29229529-d8da-40c1-9edf-e49d4c0ae94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:19:15.692082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29229529-d8da-40c1-9edf-e49d4c0ae94f admin admin] PATH_INFO: `/v3/projects/4e54150623ee4d54a25aa4548caec7fa/users/c88962c2ca354683b8e4b6cc2bcd306c/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:19:15.714279 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29229529-d8da-40c1-9edf-e49d4c0ae94f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e54150623ee4d54a25aa4548caec7fa, user_id=c88962c2ca354683b8e4b6cc2bcd306c, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:19:15.715310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: WARNING py.warnings [None req-29229529-d8da-40c1-9edf-e49d4c0ae94f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:19:15.715310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: warnings.warn(msg) Jul 26 16:19:15.715310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: Jul 26 16:19:15.717306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29229529-d8da-40c1-9edf-e49d4c0ae94f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:19:15.812494 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 738/1501] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:19:15 2022] PUT /identity/v3/projects/4e54150623ee4d54a25aa4548caec7fa/users/c88962c2ca354683b8e4b6cc2bcd306c/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:19:15.825081 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7957b6-9511-4425-b01e-39d8a0b563ba None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:19:15.825394 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7957b6-9511-4425-b01e-39d8a0b563ba None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:19:15.825659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7957b6-9511-4425-b01e-39d8a0b563ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:19:15.881818 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-3a7957b6-9511-4425-b01e-39d8a0b563ba None None] MFA Rules not processed for user `c88962c2ca354683b8e4b6cc2bcd306c`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:19:15.883035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3a7957b6-9511-4425-b01e-39d8a0b563ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:19:15.959733 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 764/1502] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:19:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:19:15.972742 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a1d4b-84d1-46fb-9d82-cb350f6e25de None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:19:15.973078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a1d4b-84d1-46fb-9d82-cb350f6e25de None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:19:15.973358 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a1d4b-84d1-46fb-9d82-cb350f6e25de None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:19:15.974698 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 739/1503] 10.222.0.141 () {54 vars in 969 bytes} [Tue Jul 26 16:19:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:19:15.979492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112909ef-021a-42dd-9b6e-47ac8ec04c1d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:19:15.979781 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112909ef-021a-42dd-9b6e-47ac8ec04c1d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:19:15.980062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112909ef-021a-42dd-9b6e-47ac8ec04c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:19:16.011822 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:19:16.056470 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-112909ef-021a-42dd-9b6e-47ac8ec04c1d None None] MFA Rules not processed for user `bb13d9d5d05a456fb2cb33a380c505f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:19:16.057712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-112909ef-021a-42dd-9b6e-47ac8ec04c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:19:16.131869 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 765/1504] 10.222.0.141 () {58 vars in 1066 bytes} [Tue Jul 26 16:19:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:19:16.139658 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a1d4b-84d1-46fb-9d82-cb350f6e25de None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:19:16.141228 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-898a1d4b-84d1-46fb-9d82-cb350f6e25de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:19:16.191021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:19:16.243856 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a1d4b-84d1-46fb-9d82-cb350f6e25de None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:19:16.315500 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903d4c8-fdf4-4b29-befa-bfa95e1218ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:19:16.316114 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903d4c8-fdf4-4b29-befa-bfa95e1218ae service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:19:16.316412 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903d4c8-fdf4-4b29-befa-bfa95e1218ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:19:16.316689 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903d4c8-fdf4-4b29-befa-bfa95e1218ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:19:16.318351 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6903d4c8-fdf4-4b29-befa-bfa95e1218ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:19:16.415683 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903d4c8-fdf4-4b29-befa-bfa95e1218ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:19:16.417148 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903d4c8-fdf4-4b29-befa-bfa95e1218ae service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:19:16.420566 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:19:16.435300 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 740/1505] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:19:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:19:16.479594 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce8ce0-d814-455f-8e2e-b1842f41ea3b None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:19:16.480031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce8ce0-d814-455f-8e2e-b1842f41ea3b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:19:16.480131 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce8ce0-d814-455f-8e2e-b1842f41ea3b None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:19:16.481416 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 766/1506] 10.222.0.141 () {52 vars in 835 bytes} [Tue Jul 26 16:19:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:19:16.484851 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903d4c8-fdf4-4b29-befa-bfa95e1218ae service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:19:16.486083 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6903d4c8-fdf4-4b29-befa-bfa95e1218ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:19:16.586202 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903d4c8-fdf4-4b29-befa-bfa95e1218ae service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:19:16.682125 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec728887-5408-42e5-a344-11d60aef7fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:19:16.682769 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec728887-5408-42e5-a344-11d60aef7fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:19:16.683049 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec728887-5408-42e5-a344-11d60aef7fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:19:16.683326 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec728887-5408-42e5-a344-11d60aef7fb9 admin admin] PATH_INFO: `/v3/users/c88962c2ca354683b8e4b6cc2bcd306c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:19:16.695564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec728887-5408-42e5-a344-11d60aef7fb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88962c2ca354683b8e4b6cc2bcd306c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:19:16.696592 dv-cinder-851042-1-smb devstack@keystone.service[80602]: WARNING py.warnings [None req-ec728887-5408-42e5-a344-11d60aef7fb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:19:16.696592 dv-cinder-851042-1-smb devstack@keystone.service[80602]: warnings.warn(msg) Jul 26 16:19:16.696592 dv-cinder-851042-1-smb devstack@keystone.service[80602]: Jul 26 16:19:16.697850 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec728887-5408-42e5-a344-11d60aef7fb9 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:19:16.707474 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:19:16.908768 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ec728887-5408-42e5-a344-11d60aef7fb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88962c2ca354683b8e4b6cc2bcd306c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:19:16.909311 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ec728887-5408-42e5-a344-11d60aef7fb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88962c2ca354683b8e4b6cc2bcd306c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:19:16.927862 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ec728887-5408-42e5-a344-11d60aef7fb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88962c2ca354683b8e4b6cc2bcd306c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:19:16.940233 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ec728887-5408-42e5-a344-11d60aef7fb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88962c2ca354683b8e4b6cc2bcd306c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:19:17.005889 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ec728887-5408-42e5-a344-11d60aef7fb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88962c2ca354683b8e4b6cc2bcd306c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:19:17.011576 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 741/1507] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:19:16 2022] DELETE /identity/v3/users/c88962c2ca354683b8e4b6cc2bcd306c => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:19:17.016012 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae19a5-e396-4bd4-ba9c-4bcbe753deaa None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:19:17.016332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae19a5-e396-4bd4-ba9c-4bcbe753deaa None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:19:17.016611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae19a5-e396-4bd4-ba9c-4bcbe753deaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:19:17.073211 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-77ae19a5-e396-4bd4-ba9c-4bcbe753deaa None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:19:17.074425 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-77ae19a5-e396-4bd4-ba9c-4bcbe753deaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:19:17.148221 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:19:17.164855 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 767/1508] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:19:17.170162 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec728887-5408-42e5-a344-11d60aef7fb9 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:19:17.171644 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ec728887-5408-42e5-a344-11d60aef7fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:19:17.271367 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec728887-5408-42e5-a344-11d60aef7fb9 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:19:17.325851 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:19:17.344906 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce978079-b589-4425-a5f0-9df55b67b905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:19:17.345528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce978079-b589-4425-a5f0-9df55b67b905 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:19:17.345810 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce978079-b589-4425-a5f0-9df55b67b905 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:19:17.346085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce978079-b589-4425-a5f0-9df55b67b905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:19:17.347708 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ce978079-b589-4425-a5f0-9df55b67b905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:19:17.457769 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce978079-b589-4425-a5f0-9df55b67b905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:19:17.459303 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce978079-b589-4425-a5f0-9df55b67b905 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:19:17.477028 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 742/1509] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:19:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:19:17.928824 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae19a5-e396-4bd4-ba9c-4bcbe753deaa None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:19:17.930306 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-77ae19a5-e396-4bd4-ba9c-4bcbe753deaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:19:17.942106 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae19a5-e396-4bd4-ba9c-4bcbe753deaa None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:19:18.039823 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ad74f-30e1-4acd-bff2-a13a19c77a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:19:18.040964 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ad74f-30e1-4acd-bff2-a13a19c77a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:19:18.041462 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ad74f-30e1-4acd-bff2-a13a19c77a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:19:18.041942 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ad74f-30e1-4acd-bff2-a13a19c77a01 admin admin] PATH_INFO: `/v3/projects/4e54150623ee4d54a25aa4548caec7fa` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:19:18.053265 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ad74f-30e1-4acd-bff2-a13a19c77a01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e54150623ee4d54a25aa4548caec7fa)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:19:18.054305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: WARNING py.warnings [None req-5f3ad74f-30e1-4acd-bff2-a13a19c77a01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:19:18.054305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: warnings.warn(msg) Jul 26 16:19:18.054305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: Jul 26 16:19:18.055515 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ad74f-30e1-4acd-bff2-a13a19c77a01 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:19:18.168679 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5f3ad74f-30e1-4acd-bff2-a13a19c77a01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e54150623ee4d54a25aa4548caec7fa', 'request_id': 'req-5f3ad74f-30e1-4acd-bff2-a13a19c77a01'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:19:18.181736 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5f3ad74f-30e1-4acd-bff2-a13a19c77a01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e54150623ee4d54a25aa4548caec7fa', 'request_id': 'req-5f3ad74f-30e1-4acd-bff2-a13a19c77a01'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:19:18.187780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5f3ad74f-30e1-4acd-bff2-a13a19c77a01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e54150623ee4d54a25aa4548caec7fa', 'request_id': 'req-5f3ad74f-30e1-4acd-bff2-a13a19c77a01'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:19:18.290190 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5f3ad74f-30e1-4acd-bff2-a13a19c77a01 admin admin] The token cache is being invalidate because project 4e54150623ee4d54a25aa4548caec7fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:19:18.290407 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5f3ad74f-30e1-4acd-bff2-a13a19c77a01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:19:18.290832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5f3ad74f-30e1-4acd-bff2-a13a19c77a01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:19:18.292246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 768/1510] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:19:17 2022] DELETE /identity/v3/projects/4e54150623ee4d54a25aa4548caec7fa => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:19:27.474703 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=62 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:19:28.287942 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:21:07.860373 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f652df4-1922-4e03-a3cb-e5251bdafb15 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:07.860991 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f652df4-1922-4e03-a3cb-e5251bdafb15 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:07.860991 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f652df4-1922-4e03-a3cb-e5251bdafb15 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:07.862311 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 743/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 16:21:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:21:07.867853 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005c788-4f30-46ba-a1bf-1919710c850b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:07.868300 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005c788-4f30-46ba-a1bf-1919710c850b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:07.868396 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005c788-4f30-46ba-a1bf-1919710c850b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:07.950331 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c005c788-4f30-46ba-a1bf-1919710c850b None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:21:07.951547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c005c788-4f30-46ba-a1bf-1919710c850b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:21:08.053071 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 769/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 16:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:21:08.207735 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f652df4-1922-4e03-a3cb-e5251bdafb15 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:21:08.210098 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9f652df4-1922-4e03-a3cb-e5251bdafb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:21:08.329605 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f652df4-1922-4e03-a3cb-e5251bdafb15 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:21:08.335274 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a03a7-5a42-4711-9ab1-08e9b190ec03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:21:08.336397 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a03a7-5a42-4711-9ab1-08e9b190ec03 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:08.336737 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a03a7-5a42-4711-9ab1-08e9b190ec03 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:08.337020 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a03a7-5a42-4711-9ab1-08e9b190ec03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:08.345263 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a03a7-5a42-4711-9ab1-08e9b190ec03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:21:08.348247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a03a7-5a42-4711-9ab1-08e9b190ec03 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:21:08.357268 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 744/1513] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:21:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:21:09.192620 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0442ebf-6aa2-4b2f-aace-f5573a0b0fea None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:09.193214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0442ebf-6aa2-4b2f-aace-f5573a0b0fea None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:09.193214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0442ebf-6aa2-4b2f-aace-f5573a0b0fea None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:09.194588 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 770/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 16:21:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:21:09.200047 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d608b05-c3fb-4d55-8d46-e2c522329cf6 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:09.200490 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d608b05-c3fb-4d55-8d46-e2c522329cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:09.200653 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d608b05-c3fb-4d55-8d46-e2c522329cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:09.221092 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-7d608b05-c3fb-4d55-8d46-e2c522329cf6 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:21:09.222281 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7d608b05-c3fb-4d55-8d46-e2c522329cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:21:09.232003 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 745/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 16:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:21:09.385107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0442ebf-6aa2-4b2f-aace-f5573a0b0fea None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:21:09.399789 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0442ebf-6aa2-4b2f-aace-f5573a0b0fea None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:21:09.405217 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c523990-3c22-473e-8ee5-be6b1fe8a36f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:21:09.405821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c523990-3c22-473e-8ee5-be6b1fe8a36f service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:09.406100 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c523990-3c22-473e-8ee5-be6b1fe8a36f service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:09.406376 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c523990-3c22-473e-8ee5-be6b1fe8a36f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:09.414748 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c523990-3c22-473e-8ee5-be6b1fe8a36f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:21:09.416346 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c523990-3c22-473e-8ee5-be6b1fe8a36f service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:21:09.425999 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 771/1516] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:21:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:21:09.965854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03978932-5599-4ca0-bcc7-8e7f871fe22a None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:09.966147 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03978932-5599-4ca0-bcc7-8e7f871fe22a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:09.966430 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03978932-5599-4ca0-bcc7-8e7f871fe22a None None] PATH_INFO: `/v3` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:09.967724 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 746/1517] 10.222.0.39 () {54 vars in 929 bytes} [Tue Jul 26 16:21:09 2022] GET /identity/v3 => generated 256 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:21:09.974047 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9efde9-ffed-4b47-be38-5eacd3c2807b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:09.974336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9efde9-ffed-4b47-be38-5eacd3c2807b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:09.974613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9efde9-ffed-4b47-be38-5eacd3c2807b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:10.033954 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-1c9efde9-ffed-4b47-be38-5eacd3c2807b None None] MFA Rules not processed for user `fda05b7b9675423e992470819d1c150a`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:21:10.035230 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1c9efde9-ffed-4b47-be38-5eacd3c2807b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:21:10.051981 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:21:10.107828 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 772/1518] 10.222.0.39 () {58 vars in 1019 bytes} [Tue Jul 26 16:21:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:21:14.098398 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0e556-d040-4c54-9345-864c0bc369e1 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:14.098915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0e556-d040-4c54-9345-864c0bc369e1 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:14.098915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0e556-d040-4c54-9345-864c0bc369e1 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:14.100250 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 747/1519] 10.222.0.141 () {54 vars in 966 bytes} [Tue Jul 26 16:21:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:21:14.105674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86063875-1fb3-4b5c-a29f-a27df7212160 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:14.106111 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86063875-1fb3-4b5c-a29f-a27df7212160 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:14.106240 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86063875-1fb3-4b5c-a29f-a27df7212160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:14.125566 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-86063875-1fb3-4b5c-a29f-a27df7212160 None None] MFA Rules not processed for user `fda05b7b9675423e992470819d1c150a`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:21:14.126761 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-86063875-1fb3-4b5c-a29f-a27df7212160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:21:14.135309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 773/1520] 10.222.0.141 () {58 vars in 1063 bytes} [Tue Jul 26 16:21:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:21:14.142691 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0e556-d040-4c54-9345-864c0bc369e1 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:21:14.156325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0e556-d040-4c54-9345-864c0bc369e1 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:21:14.161214 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97dca3-669c-4cd0-866a-a2757a2b9e1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda05b7b9675423e992470819d1c150a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:21:14.161810 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97dca3-669c-4cd0-866a-a2757a2b9e1c service placement] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:14.162090 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97dca3-669c-4cd0-866a-a2757a2b9e1c service placement] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:14.162361 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97dca3-669c-4cd0-866a-a2757a2b9e1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:14.171254 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97dca3-669c-4cd0-866a-a2757a2b9e1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:21:14.172866 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97dca3-669c-4cd0-866a-a2757a2b9e1c service placement] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:21:14.182301 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 748/1521] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:21:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:21:20.654988 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d854bd8-b4e8-4396-9bea-b9bfa9c15968 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:20.655591 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d854bd8-b4e8-4396-9bea-b9bfa9c15968 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:20.655591 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d854bd8-b4e8-4396-9bea-b9bfa9c15968 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:20.657214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 774/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 16:21:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:21:20.661804 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b3c5c-5ff3-47a2-a689-1161b4e832de None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:20.662204 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b3c5c-5ff3-47a2-a689-1161b4e832de None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:20.662362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b3c5c-5ff3-47a2-a689-1161b4e832de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:20.681483 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d47b3c5c-5ff3-47a2-a689-1161b4e832de None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:21:20.682685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d47b3c5c-5ff3-47a2-a689-1161b4e832de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:21:20.690485 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 749/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 16:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:21:20.845492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d854bd8-b4e8-4396-9bea-b9bfa9c15968 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:21:20.859599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d854bd8-b4e8-4396-9bea-b9bfa9c15968 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:21:20.865015 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f811e50-3d76-41cf-9150-ca7ad9fcebcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:21:20.865612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f811e50-3d76-41cf-9150-ca7ad9fcebcd service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:20.865884 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f811e50-3d76-41cf-9150-ca7ad9fcebcd service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:20.866151 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f811e50-3d76-41cf-9150-ca7ad9fcebcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:20.875337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f811e50-3d76-41cf-9150-ca7ad9fcebcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:21:20.876926 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f811e50-3d76-41cf-9150-ca7ad9fcebcd service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:21:20.886859 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 775/1524] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:21:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:21:21.703788 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d47ab9-06b3-421d-9a50-1d504b9e8d13 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:21.704331 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d47ab9-06b3-421d-9a50-1d504b9e8d13 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:21.704331 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d47ab9-06b3-421d-9a50-1d504b9e8d13 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:21.705725 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 750/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 16:21:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:21:21.710502 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dff445-f328-4de7-98f0-756d905d8a5e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:21.710928 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dff445-f328-4de7-98f0-756d905d8a5e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:21.711084 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dff445-f328-4de7-98f0-756d905d8a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:21.729811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-73dff445-f328-4de7-98f0-756d905d8a5e None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:21:21.730988 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-73dff445-f328-4de7-98f0-756d905d8a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:21:21.738675 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 776/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 16:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:21:21.890752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d47ab9-06b3-421d-9a50-1d504b9e8d13 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:21:21.906018 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d47ab9-06b3-421d-9a50-1d504b9e8d13 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:21:21.911442 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3e967-8a38-4ecb-99c5-5c9ae8d75730 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:21:21.912053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3e967-8a38-4ecb-99c5-5c9ae8d75730 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:21.912336 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3e967-8a38-4ecb-99c5-5c9ae8d75730 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:21.912612 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3e967-8a38-4ecb-99c5-5c9ae8d75730 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:21.921911 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3e967-8a38-4ecb-99c5-5c9ae8d75730 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:21:21.923492 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3e967-8a38-4ecb-99c5-5c9ae8d75730 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:21:21.933526 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 751/1527] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:21:25.890690 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57203977-f2fd-4420-aa2c-c9ef8a7e6af5 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:25.891229 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57203977-f2fd-4420-aa2c-c9ef8a7e6af5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:25.891229 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57203977-f2fd-4420-aa2c-c9ef8a7e6af5 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:25.892588 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 777/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 16:21:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:21:25.897727 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d545e-2267-4c05-9cd9-8b0c2b797010 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:25.898134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d545e-2267-4c05-9cd9-8b0c2b797010 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:25.898279 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d545e-2267-4c05-9cd9-8b0c2b797010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:25.917108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b65d545e-2267-4c05-9cd9-8b0c2b797010 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:21:25.918299 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b65d545e-2267-4c05-9cd9-8b0c2b797010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:21:25.928008 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 752/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 16:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:21:25.999612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57203977-f2fd-4420-aa2c-c9ef8a7e6af5 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:21:26.001352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-57203977-f2fd-4420-aa2c-c9ef8a7e6af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:21:26.079159 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57203977-f2fd-4420-aa2c-c9ef8a7e6af5 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:21:26.082627 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95baf6fb-853a-4beb-b112-fafbd5f5fc54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:21:26.083232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baf6fb-853a-4beb-b112-fafbd5f5fc54 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:26.083511 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baf6fb-853a-4beb-b112-fafbd5f5fc54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:26.083783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baf6fb-853a-4beb-b112-fafbd5f5fc54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:26.092498 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95baf6fb-853a-4beb-b112-fafbd5f5fc54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:21:26.093961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95baf6fb-853a-4beb-b112-fafbd5f5fc54 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:21:26.103707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 778/1530] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:21:28.092592 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edbe07-9509-4d7d-b54f-5a447b292bfe None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:28.093146 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edbe07-9509-4d7d-b54f-5a447b292bfe None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:28.093146 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edbe07-9509-4d7d-b54f-5a447b292bfe None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:28.094460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 753/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 16:21:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:21:28.099541 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d65d1-1222-4db1-829e-5af2de189d89 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:28.099962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d65d1-1222-4db1-829e-5af2de189d89 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:28.100103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d65d1-1222-4db1-829e-5af2de189d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:28.120672 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-178d65d1-1222-4db1-829e-5af2de189d89 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:21:28.121875 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-178d65d1-1222-4db1-829e-5af2de189d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:21:28.129709 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 779/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 16:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:21:28.165349 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edbe07-9509-4d7d-b54f-5a447b292bfe None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:21:28.176151 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edbe07-9509-4d7d-b54f-5a447b292bfe None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:21:28.179633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e71226-f2c2-44ad-b626-c92d3b46841e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:21:28.180228 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e71226-f2c2-44ad-b626-c92d3b46841e service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:28.180505 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e71226-f2c2-44ad-b626-c92d3b46841e service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:28.180813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e71226-f2c2-44ad-b626-c92d3b46841e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:28.189947 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e71226-f2c2-44ad-b626-c92d3b46841e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:21:28.191351 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e71226-f2c2-44ad-b626-c92d3b46841e service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:21:28.201071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 754/1533] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:21:31.979389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ebfe8-aaba-4cd5-9c73-0aec913e4d7a None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:31.979889 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ebfe8-aaba-4cd5-9c73-0aec913e4d7a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:31.979994 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ebfe8-aaba-4cd5-9c73-0aec913e4d7a None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:31.981307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 780/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 16:21:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:21:31.986369 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a800720-44d6-4c23-986d-5b7b17c65d5b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:31.986773 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a800720-44d6-4c23-986d-5b7b17c65d5b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:31.986917 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a800720-44d6-4c23-986d-5b7b17c65d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:32.006587 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-7a800720-44d6-4c23-986d-5b7b17c65d5b None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:21:32.007769 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7a800720-44d6-4c23-986d-5b7b17c65d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:21:32.016358 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 755/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 16:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:21:32.317880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ebfe8-aaba-4cd5-9c73-0aec913e4d7a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:21:32.319596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f78ebfe8-aaba-4cd5-9c73-0aec913e4d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:21:32.383854 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:21:32.397017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ebfe8-aaba-4cd5-9c73-0aec913e4d7a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:21:32.401423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8896b68-23c0-4810-8bba-1ab7c860876e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:21:32.402039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8896b68-23c0-4810-8bba-1ab7c860876e service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:32.402323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8896b68-23c0-4810-8bba-1ab7c860876e service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:32.402598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8896b68-23c0-4810-8bba-1ab7c860876e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:32.411696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8896b68-23c0-4810-8bba-1ab7c860876e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:21:32.413152 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8896b68-23c0-4810-8bba-1ab7c860876e service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:21:32.423621 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 781/1536] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:21:34.436197 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d65735-009c-4dca-8f1c-f05fac5eabee None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:34.436789 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d65735-009c-4dca-8f1c-f05fac5eabee None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:34.436789 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d65735-009c-4dca-8f1c-f05fac5eabee None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:34.438143 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 756/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 16:21:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:21:34.443421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ff825-f1f7-4e4a-b981-bd9c6790674b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:34.443845 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ff825-f1f7-4e4a-b981-bd9c6790674b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:34.443962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ff825-f1f7-4e4a-b981-bd9c6790674b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:34.464119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-8b3ff825-f1f7-4e4a-b981-bd9c6790674b None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:21:34.465350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8b3ff825-f1f7-4e4a-b981-bd9c6790674b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:21:34.473162 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 782/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 16:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:21:34.776815 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d65735-009c-4dca-8f1c-f05fac5eabee None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:21:34.778530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d5d65735-009c-4dca-8f1c-f05fac5eabee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:21:34.791311 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d65735-009c-4dca-8f1c-f05fac5eabee None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:21:34.795099 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71811ab7-832f-4390-9363-5a3dc7a8b19c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:21:34.795705 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71811ab7-832f-4390-9363-5a3dc7a8b19c service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:21:34.795982 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71811ab7-832f-4390-9363-5a3dc7a8b19c service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:21:34.796253 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71811ab7-832f-4390-9363-5a3dc7a8b19c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:21:34.805085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71811ab7-832f-4390-9363-5a3dc7a8b19c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:21:34.806998 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71811ab7-832f-4390-9363-5a3dc7a8b19c service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:21:34.816283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 757/1539] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:21:44.458767 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=11 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:21:44.812109 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:07.957796 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318a816-ebb3-4842-8c80-d8011f2dfa09 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:07.958471 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318a816-ebb3-4842-8c80-d8011f2dfa09 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:07.958471 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318a816-ebb3-4842-8c80-d8011f2dfa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:07.993991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d318a816-ebb3-4842-8c80-d8011f2dfa09 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:07.995417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d318a816-ebb3-4842-8c80-d8011f2dfa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:08.008500 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 783/1540] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:08.017999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da677e-67f9-4d6a-b60d-36eea8015e5d None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.018592 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da677e-67f9-4d6a-b60d-36eea8015e5d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.018592 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da677e-67f9-4d6a-b60d-36eea8015e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.047515 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e4da677e-67f9-4d6a-b60d-36eea8015e5d None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:08.048799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e4da677e-67f9-4d6a-b60d-36eea8015e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:08.061873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 758/1541] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:08.066835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318a816-ebb3-4842-8c80-d8011f2dfa09 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:08.087450 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318a816-ebb3-4842-8c80-d8011f2dfa09 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:08.092450 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8482c02-bbe6-4092-bc83-db26c1fec324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:08.093122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8482c02-bbe6-4092-bc83-db26c1fec324 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.093420 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8482c02-bbe6-4092-bc83-db26c1fec324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.093681 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8482c02-bbe6-4092-bc83-db26c1fec324 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.094386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8482c02-bbe6-4092-bc83-db26c1fec324 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:23:08.094691 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8482c02-bbe6-4092-bc83-db26c1fec324 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:08.096305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8482c02-bbe6-4092-bc83-db26c1fec324 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:08.114703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 784/1542] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:23:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:23:08.122960 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da677e-67f9-4d6a-b60d-36eea8015e5d None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:08.132614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da677e-67f9-4d6a-b60d-36eea8015e5d None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:08.143021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4fccc-77ea-4691-ac5d-e0d8289f4a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:08.143788 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4fccc-77ea-4691-ac5d-e0d8289f4a07 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.144080 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4fccc-77ea-4691-ac5d-e0d8289f4a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.144361 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4fccc-77ea-4691-ac5d-e0d8289f4a07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.145075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4fccc-77ea-4691-ac5d-e0d8289f4a07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:08.147942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4fccc-77ea-4691-ac5d-e0d8289f4a07 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:08.277814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 759/1543] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:08 2022] POST /identity/v3/projects => generated 378 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:08.282290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8482c02-bbe6-4092-bc83-db26c1fec324 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:08.283761 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623594a3-0d16-419e-a08c-ae8ffa95344a None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.284055 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623594a3-0d16-419e-a08c-ae8ffa95344a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.284379 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623594a3-0d16-419e-a08c-ae8ffa95344a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.299313 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8482c02-bbe6-4092-bc83-db26c1fec324 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:08.321797 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-623594a3-0d16-419e-a08c-ae8ffa95344a None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:08.323045 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-623594a3-0d16-419e-a08c-ae8ffa95344a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:08.387641 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a831384-37aa-473b-a926-1427e449bc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:08.388290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a831384-37aa-473b-a926-1427e449bc3c admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.388575 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a831384-37aa-473b-a926-1427e449bc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.388883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a831384-37aa-473b-a926-1427e449bc3c admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.389561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a831384-37aa-473b-a926-1427e449bc3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:08.391629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a831384-37aa-473b-a926-1427e449bc3c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:08.419470 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 760/1544] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:23:08.420948 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a554e35-12b6-4315-b326-868aae9087b5 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.421383 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a554e35-12b6-4315-b326-868aae9087b5 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.421777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a554e35-12b6-4315-b326-868aae9087b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.447634 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8a554e35-12b6-4315-b326-868aae9087b5 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:08.448893 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8a554e35-12b6-4315-b326-868aae9087b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:08.458922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 761/1545] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:08.460270 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6595be2-de54-4eb8-9569-d135a0f21da5 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.460557 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6595be2-de54-4eb8-9569-d135a0f21da5 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.460856 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6595be2-de54-4eb8-9569-d135a0f21da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.481572 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b6595be2-de54-4eb8-9569-d135a0f21da5 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:08.482783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b6595be2-de54-4eb8-9569-d135a0f21da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:08.491040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 762/1546] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:08.495606 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6436d-9dc8-48ef-b521-a729520954a2 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.495606 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6436d-9dc8-48ef-b521-a729520954a2 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.495606 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6436d-9dc8-48ef-b521-a729520954a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.513445 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 785/1547] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:08 2022] POST /identity/v3/users => generated 290 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:08.515187 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09ce3c-aff8-4acf-81cb-1fcef1cfd1ff None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.515714 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09ce3c-aff8-4acf-81cb-1fcef1cfd1ff None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.515842 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c6a6436d-9dc8-48ef-b521-a729520954a2 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:08.516324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09ce3c-aff8-4acf-81cb-1fcef1cfd1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.517383 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c6a6436d-9dc8-48ef-b521-a729520954a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:08.527705 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 763/1548] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:08.530659 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c15ba-3c78-4dce-924e-e99823f82c8e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.530659 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c15ba-3c78-4dce-924e-e99823f82c8e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.530659 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c15ba-3c78-4dce-924e-e99823f82c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.538010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-cd09ce3c-aff8-4acf-81cb-1fcef1cfd1ff None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:08.539386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-cd09ce3c-aff8-4acf-81cb-1fcef1cfd1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:08.548047 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 786/1549] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:08.549399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324b3fd-ce42-478f-b9b4-1f0e350f81a2 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.549766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324b3fd-ce42-478f-b9b4-1f0e350f81a2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.550186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324b3fd-ce42-478f-b9b4-1f0e350f81a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.550317 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-382c15ba-3c78-4dce-924e-e99823f82c8e None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:08.551531 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-382c15ba-3c78-4dce-924e-e99823f82c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:08.564345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 764/1550] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:08.565618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90d715-d421-4ad1-ad5e-b8a60021c6f8 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.565897 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90d715-d421-4ad1-ad5e-b8a60021c6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.566171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90d715-d421-4ad1-ad5e-b8a60021c6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.571622 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6324b3fd-ce42-478f-b9b4-1f0e350f81a2 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:08.572975 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6324b3fd-ce42-478f-b9b4-1f0e350f81a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:08.581489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 787/1551] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:08.582646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452579c6-5fca-4cd1-b63b-30af1da7086d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.583046 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452579c6-5fca-4cd1-b63b-30af1da7086d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.583417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452579c6-5fca-4cd1-b63b-30af1da7086d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.594308 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-4d90d715-d421-4ad1-ad5e-b8a60021c6f8 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:08.595516 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4d90d715-d421-4ad1-ad5e-b8a60021c6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:08.603767 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 765/1552] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:08.604438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90d715-d421-4ad1-ad5e-b8a60021c6f8 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:08.613643 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-452579c6-5fca-4cd1-b63b-30af1da7086d None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:08.613923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90d715-d421-4ad1-ad5e-b8a60021c6f8 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:08.614884 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-452579c6-5fca-4cd1-b63b-30af1da7086d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:08.618967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86db697-fcd8-4491-9fdc-ac02f392d661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:08.619562 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86db697-fcd8-4491-9fdc-ac02f392d661 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.619847 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86db697-fcd8-4491-9fdc-ac02f392d661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.620120 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86db697-fcd8-4491-9fdc-ac02f392d661 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.620836 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86db697-fcd8-4491-9fdc-ac02f392d661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:08.622438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86db697-fcd8-4491-9fdc-ac02f392d661 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:08.623781 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 788/1553] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:08.625128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ad5fd-31bd-4f23-a575-d15cbde6cbc5 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.625415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ad5fd-31bd-4f23-a575-d15cbde6cbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.625691 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ad5fd-31bd-4f23-a575-d15cbde6cbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.632967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 766/1554] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:08 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:08.634292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86db697-fcd8-4491-9fdc-ac02f392d661 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:08.643872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86db697-fcd8-4491-9fdc-ac02f392d661 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:08.645635 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-aa7ad5fd-31bd-4f23-a575-d15cbde6cbc5 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:08.646864 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-aa7ad5fd-31bd-4f23-a575-d15cbde6cbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:08.648631 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285b07f-98d1-4296-b641-7d6cec54f42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:08.649250 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285b07f-98d1-4296-b641-7d6cec54f42e admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.649534 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285b07f-98d1-4296-b641-7d6cec54f42e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.649811 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285b07f-98d1-4296-b641-7d6cec54f42e admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.650492 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285b07f-98d1-4296-b641-7d6cec54f42e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:23:08.650795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285b07f-98d1-4296-b641-7d6cec54f42e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:08.651792 dv-cinder-851042-1-smb devstack@keystone.service[80602]: WARNING py.warnings [None req-1285b07f-98d1-4296-b641-7d6cec54f42e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:23:08.651792 dv-cinder-851042-1-smb devstack@keystone.service[80602]: warnings.warn(msg) Jul 26 16:23:08.651792 dv-cinder-851042-1-smb devstack@keystone.service[80602]: Jul 26 16:23:08.652696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285b07f-98d1-4296-b641-7d6cec54f42e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:08.654779 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 789/1555] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:08.655542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ad5fd-31bd-4f23-a575-d15cbde6cbc5 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:08.664563 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ad5fd-31bd-4f23-a575-d15cbde6cbc5 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:08.668788 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 767/1556] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:23:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:23:08.669364 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c5b56-2a91-465a-951f-219c64b347b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:08.670026 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c5b56-2a91-465a-951f-219c64b347b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.670220 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e87ef-953e-49e2-9466-06a47967a754 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.670352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c5b56-2a91-465a-951f-219c64b347b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.670565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c5b56-2a91-465a-951f-219c64b347b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.670694 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e87ef-953e-49e2-9466-06a47967a754 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.670897 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e87ef-953e-49e2-9466-06a47967a754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.671246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c5b56-2a91-465a-951f-219c64b347b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:23:08.671545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c5b56-2a91-465a-951f-219c64b347b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:08.673155 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c5b56-2a91-465a-951f-219c64b347b5 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:08.691351 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 790/1557] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:23:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:23:08.691351 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1667bfc-4247-4fb9-b131-670465a256a6 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.691351 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1667bfc-4247-4fb9-b131-670465a256a6 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.691351 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1667bfc-4247-4fb9-b131-670465a256a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.691833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-663e87ef-953e-49e2-9466-06a47967a754 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:08.691833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-663e87ef-953e-49e2-9466-06a47967a754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:08.699644 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 768/1558] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:08.700591 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e87ef-953e-49e2-9466-06a47967a754 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:08.708466 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c1667bfc-4247-4fb9-b131-670465a256a6 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:08.709775 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c1667bfc-4247-4fb9-b131-670465a256a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:08.710069 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e87ef-953e-49e2-9466-06a47967a754 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:08.714555 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e1ad5-9105-42d2-b973-51bb7d843994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:08.715143 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e1ad5-9105-42d2-b973-51bb7d843994 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.715424 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e1ad5-9105-42d2-b973-51bb7d843994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.715702 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e1ad5-9105-42d2-b973-51bb7d843994 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.716381 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e1ad5-9105-42d2-b973-51bb7d843994 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:23:08.716729 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e1ad5-9105-42d2-b973-51bb7d843994 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:08.718154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 791/1559] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:08.718319 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e1ad5-9105-42d2-b973-51bb7d843994 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:08.719315 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545e393-1e03-4b48-84b1-ecfd791e90bd None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.719595 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545e393-1e03-4b48-84b1-ecfd791e90bd None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.719920 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545e393-1e03-4b48-84b1-ecfd791e90bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.731651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 769/1560] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:23:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:23:08.732469 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e1ad5-9105-42d2-b973-51bb7d843994 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:08.739934 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c545e393-1e03-4b48-84b1-ecfd791e90bd None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:08.742156 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c545e393-1e03-4b48-84b1-ecfd791e90bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:08.747900 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e1ad5-9105-42d2-b973-51bb7d843994 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:08.750257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 792/1561] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:08.751027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545e393-1e03-4b48-84b1-ecfd791e90bd None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:08.755456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f8d2a-4cf4-4061-80e2-b65c4c9227c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:08.756085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f8d2a-4cf4-4061-80e2-b65c4c9227c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.756348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f8d2a-4cf4-4061-80e2-b65c4c9227c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.756624 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f8d2a-4cf4-4061-80e2-b65c4c9227c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.757361 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f8d2a-4cf4-4061-80e2-b65c4c9227c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:08.759467 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f8d2a-4cf4-4061-80e2-b65c4c9227c3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:08.761125 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545e393-1e03-4b48-84b1-ecfd791e90bd None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:08.765639 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47f4f2-04bd-4ec5-bd46-e655699ce73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:08.766234 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47f4f2-04bd-4ec5-bd46-e655699ce73d admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.766517 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47f4f2-04bd-4ec5-bd46-e655699ce73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.766790 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47f4f2-04bd-4ec5-bd46-e655699ce73d admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.767506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47f4f2-04bd-4ec5-bd46-e655699ce73d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:23:08.767804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47f4f2-04bd-4ec5-bd46-e655699ce73d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:08.769434 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47f4f2-04bd-4ec5-bd46-e655699ce73d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:08.769935 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 770/1562] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:08 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:08.770692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f8d2a-4cf4-4061-80e2-b65c4c9227c3 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:08.781992 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f8d2a-4cf4-4061-80e2-b65c4c9227c3 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:08.782179 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 793/1563] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:23:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:23:08.782924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47f4f2-04bd-4ec5-bd46-e655699ce73d admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:08.786928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1c24e-db9b-480b-9651-7958b3d3975f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:08.793624 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1c24e-db9b-480b-9651-7958b3d3975f admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.793624 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1c24e-db9b-480b-9651-7958b3d3975f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.793624 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1c24e-db9b-480b-9651-7958b3d3975f admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.793624 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1c24e-db9b-480b-9651-7958b3d3975f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:08.793624 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1c24e-db9b-480b-9651-7958b3d3975f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:08.794370 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47f4f2-04bd-4ec5-bd46-e655699ce73d admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:08.798744 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b9c9d-e97c-47c4-9ca3-5bf3c3abdd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:08.799337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b9c9d-e97c-47c4-9ca3-5bf3c3abdd70 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.799615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b9c9d-e97c-47c4-9ca3-5bf3c3abdd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.799887 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b9c9d-e97c-47c4-9ca3-5bf3c3abdd70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.800537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b9c9d-e97c-47c4-9ca3-5bf3c3abdd70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:08.801581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: WARNING py.warnings [None req-4c4b9c9d-e97c-47c4-9ca3-5bf3c3abdd70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:23:08.801581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: warnings.warn(msg) Jul 26 16:23:08.801581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: Jul 26 16:23:08.802762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b9c9d-e97c-47c4-9ca3-5bf3c3abdd70 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:08.907896 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 771/1564] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:08 2022] POST /identity/v3/projects => generated 390 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:08.908241 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 794/1565] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:08 2022] POST /identity/v3/projects => generated 386 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:08.909753 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc13ccf-9246-42f8-8e97-b02ce2cdffa2 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:08.910043 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc13ccf-9246-42f8-8e97-b02ce2cdffa2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:08.910321 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc13ccf-9246-42f8-8e97-b02ce2cdffa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:08.911788 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1c24e-db9b-480b-9651-7958b3d3975f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:08.925900 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:08.931924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6dc13ccf-9246-42f8-8e97-b02ce2cdffa2 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:08.933356 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6dc13ccf-9246-42f8-8e97-b02ce2cdffa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:08.973746 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:08.976912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1c24e-db9b-480b-9651-7958b3d3975f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:08.994386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 795/1566] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:08.995324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc13ccf-9246-42f8-8e97-b02ce2cdffa2 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:09.007205 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc13ccf-9246-42f8-8e97-b02ce2cdffa2 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:09.012608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cf919-f716-4476-9deb-4ae6ec88aded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:09.025362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cf919-f716-4476-9deb-4ae6ec88aded admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:09.025362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cf919-f716-4476-9deb-4ae6ec88aded admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:09.025362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cf919-f716-4476-9deb-4ae6ec88aded admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:09.025362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cf919-f716-4476-9deb-4ae6ec88aded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:09.025362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cf919-f716-4476-9deb-4ae6ec88aded admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:09.037031 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8abea-97fc-4173-8d57-a28ed794b202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:09.037656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8abea-97fc-4173-8d57-a28ed794b202 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:09.037997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8abea-97fc-4173-8d57-a28ed794b202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:09.038337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8abea-97fc-4173-8d57-a28ed794b202 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:09.039102 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8abea-97fc-4173-8d57-a28ed794b202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:23:09.039444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8abea-97fc-4173-8d57-a28ed794b202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:09.041227 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8abea-97fc-4173-8d57-a28ed794b202 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:09.053237 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 772/1567] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:23:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:23:09.054194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8abea-97fc-4173-8d57-a28ed794b202 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:09.064238 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8abea-97fc-4173-8d57-a28ed794b202 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:09.068868 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba81e72-b566-4e01-9372-bfaceff5e46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:09.069458 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba81e72-b566-4e01-9372-bfaceff5e46f admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:09.069734 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba81e72-b566-4e01-9372-bfaceff5e46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:09.070004 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba81e72-b566-4e01-9372-bfaceff5e46f admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:09.073242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba81e72-b566-4e01-9372-bfaceff5e46f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:23:09.073548 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba81e72-b566-4e01-9372-bfaceff5e46f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:09.075173 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba81e72-b566-4e01-9372-bfaceff5e46f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:09.087178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 773/1568] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:23:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:23:09.088132 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba81e72-b566-4e01-9372-bfaceff5e46f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:09.097503 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba81e72-b566-4e01-9372-bfaceff5e46f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:09.106924 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1fc13-b562-4575-92a5-1f8cd13e0d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:09.106924 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1fc13-b562-4575-92a5-1f8cd13e0d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:09.106924 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1fc13-b562-4575-92a5-1f8cd13e0d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:09.106924 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1fc13-b562-4575-92a5-1f8cd13e0d76 admin admin] PATH_INFO: `/v3/projects/0ed9eba09a214f8dab70ed53a07d798b/users/6a56919ded5645c290058d80ddc97f76/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:09.117961 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1fc13-b562-4575-92a5-1f8cd13e0d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ed9eba09a214f8dab70ed53a07d798b, user_id=6a56919ded5645c290058d80ddc97f76, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:09.120759 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1fc13-b562-4575-92a5-1f8cd13e0d76 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:09.134106 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 796/1569] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:08 2022] POST /identity/v3/projects => generated 366 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:09.135329 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cf919-f716-4476-9deb-4ae6ec88aded admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:09.193769 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cf919-f716-4476-9deb-4ae6ec88aded admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:09.200336 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 774/1570] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:09 2022] PUT /identity/v3/projects/0ed9eba09a214f8dab70ed53a07d798b/users/6a56919ded5645c290058d80ddc97f76/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:09.204965 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1fc13-b562-4575-92a5-1f8cd13e0d76 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:09.249972 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7032e1-1f33-4145-980b-67ce3d735cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:09.250594 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7032e1-1f33-4145-980b-67ce3d735cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:09.250871 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7032e1-1f33-4145-980b-67ce3d735cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:09.251146 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7032e1-1f33-4145-980b-67ce3d735cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:09.251843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7032e1-1f33-4145-980b-67ce3d735cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:09.253850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7032e1-1f33-4145-980b-67ce3d735cc7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:09.268911 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1fc13-b562-4575-92a5-1f8cd13e0d76 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:09.273657 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5279b-bb78-4438-bd26-201aca908b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:09.278598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5279b-bb78-4438-bd26-201aca908b12 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:09.278598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5279b-bb78-4438-bd26-201aca908b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:09.278598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5279b-bb78-4438-bd26-201aca908b12 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:09.278598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5279b-bb78-4438-bd26-201aca908b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:09.278598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: WARNING py.warnings [None req-b6d5279b-bb78-4438-bd26-201aca908b12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:23:09.278598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: warnings.warn(msg) Jul 26 16:23:09.278598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: Jul 26 16:23:09.279241 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5279b-bb78-4438-bd26-201aca908b12 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:09.338608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 797/1571] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:09 2022] POST /identity/v3/projects => generated 392 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:09.339339 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7032e1-1f33-4145-980b-67ce3d735cc7 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:09.390585 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:09.400719 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7032e1-1f33-4145-980b-67ce3d735cc7 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:09.405638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edced48-0443-4a86-8958-b198f3c09f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:09.406245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edced48-0443-4a86-8958-b198f3c09f1e admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:09.406526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edced48-0443-4a86-8958-b198f3c09f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:09.406798 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edced48-0443-4a86-8958-b198f3c09f1e admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:09.407449 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edced48-0443-4a86-8958-b198f3c09f1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:09.409407 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edced48-0443-4a86-8958-b198f3c09f1e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:09.423450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 775/1572] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:09 2022] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:09.424316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5279b-bb78-4438-bd26-201aca908b12 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:09.435052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5279b-bb78-4438-bd26-201aca908b12 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:09.441153 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ac778-f12f-4bb9-a3ef-3105b3af7abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:09.442180 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ac778-f12f-4bb9-a3ef-3105b3af7abb admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:09.442679 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ac778-f12f-4bb9-a3ef-3105b3af7abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:09.443186 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ac778-f12f-4bb9-a3ef-3105b3af7abb admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:09.444545 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ac778-f12f-4bb9-a3ef-3105b3af7abb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:23:09.444884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ac778-f12f-4bb9-a3ef-3105b3af7abb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:09.447315 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ac778-f12f-4bb9-a3ef-3105b3af7abb admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:09.449082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:09.460801 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 776/1573] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:23:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:23:09.463045 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ac778-f12f-4bb9-a3ef-3105b3af7abb admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:09.471496 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ac778-f12f-4bb9-a3ef-3105b3af7abb admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:09.476175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b31de3-49bc-4055-b33f-46b7f5ed5e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:09.477295 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b31de3-49bc-4055-b33f-46b7f5ed5e77 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:09.477599 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b31de3-49bc-4055-b33f-46b7f5ed5e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:09.477866 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b31de3-49bc-4055-b33f-46b7f5ed5e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:09.478516 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b31de3-49bc-4055-b33f-46b7f5ed5e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:09.480471 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b31de3-49bc-4055-b33f-46b7f5ed5e77 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:09.480762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 798/1574] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:09 2022] POST /identity/v3/users => generated 296 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:09.481566 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edced48-0443-4a86-8958-b198f3c09f1e admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:09.491667 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edced48-0443-4a86-8958-b198f3c09f1e admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:09.496971 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8632d-2178-4453-9e5a-f46df3ea993a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:09.497611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8632d-2178-4453-9e5a-f46df3ea993a admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:09.497893 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8632d-2178-4453-9e5a-f46df3ea993a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:09.498194 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8632d-2178-4453-9e5a-f46df3ea993a admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:09.498847 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8632d-2178-4453-9e5a-f46df3ea993a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:09.500781 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8632d-2178-4453-9e5a-f46df3ea993a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:09.549684 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 777/1575] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:09 2022] POST /identity/v3/projects => generated 378 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:09.550519 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b31de3-49bc-4055-b33f-46b7f5ed5e77 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:09.568287 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 799/1576] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:09 2022] POST /identity/v3/projects => generated 368 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:09.568287 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf9ef5-ac7a-4a8f-9f6b-e559fcfdf451 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:09.574079 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf9ef5-ac7a-4a8f-9f6b-e559fcfdf451 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:09.574079 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf9ef5-ac7a-4a8f-9f6b-e559fcfdf451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:09.587308 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-dbaf9ef5-ac7a-4a8f-9f6b-e559fcfdf451 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:09.588512 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dbaf9ef5-ac7a-4a8f-9f6b-e559fcfdf451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:09.623382 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b31de3-49bc-4055-b33f-46b7f5ed5e77 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:09.650482 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 800/1577] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:09.653817 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf9ef5-ac7a-4a8f-9f6b-e559fcfdf451 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:09.660260 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf9ef5-ac7a-4a8f-9f6b-e559fcfdf451 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:09.666031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a7aa3-c559-4e77-83b8-21f06f891d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:09.666645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a7aa3-c559-4e77-83b8-21f06f891d4d admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:09.666930 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a7aa3-c559-4e77-83b8-21f06f891d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:09.667204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a7aa3-c559-4e77-83b8-21f06f891d4d admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:09.667862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a7aa3-c559-4e77-83b8-21f06f891d4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:09.670165 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a7aa3-c559-4e77-83b8-21f06f891d4d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:09.674692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1765549-5f13-443c-9b99-c27ae50d4718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:09.675343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1765549-5f13-443c-9b99-c27ae50d4718 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:09.675624 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1765549-5f13-443c-9b99-c27ae50d4718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:09.675899 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1765549-5f13-443c-9b99-c27ae50d4718 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:09.676558 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1765549-5f13-443c-9b99-c27ae50d4718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:09.678523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1765549-5f13-443c-9b99-c27ae50d4718 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:09.782822 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 801/1578] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:09 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:09.783642 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a7aa3-c559-4e77-83b8-21f06f891d4d admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:09.793788 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a7aa3-c559-4e77-83b8-21f06f891d4d admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:09.799714 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 778/1579] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:09 2022] POST /identity/v3/users => generated 284 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:09.799714 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1765549-5f13-443c-9b99-c27ae50d4718 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:09.800025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea54605-839e-4c3b-bd8a-fdaceb776cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:09.800025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea54605-839e-4c3b-bd8a-fdaceb776cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:09.800025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea54605-839e-4c3b-bd8a-fdaceb776cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:09.800025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea54605-839e-4c3b-bd8a-fdaceb776cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:09.800740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea54605-839e-4c3b-bd8a-fdaceb776cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:09.802402 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea54605-839e-4c3b-bd8a-fdaceb776cf7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:09.807170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1765549-5f13-443c-9b99-c27ae50d4718 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:09.812070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c776896-ed7e-4433-81d3-67bed1f56a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:09.812714 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c776896-ed7e-4433-81d3-67bed1f56a79 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:09.813000 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c776896-ed7e-4433-81d3-67bed1f56a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:09.813277 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c776896-ed7e-4433-81d3-67bed1f56a79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:09.813982 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c776896-ed7e-4433-81d3-67bed1f56a79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:09.814110 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 802/1580] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:09 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:09.814816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea54605-839e-4c3b-bd8a-fdaceb776cf7 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:09.816010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c776896-ed7e-4433-81d3-67bed1f56a79 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:09.824382 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea54605-839e-4c3b-bd8a-fdaceb776cf7 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:09.829185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc385c5-189b-4fb8-9ed7-4976a9a09b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:09.829786 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc385c5-189b-4fb8-9ed7-4976a9a09b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:09.830095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc385c5-189b-4fb8-9ed7-4976a9a09b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:09.830348 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc385c5-189b-4fb8-9ed7-4976a9a09b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:09.831038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc385c5-189b-4fb8-9ed7-4976a9a09b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:09.832721 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc385c5-189b-4fb8-9ed7-4976a9a09b0e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:09.844502 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 803/1581] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:09 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:09.845405 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc385c5-189b-4fb8-9ed7-4976a9a09b0e admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:09.855688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc385c5-189b-4fb8-9ed7-4976a9a09b0e admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:09.860943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701b121-7a9b-4be8-866d-f480784c9c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:09.861483 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701b121-7a9b-4be8-866d-f480784c9c64 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:09.861761 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701b121-7a9b-4be8-866d-f480784c9c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:09.862039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701b121-7a9b-4be8-866d-f480784c9c64 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:09.862693 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701b121-7a9b-4be8-866d-f480784c9c64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:09.864596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701b121-7a9b-4be8-866d-f480784c9c64 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:09.933349 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 779/1582] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:09 2022] POST /identity/v3/projects => generated 374 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:09.934166 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c776896-ed7e-4433-81d3-67bed1f56a79 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:09.962094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 804/1583] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:09 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:09.962094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701b121-7a9b-4be8-866d-f480784c9c64 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:09.985590 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:09.999397 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c776896-ed7e-4433-81d3-67bed1f56a79 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:10.004053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c9bf2-4eec-414f-ad55-2dece9bc9e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:10.007408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c9bf2-4eec-414f-ad55-2dece9bc9e7d admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.007408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c9bf2-4eec-414f-ad55-2dece9bc9e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.007408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c9bf2-4eec-414f-ad55-2dece9bc9e7d admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.007408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c9bf2-4eec-414f-ad55-2dece9bc9e7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:10.007855 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c9bf2-4eec-414f-ad55-2dece9bc9e7d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:10.016820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701b121-7a9b-4be8-866d-f480784c9c64 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:10.034146 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:10.066791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe0ef0-da99-47a4-b636-57be343a1157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:10.067437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe0ef0-da99-47a4-b636-57be343a1157 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.067716 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe0ef0-da99-47a4-b636-57be343a1157 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.067985 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe0ef0-da99-47a4-b636-57be343a1157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.077499 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe0ef0-da99-47a4-b636-57be343a1157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:10.079151 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe0ef0-da99-47a4-b636-57be343a1157 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:10.093399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 805/1584] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:10.093399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe0ef0-da99-47a4-b636-57be343a1157 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:10.102546 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe0ef0-da99-47a4-b636-57be343a1157 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:10.107698 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906354d7-0eff-4fbd-99c5-c83a3314a66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:10.108334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906354d7-0eff-4fbd-99c5-c83a3314a66d admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.108646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906354d7-0eff-4fbd-99c5-c83a3314a66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.108951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906354d7-0eff-4fbd-99c5-c83a3314a66d admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.109639 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906354d7-0eff-4fbd-99c5-c83a3314a66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:10.111241 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906354d7-0eff-4fbd-99c5-c83a3314a66d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:10.119604 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 780/1585] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:09 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:10.120444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c9bf2-4eec-414f-ad55-2dece9bc9e7d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:10.125331 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 806/1586] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:10 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:10.125331 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906354d7-0eff-4fbd-99c5-c83a3314a66d admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:10.130930 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c9bf2-4eec-414f-ad55-2dece9bc9e7d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:10.133309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906354d7-0eff-4fbd-99c5-c83a3314a66d admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:10.136517 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84d489-ade0-40b2-b702-c9fa50ca4481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:10.137229 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84d489-ade0-40b2-b702-c9fa50ca4481 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.143330 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84d489-ade0-40b2-b702-c9fa50ca4481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.143330 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84d489-ade0-40b2-b702-c9fa50ca4481 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.143330 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84d489-ade0-40b2-b702-c9fa50ca4481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:10.143608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96a621-4d07-4720-88bf-fd890f0526bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:10.143608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96a621-4d07-4720-88bf-fd890f0526bd admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.143608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96a621-4d07-4720-88bf-fd890f0526bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.143608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96a621-4d07-4720-88bf-fd890f0526bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.143943 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84d489-ade0-40b2-b702-c9fa50ca4481 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:10.144039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96a621-4d07-4720-88bf-fd890f0526bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:10.144039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96a621-4d07-4720-88bf-fd890f0526bd admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:10.150397 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 781/1587] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:10 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:10.154230 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84d489-ade0-40b2-b702-c9fa50ca4481 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:10.159093 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 807/1588] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:10 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:10.159461 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96a621-4d07-4720-88bf-fd890f0526bd admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:10.167553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84d489-ade0-40b2-b702-c9fa50ca4481 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:10.171060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96a621-4d07-4720-88bf-fd890f0526bd admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:10.172903 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c90be3-c403-48f2-89cf-1624f04658c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:10.173617 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c90be3-c403-48f2-89cf-1624f04658c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.173904 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c90be3-c403-48f2-89cf-1624f04658c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.174173 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c90be3-c403-48f2-89cf-1624f04658c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.174888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c90be3-c403-48f2-89cf-1624f04658c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:10.175822 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dfe3f-e0da-4c21-968b-5f857452ca96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:10.176425 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dfe3f-e0da-4c21-968b-5f857452ca96 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.176570 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c90be3-c403-48f2-89cf-1624f04658c2 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:10.176726 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dfe3f-e0da-4c21-968b-5f857452ca96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.177006 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dfe3f-e0da-4c21-968b-5f857452ca96 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.177798 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dfe3f-e0da-4c21-968b-5f857452ca96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:10.179631 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dfe3f-e0da-4c21-968b-5f857452ca96 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:10.187397 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 782/1589] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:10 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:10.188080 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c90be3-c403-48f2-89cf-1624f04658c2 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:10.199326 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c90be3-c403-48f2-89cf-1624f04658c2 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:10.204487 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b895c-8e25-4438-90a3-bb02cc470f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:10.205196 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b895c-8e25-4438-90a3-bb02cc470f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.205476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b895c-8e25-4438-90a3-bb02cc470f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.205747 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b895c-8e25-4438-90a3-bb02cc470f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.206429 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b895c-8e25-4438-90a3-bb02cc470f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:10.208127 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b895c-8e25-4438-90a3-bb02cc470f9a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:10.219013 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 783/1590] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:10 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:10.219968 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b895c-8e25-4438-90a3-bb02cc470f9a admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:10.229706 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b895c-8e25-4438-90a3-bb02cc470f9a admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:10.234764 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b78666-c66a-43c5-bc76-65e4779e21fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:10.235365 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b78666-c66a-43c5-bc76-65e4779e21fe admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.235646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b78666-c66a-43c5-bc76-65e4779e21fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.235923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b78666-c66a-43c5-bc76-65e4779e21fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.236601 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b78666-c66a-43c5-bc76-65e4779e21fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:10.238206 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b78666-c66a-43c5-bc76-65e4779e21fe admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:10.248423 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 784/1591] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:10 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:10.252365 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b78666-c66a-43c5-bc76-65e4779e21fe admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:10.262502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b78666-c66a-43c5-bc76-65e4779e21fe admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:10.267085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3708a9d-f2c3-464f-9691-cbb6c20e5a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:10.267687 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3708a9d-f2c3-464f-9691-cbb6c20e5a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.267968 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3708a9d-f2c3-464f-9691-cbb6c20e5a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.268244 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3708a9d-f2c3-464f-9691-cbb6c20e5a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.268964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3708a9d-f2c3-464f-9691-cbb6c20e5a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:10.270548 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3708a9d-f2c3-464f-9691-cbb6c20e5a91 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:10.282535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 785/1592] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:10 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:10.282535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3708a9d-f2c3-464f-9691-cbb6c20e5a91 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:10.292370 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 808/1593] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:10 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:10.292370 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dfe3f-e0da-4c21-968b-5f857452ca96 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:10.293244 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3708a9d-f2c3-464f-9691-cbb6c20e5a91 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:10.298284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dfe3f-e0da-4c21-968b-5f857452ca96 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:10.298424 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4f16b-f2e9-4ee1-9cac-39861dec3170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:10.299079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4f16b-f2e9-4ee1-9cac-39861dec3170 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.299322 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4f16b-f2e9-4ee1-9cac-39861dec3170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.299563 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4f16b-f2e9-4ee1-9cac-39861dec3170 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.300252 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4f16b-f2e9-4ee1-9cac-39861dec3170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:10.301865 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4f16b-f2e9-4ee1-9cac-39861dec3170 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:10.303472 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aec2e6-c593-474b-91c0-9577256081b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:10.304493 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aec2e6-c593-474b-91c0-9577256081b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.305463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aec2e6-c593-474b-91c0-9577256081b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.305746 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aec2e6-c593-474b-91c0-9577256081b2 admin admin] PATH_INFO: `/v3/projects/285fe70bd1a24e1a83f7d655356630a8/users/946536697a3d4109af6c7cb90a613fa1/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.312308 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 786/1594] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:10 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:10.314477 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4f16b-f2e9-4ee1-9cac-39861dec3170 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:10.323847 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4f16b-f2e9-4ee1-9cac-39861dec3170 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:10.324015 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aec2e6-c593-474b-91c0-9577256081b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=285fe70bd1a24e1a83f7d655356630a8, user_id=946536697a3d4109af6c7cb90a613fa1, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:10.325081 dv-cinder-851042-1-smb devstack@keystone.service[80601]: WARNING py.warnings [None req-30aec2e6-c593-474b-91c0-9577256081b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:23:10.325081 dv-cinder-851042-1-smb devstack@keystone.service[80601]: warnings.warn(msg) Jul 26 16:23:10.325081 dv-cinder-851042-1-smb devstack@keystone.service[80601]: Jul 26 16:23:10.327074 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aec2e6-c593-474b-91c0-9577256081b2 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:10.328440 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31cd41-2530-4bef-95dd-8473d0a42175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:10.329107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31cd41-2530-4bef-95dd-8473d0a42175 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.329398 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31cd41-2530-4bef-95dd-8473d0a42175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.329668 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31cd41-2530-4bef-95dd-8473d0a42175 admin admin] PATH_INFO: `/v3/projects/68c67a229e254c1a947e53f16ec47dfb/users/ab89e3033bb949dfb468c2013bc6b096/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.343982 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31cd41-2530-4bef-95dd-8473d0a42175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68c67a229e254c1a947e53f16ec47dfb, user_id=ab89e3033bb949dfb468c2013bc6b096, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:10.346697 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31cd41-2530-4bef-95dd-8473d0a42175 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:10.460899 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 809/1595] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:10 2022] PUT /identity/v3/projects/285fe70bd1a24e1a83f7d655356630a8/users/946536697a3d4109af6c7cb90a613fa1/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:10.461522 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aec2e6-c593-474b-91c0-9577256081b2 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:10.498679 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 787/1596] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:10 2022] PUT /identity/v3/projects/68c67a229e254c1a947e53f16ec47dfb/users/ab89e3033bb949dfb468c2013bc6b096/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:10.498679 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31cd41-2530-4bef-95dd-8473d0a42175 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:10.541224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aec2e6-c593-474b-91c0-9577256081b2 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:10.573639 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31cd41-2530-4bef-95dd-8473d0a42175 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:10.579546 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7e00d-89b9-422f-bde4-688743d5d363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:10.586624 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7e00d-89b9-422f-bde4-688743d5d363 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.586624 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7e00d-89b9-422f-bde4-688743d5d363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.586624 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7e00d-89b9-422f-bde4-688743d5d363 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.586624 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7e00d-89b9-422f-bde4-688743d5d363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:10.586624 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7e00d-89b9-422f-bde4-688743d5d363 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:10.595770 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 788/1597] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:10 2022] GET /identity/v3/roles => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:10.596602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7e00d-89b9-422f-bde4-688743d5d363 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:10.607581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7e00d-89b9-422f-bde4-688743d5d363 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:10.609262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e3880-3db5-4de1-802a-844fbcb444a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:10.614885 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e3880-3db5-4de1-802a-844fbcb444a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.614885 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e3880-3db5-4de1-802a-844fbcb444a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.614885 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e3880-3db5-4de1-802a-844fbcb444a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.614885 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e3880-3db5-4de1-802a-844fbcb444a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:10.615260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee308f-8f4e-4c84-8b36-a4b1e34b8eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:10.615381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e3880-3db5-4de1-802a-844fbcb444a3 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:10.615473 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee308f-8f4e-4c84-8b36-a4b1e34b8eae admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.615473 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee308f-8f4e-4c84-8b36-a4b1e34b8eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.615473 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee308f-8f4e-4c84-8b36-a4b1e34b8eae admin admin] PATH_INFO: `/v3/projects/d4aac3a9e2694d10844c9000c1e34b7e/users/b867401639e74527adb079981496b19f/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.622709 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 810/1598] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:10 2022] GET /identity/v3/roles => generated 1427 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:10.623567 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e3880-3db5-4de1-802a-844fbcb444a3 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:10.628485 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:10.633220 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee308f-8f4e-4c84-8b36-a4b1e34b8eae admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4aac3a9e2694d10844c9000c1e34b7e, user_id=b867401639e74527adb079981496b19f, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:10.633422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e3880-3db5-4de1-802a-844fbcb444a3 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:10.636403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee308f-8f4e-4c84-8b36-a4b1e34b8eae admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:10.638099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccee06-cf80-491e-8687-24ded906d9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:10.638705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccee06-cf80-491e-8687-24ded906d9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.638985 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccee06-cf80-491e-8687-24ded906d9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.648108 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccee06-cf80-491e-8687-24ded906d9d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.648108 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccee06-cf80-491e-8687-24ded906d9d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:10.648108 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccee06-cf80-491e-8687-24ded906d9d3 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:10.651921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 811/1599] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:10 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:10.652703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccee06-cf80-491e-8687-24ded906d9d3 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:10.662061 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccee06-cf80-491e-8687-24ded906d9d3 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:10.669219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519eb57-4d8a-4ad7-b010-60ca55455230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:10.669881 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519eb57-4d8a-4ad7-b010-60ca55455230 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.682721 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519eb57-4d8a-4ad7-b010-60ca55455230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.682721 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519eb57-4d8a-4ad7-b010-60ca55455230 admin admin] PATH_INFO: `/v3/projects/86b038e0226d4031baeee926d19de082/users/a409e3faaccd40d9b0a3d878d5d8a787/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.686164 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519eb57-4d8a-4ad7-b010-60ca55455230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b038e0226d4031baeee926d19de082, user_id=a409e3faaccd40d9b0a3d878d5d8a787, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:10.688865 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519eb57-4d8a-4ad7-b010-60ca55455230 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:10.766579 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 789/1600] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:10 2022] PUT /identity/v3/projects/d4aac3a9e2694d10844c9000c1e34b7e/users/b867401639e74527adb079981496b19f/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:10.768164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31861c1c-bb0d-486e-b76e-eddaeae12312 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.770358 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31861c1c-bb0d-486e-b76e-eddaeae12312 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.770358 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31861c1c-bb0d-486e-b76e-eddaeae12312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.798617 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-31861c1c-bb0d-486e-b76e-eddaeae12312 None None] MFA Rules not processed for user `946536697a3d4109af6c7cb90a613fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:10.799824 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-31861c1c-bb0d-486e-b76e-eddaeae12312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:10.805579 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:10.830331 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 812/1601] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:10 2022] PUT /identity/v3/projects/86b038e0226d4031baeee926d19de082/users/a409e3faaccd40d9b0a3d878d5d8a787/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:10.845042 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e45586-8689-40d8-9db8-9cef9c76400a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.845324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e45586-8689-40d8-9db8-9cef9c76400a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.845681 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e45586-8689-40d8-9db8-9cef9c76400a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.868916 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-71e45586-8689-40d8-9db8-9cef9c76400a None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:10.870367 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-71e45586-8689-40d8-9db8-9cef9c76400a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:10.871350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 790/1602] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:10.872443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31861c1c-bb0d-486e-b76e-eddaeae12312 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:10.942976 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 813/1603] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:10.943884 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e45586-8689-40d8-9db8-9cef9c76400a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:10.952076 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31861c1c-bb0d-486e-b76e-eddaeae12312 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:10.956165 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef5533-d08c-4223-afc0-9a66c986775e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:10.957014 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e45586-8689-40d8-9db8-9cef9c76400a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:10.957135 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef5533-d08c-4223-afc0-9a66c986775e admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.957449 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef5533-d08c-4223-afc0-9a66c986775e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.957831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef5533-d08c-4223-afc0-9a66c986775e admin admin] PATH_INFO: `/v3/projects/ba6c01fd15c14c60acfee84923870003/users/11a137eec22440ce9b26d5e207355c05/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.963017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e607d0-72b3-4cc5-ac37-0ab27073167b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:10.964533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e607d0-72b3-4cc5-ac37-0ab27073167b admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:10.965015 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e607d0-72b3-4cc5-ac37-0ab27073167b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:10.965716 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e607d0-72b3-4cc5-ac37-0ab27073167b admin admin] PATH_INFO: `/v3/projects/4a9c76ad32964ba094c0e201f0762cc8/users/2e75b38158404b298375fab5234851b0/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:10.981976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef5533-d08c-4223-afc0-9a66c986775e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6c01fd15c14c60acfee84923870003, user_id=11a137eec22440ce9b26d5e207355c05, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:10.986804 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef5533-d08c-4223-afc0-9a66c986775e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:10.988633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e607d0-72b3-4cc5-ac37-0ab27073167b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a9c76ad32964ba094c0e201f0762cc8, user_id=2e75b38158404b298375fab5234851b0, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:10.991353 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e607d0-72b3-4cc5-ac37-0ab27073167b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:11.120985 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 791/1604] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:10 2022] PUT /identity/v3/projects/ba6c01fd15c14c60acfee84923870003/users/11a137eec22440ce9b26d5e207355c05/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:11.121857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef5533-d08c-4223-afc0-9a66c986775e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:11.182978 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef5533-d08c-4223-afc0-9a66c986775e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:11.187732 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537021f-8fc1-4a7f-a7c3-d0dacc29dc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:11.188351 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537021f-8fc1-4a7f-a7c3-d0dacc29dc3d admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:11.188629 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537021f-8fc1-4a7f-a7c3-d0dacc29dc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:11.188930 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537021f-8fc1-4a7f-a7c3-d0dacc29dc3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:11.189619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537021f-8fc1-4a7f-a7c3-d0dacc29dc3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:11.191247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537021f-8fc1-4a7f-a7c3-d0dacc29dc3d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:11.201004 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 814/1605] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:10 2022] PUT /identity/v3/projects/4a9c76ad32964ba094c0e201f0762cc8/users/2e75b38158404b298375fab5234851b0/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:11.206134 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af63235-ec15-454b-a77e-1691c46fa2b1 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:11.206134 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af63235-ec15-454b-a77e-1691c46fa2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:11.206352 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 792/1606] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:11 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:11.206448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af63235-ec15-454b-a77e-1691c46fa2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:11.206535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd24d9-eaa1-4964-bcab-cdc70ac0abc2 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:11.206535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd24d9-eaa1-4964-bcab-cdc70ac0abc2 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:11.206535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd24d9-eaa1-4964-bcab-cdc70ac0abc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:11.222456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2af63235-ec15-454b-a77e-1691c46fa2b1 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:11.223973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2af63235-ec15-454b-a77e-1691c46fa2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:11.232596 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-00bd24d9-eaa1-4964-bcab-cdc70ac0abc2 None None] MFA Rules not processed for user `a409e3faaccd40d9b0a3d878d5d8a787`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:11.242026 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-00bd24d9-eaa1-4964-bcab-cdc70ac0abc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:11.292719 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 815/1607] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:11.294581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3683f4-bd3b-40ea-847a-3134a1842d43 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:11.294947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3683f4-bd3b-40ea-847a-3134a1842d43 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:11.295286 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3683f4-bd3b-40ea-847a-3134a1842d43 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:11.296737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 816/1608] 10.222.0.141 () {54 vars in 967 bytes} [Tue Jul 26 16:23:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:23:11.297507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3683f4-bd3b-40ea-847a-3134a1842d43 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:11.317690 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 793/1609] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:11.319209 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face3aae-7bfe-4cb6-aac6-fd9f57de7dd1 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:11.319569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face3aae-7bfe-4cb6-aac6-fd9f57de7dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:11.319912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face3aae-7bfe-4cb6-aac6-fd9f57de7dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:11.350550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-face3aae-7bfe-4cb6-aac6-fd9f57de7dd1 None None] MFA Rules not processed for user `11a137eec22440ce9b26d5e207355c05`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:11.352326 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-face3aae-7bfe-4cb6-aac6-fd9f57de7dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:11.353478 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:11.363162 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3683f4-bd3b-40ea-847a-3134a1842d43 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:11.369499 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a445da-de41-415a-b391-4b4d153b888b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:11.369499 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a445da-de41-415a-b391-4b4d153b888b service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:11.369499 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a445da-de41-415a-b391-4b4d153b888b service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:11.369499 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a445da-de41-415a-b391-4b4d153b888b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:11.377732 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a445da-de41-415a-b391-4b4d153b888b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:11.379207 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a445da-de41-415a-b391-4b4d153b888b service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:11.396324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 817/1610] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:11.399560 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd7284-4ddd-4c22-ba4c-43d2c3825fb4 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:11.403978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd7284-4ddd-4c22-ba4c-43d2c3825fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:11.403978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd7284-4ddd-4c22-ba4c-43d2c3825fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:11.404184 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:11.425392 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 794/1611] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:11.425392 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face3aae-7bfe-4cb6-aac6-fd9f57de7dd1 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:11.432781 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-60bd7284-4ddd-4c22-ba4c-43d2c3825fb4 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:11.434703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-60bd7284-4ddd-4c22-ba4c-43d2c3825fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:11.437732 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face3aae-7bfe-4cb6-aac6-fd9f57de7dd1 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:11.443782 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d0f12-ec64-4c5e-b0e0-08c81f92fb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:11.444825 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d0f12-ec64-4c5e-b0e0-08c81f92fb83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:11.445311 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d0f12-ec64-4c5e-b0e0-08c81f92fb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:11.445862 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d0f12-ec64-4c5e-b0e0-08c81f92fb83 admin admin] PATH_INFO: `/v3/projects/5f1f7a10bcbc4f45b7782f9a4aecede2/users/304a445c669448a6a06adb16b251b6a3/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:11.448690 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 818/1612] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:11.451032 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45b69e-f1b0-4c31-9cc2-3fd14b8ab64a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:11.453500 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45b69e-f1b0-4c31-9cc2-3fd14b8ab64a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:11.453702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45b69e-f1b0-4c31-9cc2-3fd14b8ab64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:11.466419 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d0f12-ec64-4c5e-b0e0-08c81f92fb83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1f7a10bcbc4f45b7782f9a4aecede2, user_id=304a445c669448a6a06adb16b251b6a3, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:11.469245 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d0f12-ec64-4c5e-b0e0-08c81f92fb83 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:11.501657 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-4f45b69e-f1b0-4c31-9cc2-3fd14b8ab64a None None] MFA Rules not processed for user `f7eac931cabf4921b6dbd42f63b9300f`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:11.502877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4f45b69e-f1b0-4c31-9cc2-3fd14b8ab64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:11.571860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 819/1613] 10.222.0.141 () {58 vars in 1064 bytes} [Tue Jul 26 16:23:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:11.573062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45b69e-f1b0-4c31-9cc2-3fd14b8ab64a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:11.581358 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 795/1614] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:11 2022] PUT /identity/v3/projects/5f1f7a10bcbc4f45b7782f9a4aecede2/users/304a445c669448a6a06adb16b251b6a3/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:11.582172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d0f12-ec64-4c5e-b0e0-08c81f92fb83 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:11.588826 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4f45b69e-f1b0-4c31-9cc2-3fd14b8ab64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:11.615979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45b69e-f1b0-4c31-9cc2-3fd14b8ab64a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:11.681685 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8181ba4-ed51-4ff9-b06d-4bd2fd565925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:11.683054 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8181ba4-ed51-4ff9-b06d-4bd2fd565925 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:11.683054 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8181ba4-ed51-4ff9-b06d-4bd2fd565925 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:11.683294 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8181ba4-ed51-4ff9-b06d-4bd2fd565925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:11.711928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d0f12-ec64-4c5e-b0e0-08c81f92fb83 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:11.716988 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668700a2-b285-4a91-b3cb-5cbe54466357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:11.717608 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668700a2-b285-4a91-b3cb-5cbe54466357 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:11.718112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668700a2-b285-4a91-b3cb-5cbe54466357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:11.718491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668700a2-b285-4a91-b3cb-5cbe54466357 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:11.719191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668700a2-b285-4a91-b3cb-5cbe54466357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:11.721125 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668700a2-b285-4a91-b3cb-5cbe54466357 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:11.764280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8181ba4-ed51-4ff9-b06d-4bd2fd565925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:11.765572 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8181ba4-ed51-4ff9-b06d-4bd2fd565925 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:11.780595 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 820/1615] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:11.782289 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8181ba4-ed51-4ff9-b06d-4bd2fd565925 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:11.796496 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:11.827840 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 796/1616] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:11 2022] POST /identity/v3/projects => generated 364 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:11.830792 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668700a2-b285-4a91-b3cb-5cbe54466357 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:11.851923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:11.878612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8181ba4-ed51-4ff9-b06d-4bd2fd565925 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:11.938247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668700a2-b285-4a91-b3cb-5cbe54466357 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:11.943163 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618fef4-ea50-4a30-8448-b3d793e32500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:11.943799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618fef4-ea50-4a30-8448-b3d793e32500 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:11.944132 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618fef4-ea50-4a30-8448-b3d793e32500 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:11.944415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618fef4-ea50-4a30-8448-b3d793e32500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:11.960015 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe3697-d17e-483b-94a2-41f95b6307df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:11.962110 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe3697-d17e-483b-94a2-41f95b6307df service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:11.962737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe3697-d17e-483b-94a2-41f95b6307df service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:11.963223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe3697-d17e-483b-94a2-41f95b6307df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:12.018112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618fef4-ea50-4a30-8448-b3d793e32500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:12.019954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618fef4-ea50-4a30-8448-b3d793e32500 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:12.035424 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 797/1617] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:12.036127 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618fef4-ea50-4a30-8448-b3d793e32500 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:12.039191 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe3697-d17e-483b-94a2-41f95b6307df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:12.044031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe3697-d17e-483b-94a2-41f95b6307df service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:12.051311 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 821/1618] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:12.052721 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c55a6a-9a79-4d4b-9b13-56136b53f7ad None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:12.053046 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c55a6a-9a79-4d4b-9b13-56136b53f7ad None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:12.053447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c55a6a-9a79-4d4b-9b13-56136b53f7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:12.086853 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c9c55a6a-9a79-4d4b-9b13-56136b53f7ad None None] MFA Rules not processed for user `304a445c669448a6a06adb16b251b6a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:12.088391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c9c55a6a-9a79-4d4b-9b13-56136b53f7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:12.154370 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618fef4-ea50-4a30-8448-b3d793e32500 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:12.169026 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 822/1619] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:12.169198 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e43d6-dddc-4400-8688-1c82aae75e09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:12.169198 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e43d6-dddc-4400-8688-1c82aae75e09 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:12.169198 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e43d6-dddc-4400-8688-1c82aae75e09 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:12.169198 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e43d6-dddc-4400-8688-1c82aae75e09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:12.169554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c55a6a-9a79-4d4b-9b13-56136b53f7ad None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:12.198834 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c55a6a-9a79-4d4b-9b13-56136b53f7ad None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:12.208757 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f690c6-d5f8-402d-9343-b61a7b18f5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:12.209503 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f690c6-d5f8-402d-9343-b61a7b18f5fb admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:12.210037 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f690c6-d5f8-402d-9343-b61a7b18f5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:12.210415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f690c6-d5f8-402d-9343-b61a7b18f5fb admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:12.211283 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f690c6-d5f8-402d-9343-b61a7b18f5fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:12.216131 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f690c6-d5f8-402d-9343-b61a7b18f5fb admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:12.243700 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:12.285221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e43d6-dddc-4400-8688-1c82aae75e09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:12.287001 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e43d6-dddc-4400-8688-1c82aae75e09 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:12.299240 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 798/1620] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:12.300497 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89e96-a29c-4089-baf7-1b46be7b95fe None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:12.300821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89e96-a29c-4089-baf7-1b46be7b95fe None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:12.301101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89e96-a29c-4089-baf7-1b46be7b95fe None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:12.304374 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 799/1621] 10.222.0.141 () {54 vars in 967 bytes} [Tue Jul 26 16:23:12 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:23:12.314637 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec90f8-0a4f-426a-aa16-ff58d17905df None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:12.316020 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec90f8-0a4f-426a-aa16-ff58d17905df None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:12.317013 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec90f8-0a4f-426a-aa16-ff58d17905df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:12.367927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c7ec90f8-0a4f-426a-aa16-ff58d17905df None None] MFA Rules not processed for user `f7eac931cabf4921b6dbd42f63b9300f`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:12.369342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c7ec90f8-0a4f-426a-aa16-ff58d17905df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:12.390471 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 823/1622] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:12 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:12.394374 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f690c6-d5f8-402d-9343-b61a7b18f5fb admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:12.398983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 800/1623] 10.222.0.141 () {58 vars in 1064 bytes} [Tue Jul 26 16:23:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:12.399979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec90f8-0a4f-426a-aa16-ff58d17905df None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:12.426209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f690c6-d5f8-402d-9343-b61a7b18f5fb admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:12.426324 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec90f8-0a4f-426a-aa16-ff58d17905df None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:12.436732 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78927880-35f9-4919-aeaa-fcbcf167cc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:12.437470 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78927880-35f9-4919-aeaa-fcbcf167cc28 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:12.437832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78927880-35f9-4919-aeaa-fcbcf167cc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:12.438184 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78927880-35f9-4919-aeaa-fcbcf167cc28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:12.438593 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e695bb-2523-430f-b6b6-11aecedf7d83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:12.439190 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78927880-35f9-4919-aeaa-fcbcf167cc28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:12.439319 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e695bb-2523-430f-b6b6-11aecedf7d83 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:12.439504 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e695bb-2523-430f-b6b6-11aecedf7d83 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:12.439783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e695bb-2523-430f-b6b6-11aecedf7d83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:12.441350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78927880-35f9-4919-aeaa-fcbcf167cc28 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:12.459474 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e695bb-2523-430f-b6b6-11aecedf7d83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:12.461167 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e695bb-2523-430f-b6b6-11aecedf7d83 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:12.463163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 824/1624] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:12 2022] GET /identity/v3/roles => generated 1427 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:12.467102 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78927880-35f9-4919-aeaa-fcbcf167cc28 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:12.489198 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78927880-35f9-4919-aeaa-fcbcf167cc28 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:12.489617 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:12.496939 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 801/1625] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:12.499097 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285add30-b842-4e5b-9ab8-ab12c41cea73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:12.500106 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285add30-b842-4e5b-9ab8-ab12c41cea73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:12.500444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285add30-b842-4e5b-9ab8-ab12c41cea73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:12.500851 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285add30-b842-4e5b-9ab8-ab12c41cea73 admin admin] PATH_INFO: `/v3/projects/3f87a2b5b64d4201b9c616d633faa5c2/users/c6ed91baccc5460e8db4330da2ccaa82/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:12.532097 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285add30-b842-4e5b-9ab8-ab12c41cea73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f87a2b5b64d4201b9c616d633faa5c2, user_id=c6ed91baccc5460e8db4330da2ccaa82, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:12.535087 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285add30-b842-4e5b-9ab8-ab12c41cea73 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:12.650604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 825/1626] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:12 2022] PUT /identity/v3/projects/3f87a2b5b64d4201b9c616d633faa5c2/users/c6ed91baccc5460e8db4330da2ccaa82/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:23:12.654324 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e695bb-2523-430f-b6b6-11aecedf7d83 service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:12.669995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e695bb-2523-430f-b6b6-11aecedf7d83 service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:12.715440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12700a-cc6e-492e-9a52-7088ac6dad98 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:12.719882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12700a-cc6e-492e-9a52-7088ac6dad98 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:12.719882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12700a-cc6e-492e-9a52-7088ac6dad98 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:12.719882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 826/1627] 10.222.0.141 () {54 vars in 917 bytes} [Tue Jul 26 16:23:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:23:12.730572 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aee9d-4ff8-4e88-85d9-94eecfdb869c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:12.731196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aee9d-4ff8-4e88-85d9-94eecfdb869c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:12.731694 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aee9d-4ff8-4e88-85d9-94eecfdb869c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:12.755771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-149aee9d-4ff8-4e88-85d9-94eecfdb869c None None] MFA Rules not processed for user `f7eac931cabf4921b6dbd42f63b9300f`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:12.758146 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-149aee9d-4ff8-4e88-85d9-94eecfdb869c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:12.845246 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da05a3-767d-44a7-8abd-adba3c5e7de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:12.845892 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da05a3-767d-44a7-8abd-adba3c5e7de9 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:12.846175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da05a3-767d-44a7-8abd-adba3c5e7de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:12.846451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da05a3-767d-44a7-8abd-adba3c5e7de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:12.847151 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da05a3-767d-44a7-8abd-adba3c5e7de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:12.848791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da05a3-767d-44a7-8abd-adba3c5e7de9 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:12.871012 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 802/1628] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:12 2022] GET /identity/v3/roles => generated 1427 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:12.875168 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da05a3-767d-44a7-8abd-adba3c5e7de9 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:12.893904 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 827/1629] 10.222.0.141 () {58 vars in 1014 bytes} [Tue Jul 26 16:23:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:23:12.894295 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da05a3-767d-44a7-8abd-adba3c5e7de9 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:12.907106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a04ce3-df93-4c9e-a408-0feb41ddc472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:12.907790 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a04ce3-df93-4c9e-a408-0feb41ddc472 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:12.908074 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a04ce3-df93-4c9e-a408-0feb41ddc472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:12.908349 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a04ce3-df93-4c9e-a408-0feb41ddc472 admin admin] PATH_INFO: `/v3/projects/3f87a2b5b64d4201b9c616d633faa5c2/users/c6ed91baccc5460e8db4330da2ccaa82/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:12.916292 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149aee9d-4ff8-4e88-85d9-94eecfdb869c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:12.921403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a04ce3-df93-4c9e-a408-0feb41ddc472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f87a2b5b64d4201b9c616d633faa5c2, user_id=c6ed91baccc5460e8db4330da2ccaa82, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:12.924115 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a04ce3-df93-4c9e-a408-0feb41ddc472 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:12.957859 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 803/1630] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:12 2022] PUT /identity/v3/projects/3f87a2b5b64d4201b9c616d633faa5c2/users/c6ed91baccc5460e8db4330da2ccaa82/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:23:12.968469 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee06dd-d98b-4570-907e-0b85f682cea9 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:12.969061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee06dd-d98b-4570-907e-0b85f682cea9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:12.969494 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee06dd-d98b-4570-907e-0b85f682cea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:13.033603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-6dee06dd-d98b-4570-907e-0b85f682cea9 None None] MFA Rules not processed for user `c6ed91baccc5460e8db4330da2ccaa82`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:13.035063 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6dee06dd-d98b-4570-907e-0b85f682cea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:13.198001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149aee9d-4ff8-4e88-85d9-94eecfdb869c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:13.198001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128dc61-efba-4092-8101-532d0d31e2fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:13.198001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128dc61-efba-4092-8101-532d0d31e2fb service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:13.198001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128dc61-efba-4092-8101-532d0d31e2fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:13.198618 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128dc61-efba-4092-8101-532d0d31e2fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:13.224549 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 804/1631] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:23:13.228883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcf0ef-e22d-4c23-bcc5-df8a484a2128 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:13.231832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcf0ef-e22d-4c23-bcc5-df8a484a2128 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:13.232356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcf0ef-e22d-4c23-bcc5-df8a484a2128 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:13.234793 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 805/1632] 10.222.0.141 () {54 vars in 917 bytes} [Tue Jul 26 16:23:13 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:23:13.240912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8031cba-49f4-4409-9712-6b15ba80cc8d None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:13.241533 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8031cba-49f4-4409-9712-6b15ba80cc8d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:13.242073 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8031cba-49f4-4409-9712-6b15ba80cc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:13.284069 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c8031cba-49f4-4409-9712-6b15ba80cc8d None None] MFA Rules not processed for user `f7eac931cabf4921b6dbd42f63b9300f`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:13.285586 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c8031cba-49f4-4409-9712-6b15ba80cc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:13.290795 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128dc61-efba-4092-8101-532d0d31e2fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:13.292576 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128dc61-efba-4092-8101-532d0d31e2fb service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:13.297996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 806/1633] 10.222.0.141 () {58 vars in 1014 bytes} [Tue Jul 26 16:23:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:13.310784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 828/1634] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:13.497206 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:13.561024 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8031cba-49f4-4409-9712-6b15ba80cc8d None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:13.579972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8031cba-49f4-4409-9712-6b15ba80cc8d None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:13.587515 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b97c23-d808-4358-890b-b737ebe5835d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:13.588212 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b97c23-d808-4358-890b-b737ebe5835d service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:13.588693 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b97c23-d808-4358-890b-b737ebe5835d service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:13.589138 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b97c23-d808-4358-890b-b737ebe5835d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:13.605048 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b97c23-d808-4358-890b-b737ebe5835d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:13.607076 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b97c23-d808-4358-890b-b737ebe5835d service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:13.669109 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 807/1635] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:13.840385 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128dc61-efba-4092-8101-532d0d31e2fb service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:13.852137 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128dc61-efba-4092-8101-532d0d31e2fb service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:13.861574 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fe79e-182c-4f20-820c-ff24780c381e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:13.862829 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fe79e-182c-4f20-820c-ff24780c381e service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:13.863118 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fe79e-182c-4f20-820c-ff24780c381e service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:13.864967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fe79e-182c-4f20-820c-ff24780c381e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:13.906441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88fe79e-182c-4f20-820c-ff24780c381e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:13.909174 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88fe79e-182c-4f20-820c-ff24780c381e service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:13.961813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 829/1636] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:16.312414 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b97c23-d808-4358-890b-b737ebe5835d service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:16.383236 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:16.495653 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b97c23-d808-4358-890b-b737ebe5835d service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:16.499448 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9e622-c661-4ce9-ae18-7a570e203038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:16.500257 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9e622-c661-4ce9-ae18-7a570e203038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:16.501578 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9e622-c661-4ce9-ae18-7a570e203038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:16.501977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9e622-c661-4ce9-ae18-7a570e203038 admin admin] PATH_INFO: `/v3/users/a409e3faaccd40d9b0a3d878d5d8a787` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:16.504222 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9e622-c661-4ce9-ae18-7a570e203038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a409e3faaccd40d9b0a3d878d5d8a787)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:16.510958 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9e622-c661-4ce9-ae18-7a570e203038 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:16.903357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0ac9e622-c661-4ce9-ae18-7a570e203038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a409e3faaccd40d9b0a3d878d5d8a787'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:16.904471 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0ac9e622-c661-4ce9-ae18-7a570e203038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a409e3faaccd40d9b0a3d878d5d8a787'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:16.950893 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0ac9e622-c661-4ce9-ae18-7a570e203038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a409e3faaccd40d9b0a3d878d5d8a787'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:16.969307 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0ac9e622-c661-4ce9-ae18-7a570e203038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a409e3faaccd40d9b0a3d878d5d8a787'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:17.091175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0ac9e622-c661-4ce9-ae18-7a570e203038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a409e3faaccd40d9b0a3d878d5d8a787'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:17.113303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd9e0d-a16a-4efe-b585-e71accdab8cd None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:17.113303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd9e0d-a16a-4efe-b585-e71accdab8cd None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:17.113303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd9e0d-a16a-4efe-b585-e71accdab8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:17.117779 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 808/1637] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:23:16 2022] DELETE /identity/v3/users/a409e3faaccd40d9b0a3d878d5d8a787 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:17.159918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-4bfd9e0d-a16a-4efe-b585-e71accdab8cd None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:17.162135 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4bfd9e0d-a16a-4efe-b585-e71accdab8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:17.331859 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 830/1638] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:23:17.363542 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9e622-c661-4ce9-ae18-7a570e203038 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:17.365051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0ac9e622-c661-4ce9-ae18-7a570e203038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:17.441462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9e622-c661-4ce9-ae18-7a570e203038 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:17.446636 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8833f2-6a23-46d4-b182-039485e524a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:17.448037 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8833f2-6a23-46d4-b182-039485e524a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:17.448952 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8833f2-6a23-46d4-b182-039485e524a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:17.449414 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8833f2-6a23-46d4-b182-039485e524a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:17.461829 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8833f2-6a23-46d4-b182-039485e524a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:17.463915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8833f2-6a23-46d4-b182-039485e524a9 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:17.479889 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 809/1639] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:23:18.735945 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd9e0d-a16a-4efe-b585-e71accdab8cd None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:18.737886 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4bfd9e0d-a16a-4efe-b585-e71accdab8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:18.761331 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd9e0d-a16a-4efe-b585-e71accdab8cd None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:18.776980 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43726329-bcab-45da-888f-cbe00b88cd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:18.778252 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43726329-bcab-45da-888f-cbe00b88cd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:18.778613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43726329-bcab-45da-888f-cbe00b88cd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:18.779138 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43726329-bcab-45da-888f-cbe00b88cd29 admin admin] PATH_INFO: `/v3/users/304a445c669448a6a06adb16b251b6a3` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:18.781384 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43726329-bcab-45da-888f-cbe00b88cd29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=304a445c669448a6a06adb16b251b6a3)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:18.782622 dv-cinder-851042-1-smb devstack@keystone.service[80601]: WARNING py.warnings [None req-43726329-bcab-45da-888f-cbe00b88cd29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:23:18.782622 dv-cinder-851042-1-smb devstack@keystone.service[80601]: warnings.warn(msg) Jul 26 16:23:18.782622 dv-cinder-851042-1-smb devstack@keystone.service[80601]: Jul 26 16:23:18.785662 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43726329-bcab-45da-888f-cbe00b88cd29 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:19.146036 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-43726329-bcab-45da-888f-cbe00b88cd29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '304a445c669448a6a06adb16b251b6a3'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:19.146810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-43726329-bcab-45da-888f-cbe00b88cd29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '304a445c669448a6a06adb16b251b6a3'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:19.417764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-43726329-bcab-45da-888f-cbe00b88cd29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '304a445c669448a6a06adb16b251b6a3'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:19.419991 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8833f2-6a23-46d4-b182-039485e524a9 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:19.428632 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4e8833f2-6a23-46d4-b182-039485e524a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:19.485290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8833f2-6a23-46d4-b182-039485e524a9 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:19.497802 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-43726329-bcab-45da-888f-cbe00b88cd29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '304a445c669448a6a06adb16b251b6a3'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:19.497937 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf8d06-32c3-49fd-90d9-eb8cca416812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:19.498270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-43726329-bcab-45da-888f-cbe00b88cd29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '304a445c669448a6a06adb16b251b6a3'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:19.498646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf8d06-32c3-49fd-90d9-eb8cca416812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:19.499915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf8d06-32c3-49fd-90d9-eb8cca416812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:19.500264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf8d06-32c3-49fd-90d9-eb8cca416812 admin admin] PATH_INFO: `/v3/projects/86b038e0226d4031baeee926d19de082` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:19.502092 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf8d06-32c3-49fd-90d9-eb8cca416812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b038e0226d4031baeee926d19de082)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:19.505846 dv-cinder-851042-1-smb devstack@keystone.service[80602]: WARNING py.warnings [None req-1fcf8d06-32c3-49fd-90d9-eb8cca416812 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:23:19.505846 dv-cinder-851042-1-smb devstack@keystone.service[80602]: warnings.warn(msg) Jul 26 16:23:19.505846 dv-cinder-851042-1-smb devstack@keystone.service[80602]: Jul 26 16:23:19.507282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf8d06-32c3-49fd-90d9-eb8cca416812 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:19.542518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 831/1640] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:23:18 2022] DELETE /identity/v3/users/304a445c669448a6a06adb16b251b6a3 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:19.544800 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868f707-1758-4d3b-9579-4a201530faa4 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:19.545144 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868f707-1758-4d3b-9579-4a201530faa4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:19.545485 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868f707-1758-4d3b-9579-4a201530faa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:19.585209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:19.600068 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-0868f707-1758-4d3b-9579-4a201530faa4 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:19.601523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0868f707-1758-4d3b-9579-4a201530faa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:19.772436 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:19.781223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 832/1641] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:19.813881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1fcf8d06-32c3-49fd-90d9-eb8cca416812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b038e0226d4031baeee926d19de082', 'request_id': 'req-1fcf8d06-32c3-49fd-90d9-eb8cca416812'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:19.883785 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868f707-1758-4d3b-9579-4a201530faa4 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:19.885410 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0868f707-1758-4d3b-9579-4a201530faa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:19.889370 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1fcf8d06-32c3-49fd-90d9-eb8cca416812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b038e0226d4031baeee926d19de082', 'request_id': 'req-1fcf8d06-32c3-49fd-90d9-eb8cca416812'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:19.919971 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1fcf8d06-32c3-49fd-90d9-eb8cca416812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b038e0226d4031baeee926d19de082', 'request_id': 'req-1fcf8d06-32c3-49fd-90d9-eb8cca416812'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:20.012909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1fcf8d06-32c3-49fd-90d9-eb8cca416812 admin admin] The token cache is being invalidate because project 86b038e0226d4031baeee926d19de082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:23:20.013460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1fcf8d06-32c3-49fd-90d9-eb8cca416812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:20.014886 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1fcf8d06-32c3-49fd-90d9-eb8cca416812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:20.020849 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 810/1642] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:23:19 2022] DELETE /identity/v3/projects/86b038e0226d4031baeee926d19de082 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:20.022380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf8d06-32c3-49fd-90d9-eb8cca416812 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:20.029978 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1fcf8d06-32c3-49fd-90d9-eb8cca416812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:20.094535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868f707-1758-4d3b-9579-4a201530faa4 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:20.222603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf8d06-32c3-49fd-90d9-eb8cca416812 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:20.227233 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a3235-fbd8-44c8-94e8-435b861045a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:20.227233 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a3235-fbd8-44c8-94e8-435b861045a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:20.227233 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a3235-fbd8-44c8-94e8-435b861045a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:20.228011 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a3235-fbd8-44c8-94e8-435b861045a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:20.228255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59625738-28aa-4a58-babc-df2f22a42cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:20.229030 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59625738-28aa-4a58-babc-df2f22a42cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:20.229391 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59625738-28aa-4a58-babc-df2f22a42cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:20.229670 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59625738-28aa-4a58-babc-df2f22a42cfa admin admin] PATH_INFO: `/v3/users/c6ed91baccc5460e8db4330da2ccaa82` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:20.230936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59625738-28aa-4a58-babc-df2f22a42cfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6ed91baccc5460e8db4330da2ccaa82)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:20.233653 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59625738-28aa-4a58-babc-df2f22a42cfa admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:20.243281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d04a3235-fbd8-44c8-94e8-435b861045a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:20.291390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a3235-fbd8-44c8-94e8-435b861045a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:20.291390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a3235-fbd8-44c8-94e8-435b861045a9 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:20.308247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 833/1643] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:23:20.589956 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-59625738-28aa-4a58-babc-df2f22a42cfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6ed91baccc5460e8db4330da2ccaa82'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:20.596718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-59625738-28aa-4a58-babc-df2f22a42cfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6ed91baccc5460e8db4330da2ccaa82'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:20.637461 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-59625738-28aa-4a58-babc-df2f22a42cfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6ed91baccc5460e8db4330da2ccaa82'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:20.657267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-59625738-28aa-4a58-babc-df2f22a42cfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6ed91baccc5460e8db4330da2ccaa82'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:20.749519 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-59625738-28aa-4a58-babc-df2f22a42cfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6ed91baccc5460e8db4330da2ccaa82'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:20.758732 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 811/1644] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:23:20 2022] DELETE /identity/v3/users/c6ed91baccc5460e8db4330da2ccaa82 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:22.027631 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a3235-fbd8-44c8-94e8-435b861045a9 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:22.035238 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d04a3235-fbd8-44c8-94e8-435b861045a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:22.061260 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a3235-fbd8-44c8-94e8-435b861045a9 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:22.132154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59625738-28aa-4a58-babc-df2f22a42cfa admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:22.134645 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-59625738-28aa-4a58-babc-df2f22a42cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:22.222430 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfe5c8-94fe-47e2-995b-99bf9ba11c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:22.226105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfe5c8-94fe-47e2-995b-99bf9ba11c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:22.226105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfe5c8-94fe-47e2-995b-99bf9ba11c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:22.226105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfe5c8-94fe-47e2-995b-99bf9ba11c78 admin admin] PATH_INFO: `/v3/users/946536697a3d4109af6c7cb90a613fa1` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:22.226105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfe5c8-94fe-47e2-995b-99bf9ba11c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=946536697a3d4109af6c7cb90a613fa1)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:22.227278 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfe5c8-94fe-47e2-995b-99bf9ba11c78 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:22.245009 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:22.340735 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59625738-28aa-4a58-babc-df2f22a42cfa admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:22.341609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:22.347150 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21536fa4-046c-4868-a779-317b506fcb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:22.348542 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21536fa4-046c-4868-a779-317b506fcb99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:22.349031 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21536fa4-046c-4868-a779-317b506fcb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:22.349596 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21536fa4-046c-4868-a779-317b506fcb99 admin admin] PATH_INFO: `/v3/projects/5f1f7a10bcbc4f45b7782f9a4aecede2` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:22.353625 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21536fa4-046c-4868-a779-317b506fcb99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f1f7a10bcbc4f45b7782f9a4aecede2)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:22.356750 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21536fa4-046c-4868-a779-317b506fcb99 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:22.504279 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-21536fa4-046c-4868-a779-317b506fcb99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f1f7a10bcbc4f45b7782f9a4aecede2', 'request_id': 'req-21536fa4-046c-4868-a779-317b506fcb99'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:22.539527 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-21536fa4-046c-4868-a779-317b506fcb99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f1f7a10bcbc4f45b7782f9a4aecede2', 'request_id': 'req-21536fa4-046c-4868-a779-317b506fcb99'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:22.547932 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-21536fa4-046c-4868-a779-317b506fcb99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f1f7a10bcbc4f45b7782f9a4aecede2', 'request_id': 'req-21536fa4-046c-4868-a779-317b506fcb99'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:22.613565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c3dfe5c8-94fe-47e2-995b-99bf9ba11c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '946536697a3d4109af6c7cb90a613fa1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:22.618323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c3dfe5c8-94fe-47e2-995b-99bf9ba11c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '946536697a3d4109af6c7cb90a613fa1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:22.635856 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-21536fa4-046c-4868-a779-317b506fcb99 admin admin] The token cache is being invalidate because project 5f1f7a10bcbc4f45b7782f9a4aecede2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:23:22.636153 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-21536fa4-046c-4868-a779-317b506fcb99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:22.638041 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-21536fa4-046c-4868-a779-317b506fcb99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:22.643869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 812/1645] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:23:22 2022] DELETE /identity/v3/projects/5f1f7a10bcbc4f45b7782f9a4aecede2 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:22.643869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21536fa4-046c-4868-a779-317b506fcb99 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:22.645566 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-21536fa4-046c-4868-a779-317b506fcb99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:22.726653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c3dfe5c8-94fe-47e2-995b-99bf9ba11c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '946536697a3d4109af6c7cb90a613fa1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:22.751154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c3dfe5c8-94fe-47e2-995b-99bf9ba11c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '946536697a3d4109af6c7cb90a613fa1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:22.752507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c3dfe5c8-94fe-47e2-995b-99bf9ba11c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '946536697a3d4109af6c7cb90a613fa1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:22.789638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 834/1646] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:23:22 2022] DELETE /identity/v3/users/946536697a3d4109af6c7cb90a613fa1 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:22.793290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862db23e-0d21-43d6-b45d-4e04d3351b47 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:22.793595 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862db23e-0d21-43d6-b45d-4e04d3351b47 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:22.796141 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862db23e-0d21-43d6-b45d-4e04d3351b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:22.804856 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21536fa4-046c-4868-a779-317b506fcb99 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:22.856045 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-862db23e-0d21-43d6-b45d-4e04d3351b47 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:22.860422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-862db23e-0d21-43d6-b45d-4e04d3351b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:22.936276 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85299a94-0c39-4593-a6d4-584667684bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:22.937804 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85299a94-0c39-4593-a6d4-584667684bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:22.939170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85299a94-0c39-4593-a6d4-584667684bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:22.940592 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85299a94-0c39-4593-a6d4-584667684bcb admin admin] PATH_INFO: `/v3/projects/3f87a2b5b64d4201b9c616d633faa5c2` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:22.944363 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85299a94-0c39-4593-a6d4-584667684bcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f87a2b5b64d4201b9c616d633faa5c2)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:22.948228 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85299a94-0c39-4593-a6d4-584667684bcb admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:23.007409 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 835/1647] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:23.009230 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a5e85-9f23-44f8-945a-0ce0f13ecfd1 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:23.009348 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a5e85-9f23-44f8-945a-0ce0f13ecfd1 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:23.009721 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a5e85-9f23-44f8-945a-0ce0f13ecfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:23.045590 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-aa3a5e85-9f23-44f8-945a-0ce0f13ecfd1 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:23.049042 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-aa3a5e85-9f23-44f8-945a-0ce0f13ecfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:23.060407 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 836/1648] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:23.062629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c65f5e-df11-4ba6-8716-566289a1ef42 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:23.063068 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c65f5e-df11-4ba6-8716-566289a1ef42 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:23.063466 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c65f5e-df11-4ba6-8716-566289a1ef42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:23.092138 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-40c65f5e-df11-4ba6-8716-566289a1ef42 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:23.093988 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-40c65f5e-df11-4ba6-8716-566289a1ef42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:23.110142 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 837/1649] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:23.111185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c65f5e-df11-4ba6-8716-566289a1ef42 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:23.112939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-40c65f5e-df11-4ba6-8716-566289a1ef42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:23.170892 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-85299a94-0c39-4593-a6d4-584667684bcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f87a2b5b64d4201b9c616d633faa5c2', 'request_id': 'req-85299a94-0c39-4593-a6d4-584667684bcb'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:23.178696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-85299a94-0c39-4593-a6d4-584667684bcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f87a2b5b64d4201b9c616d633faa5c2', 'request_id': 'req-85299a94-0c39-4593-a6d4-584667684bcb'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:23.197435 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-85299a94-0c39-4593-a6d4-584667684bcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f87a2b5b64d4201b9c616d633faa5c2', 'request_id': 'req-85299a94-0c39-4593-a6d4-584667684bcb'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:23.205138 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c65f5e-df11-4ba6-8716-566289a1ef42 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:23.239478 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:23.280127 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d7a17-0a7b-42b2-b31c-a8cdc23f5dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:23.281207 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d7a17-0a7b-42b2-b31c-a8cdc23f5dea service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:23.281705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d7a17-0a7b-42b2-b31c-a8cdc23f5dea service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:23.282195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d7a17-0a7b-42b2-b31c-a8cdc23f5dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:23.303700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-85299a94-0c39-4593-a6d4-584667684bcb admin admin] The token cache is being invalidate because project 3f87a2b5b64d4201b9c616d633faa5c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:23:23.303700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-85299a94-0c39-4593-a6d4-584667684bcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:23.304529 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-85299a94-0c39-4593-a6d4-584667684bcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:23.306439 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 813/1650] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:23:22 2022] DELETE /identity/v3/projects/3f87a2b5b64d4201b9c616d633faa5c2 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:23.307585 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85299a94-0c39-4593-a6d4-584667684bcb admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:23.309176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-85299a94-0c39-4593-a6d4-584667684bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:23.373523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d7a17-0a7b-42b2-b31c-a8cdc23f5dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:23.376566 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d7a17-0a7b-42b2-b31c-a8cdc23f5dea service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:23.396238 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 838/1651] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:23.400856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4fc5a-ecf2-4cd8-9fc7-4bf329433e55 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:23.401890 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4fc5a-ecf2-4cd8-9fc7-4bf329433e55 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:23.401890 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4fc5a-ecf2-4cd8-9fc7-4bf329433e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:23.438815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-fcd4fc5a-ecf2-4cd8-9fc7-4bf329433e55 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:23.446561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fcd4fc5a-ecf2-4cd8-9fc7-4bf329433e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:23.466501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 839/1652] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:23.466501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa0800-2850-4a42-9439-764ec3eac71e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:23.466501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa0800-2850-4a42-9439-764ec3eac71e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:23.466501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa0800-2850-4a42-9439-764ec3eac71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:23.504186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f7fa0800-2850-4a42-9439-764ec3eac71e None None] MFA Rules not processed for user `6a56919ded5645c290058d80ddc97f76`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:23.505942 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f7fa0800-2850-4a42-9439-764ec3eac71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:23.523074 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85299a94-0c39-4593-a6d4-584667684bcb admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:23.544625 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bca29-e4f5-4e6d-b594-3d9e1661fb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:23.545300 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bca29-e4f5-4e6d-b594-3d9e1661fb97 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:23.545592 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bca29-e4f5-4e6d-b594-3d9e1661fb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:23.556743 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bca29-e4f5-4e6d-b594-3d9e1661fb97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:23.556743 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bca29-e4f5-4e6d-b594-3d9e1661fb97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:23:23.556743 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bca29-e4f5-4e6d-b594-3d9e1661fb97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:23.556743 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bca29-e4f5-4e6d-b594-3d9e1661fb97 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:23.590688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 814/1653] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:23:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:23:23.590688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765b433-09ce-4f03-bf5f-02d6d37cf68c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:23.590688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765b433-09ce-4f03-bf5f-02d6d37cf68c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:23.590688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765b433-09ce-4f03-bf5f-02d6d37cf68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:23.631967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 840/1654] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:23.633607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa0800-2850-4a42-9439-764ec3eac71e None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:23.652088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-6765b433-09ce-4f03-bf5f-02d6d37cf68c None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:23.653718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6765b433-09ce-4f03-bf5f-02d6d37cf68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:23.657800 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa0800-2850-4a42-9439-764ec3eac71e None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:23.665966 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3aa1d7-304f-426c-8a61-7c377e9e1447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:23.668481 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3aa1d7-304f-426c-8a61-7c377e9e1447 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:23.669382 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3aa1d7-304f-426c-8a61-7c377e9e1447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:23.669995 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3aa1d7-304f-426c-8a61-7c377e9e1447 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:23.670804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3aa1d7-304f-426c-8a61-7c377e9e1447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:23.673457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3aa1d7-304f-426c-8a61-7c377e9e1447 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:23.685091 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 815/1655] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:23.686627 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0db7b-d107-408d-b7ef-ab376853e485 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:23.686924 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0db7b-d107-408d-b7ef-ab376853e485 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:23.687203 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0db7b-d107-408d-b7ef-ab376853e485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:23.734227 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-96d0db7b-d107-408d-b7ef-ab376853e485 None None] MFA Rules not processed for user `6a56919ded5645c290058d80ddc97f76`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:23.735885 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-96d0db7b-d107-408d-b7ef-ab376853e485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:23.744304 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 816/1656] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:23.745441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0db7b-d107-408d-b7ef-ab376853e485 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:23.758941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0db7b-d107-408d-b7ef-ab376853e485 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:23.764460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946f9bf-0186-49c2-be73-d137898ca211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:23.765273 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946f9bf-0186-49c2-be73-d137898ca211 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:23.765802 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946f9bf-0186-49c2-be73-d137898ca211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:23.766489 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946f9bf-0186-49c2-be73-d137898ca211 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:23.767123 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946f9bf-0186-49c2-be73-d137898ca211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:23:23.767537 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946f9bf-0186-49c2-be73-d137898ca211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:23.769533 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946f9bf-0186-49c2-be73-d137898ca211 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:23.780936 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 841/1657] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:23 2022] POST /identity/v3/projects => generated 404 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:23.781865 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3aa1d7-304f-426c-8a61-7c377e9e1447 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:23.785375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-da3aa1d7-304f-426c-8a61-7c377e9e1447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:23.814369 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 817/1658] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:23:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:23:23.815667 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946f9bf-0186-49c2-be73-d137898ca211 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:23.840677 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946f9bf-0186-49c2-be73-d137898ca211 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:23.980749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3aa1d7-304f-426c-8a61-7c377e9e1447 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:23.986329 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:23.994400 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8fc54-cc2d-4f92-90ec-273d61da3d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:23.996147 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8fc54-cc2d-4f92-90ec-273d61da3d6a admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:23.996147 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8fc54-cc2d-4f92-90ec-273d61da3d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:23.996147 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8fc54-cc2d-4f92-90ec-273d61da3d6a admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:23.998687 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03447601-f9e5-42ac-8ed0-44c3110920f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:24.000213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8fc54-cc2d-4f92-90ec-273d61da3d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:24.000540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03447601-f9e5-42ac-8ed0-44c3110920f7 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:24.000951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03447601-f9e5-42ac-8ed0-44c3110920f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:24.002786 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03447601-f9e5-42ac-8ed0-44c3110920f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:24.004588 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8fc54-cc2d-4f92-90ec-273d61da3d6a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:24.162920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 818/1659] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:23 2022] POST /identity/v3/users => generated 303 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:24.164962 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8fc54-cc2d-4f92-90ec-273d61da3d6a admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:24.185212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03447601-f9e5-42ac-8ed0-44c3110920f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:24.186911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03447601-f9e5-42ac-8ed0-44c3110920f7 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:24.188639 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8fc54-cc2d-4f92-90ec-273d61da3d6a admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:24.237783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9d5d3-4b70-4f16-bcfb-b89b696fc53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:24.237783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9d5d3-4b70-4f16-bcfb-b89b696fc53e admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:24.237783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9d5d3-4b70-4f16-bcfb-b89b696fc53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:24.237783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9d5d3-4b70-4f16-bcfb-b89b696fc53e admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:24.238965 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9d5d3-4b70-4f16-bcfb-b89b696fc53e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:24.238965 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9d5d3-4b70-4f16-bcfb-b89b696fc53e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:24.239103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 842/1660] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:24.239103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03447601-f9e5-42ac-8ed0-44c3110920f7 service nova] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:24.247331 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03447601-f9e5-42ac-8ed0-44c3110920f7 service nova] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:24.264618 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2b462-2616-41e5-a68c-e5ba02c8c9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:24.265427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2b462-2616-41e5-a68c-e5ba02c8c9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:24.265737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2b462-2616-41e5-a68c-e5ba02c8c9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:24.266175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2b462-2616-41e5-a68c-e5ba02c8c9f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:24.266897 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2b462-2616-41e5-a68c-e5ba02c8c9f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:24.273387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2b462-2616-41e5-a68c-e5ba02c8c9f8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:24.305221 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 843/1661] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:24 2022] GET /identity/v3/roles => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:24.308564 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2b462-2616-41e5-a68c-e5ba02c8c9f8 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:24.331523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2b462-2616-41e5-a68c-e5ba02c8c9f8 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:24.342291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5103c1-59a9-4ff2-bf3f-0f3131814039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:24.342941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5103c1-59a9-4ff2-bf3f-0f3131814039 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:24.343228 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5103c1-59a9-4ff2-bf3f-0f3131814039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:24.343507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5103c1-59a9-4ff2-bf3f-0f3131814039 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:24.344203 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5103c1-59a9-4ff2-bf3f-0f3131814039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:24.349394 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5103c1-59a9-4ff2-bf3f-0f3131814039 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:24.378776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 844/1662] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:24 2022] GET /identity/v3/roles => generated 1427 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:24.379812 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5103c1-59a9-4ff2-bf3f-0f3131814039 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:24.403606 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 819/1663] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:24 2022] POST /identity/v3/projects => generated 386 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:24.407573 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9d5d3-4b70-4f16-bcfb-b89b696fc53e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:24.428979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5103c1-59a9-4ff2-bf3f-0f3131814039 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:24.566537 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9d5d3-4b70-4f16-bcfb-b89b696fc53e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:24.571744 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da0778-3b57-4ee9-bda0-d945fdd363b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:24.573119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da0778-3b57-4ee9-bda0-d945fdd363b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:24.573622 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da0778-3b57-4ee9-bda0-d945fdd363b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:24.574169 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da0778-3b57-4ee9-bda0-d945fdd363b8 admin admin] PATH_INFO: `/v3/projects/64574ad71937449a8b091eb154db0f5a/users/7d96314143f7446caf8a1caf1ebfec9c/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:24.578336 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110548f-4a76-4975-b9af-c801bdbfdb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:24.579167 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110548f-4a76-4975-b9af-c801bdbfdb1f admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:24.579585 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110548f-4a76-4975-b9af-c801bdbfdb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:24.580005 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110548f-4a76-4975-b9af-c801bdbfdb1f admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:24.580868 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110548f-4a76-4975-b9af-c801bdbfdb1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:24.583403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110548f-4a76-4975-b9af-c801bdbfdb1f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:24.602064 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da0778-3b57-4ee9-bda0-d945fdd363b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64574ad71937449a8b091eb154db0f5a, user_id=7d96314143f7446caf8a1caf1ebfec9c, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:24.608249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da0778-3b57-4ee9-bda0-d945fdd363b8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:24.709797 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 820/1664] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:24 2022] POST /identity/v3/users => generated 294 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:23:24.714823 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110548f-4a76-4975-b9af-c801bdbfdb1f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:24.730550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110548f-4a76-4975-b9af-c801bdbfdb1f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:24.732357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 845/1665] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:24 2022] PUT /identity/v3/projects/64574ad71937449a8b091eb154db0f5a/users/7d96314143f7446caf8a1caf1ebfec9c/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:24.735223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5843fff-12b5-4c27-bdaf-235d93996cba None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:24.735625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5843fff-12b5-4c27-bdaf-235d93996cba None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:24.736885 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5843fff-12b5-4c27-bdaf-235d93996cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:24.778612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a5843fff-12b5-4c27-bdaf-235d93996cba None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:24.783131 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a5843fff-12b5-4c27-bdaf-235d93996cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:24.807924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:24.858972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4e9fa-00e0-41dc-a81b-175321172e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:24.859650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4e9fa-00e0-41dc-a81b-175321172e68 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:24.860079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4e9fa-00e0-41dc-a81b-175321172e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:24.860368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4e9fa-00e0-41dc-a81b-175321172e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:24.861267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4e9fa-00e0-41dc-a81b-175321172e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:24.874687 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4e9fa-00e0-41dc-a81b-175321172e68 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:24.893725 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 821/1666] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:24 2022] GET /identity/v3/roles => generated 1427 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:23:24.894678 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4e9fa-00e0-41dc-a81b-175321172e68 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:24.923638 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4e9fa-00e0-41dc-a81b-175321172e68 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:24.943694 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79f9cd-6916-45f4-97ec-29a73920b66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:24.944605 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79f9cd-6916-45f4-97ec-29a73920b66f admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:24.944605 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79f9cd-6916-45f4-97ec-29a73920b66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:24.945471 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79f9cd-6916-45f4-97ec-29a73920b66f admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:24.946269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79f9cd-6916-45f4-97ec-29a73920b66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:24.947836 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79f9cd-6916-45f4-97ec-29a73920b66f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:24.972432 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 846/1667] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:24.975740 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 822/1668] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:24 2022] GET /identity/v3/roles => generated 1427 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:24.976385 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5843fff-12b5-4c27-bdaf-235d93996cba None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:24.982152 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5843fff-12b5-4c27-bdaf-235d93996cba None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:24.995655 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce49cc2-7ead-460b-8ffc-d4969bee3037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:24.996510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce49cc2-7ead-460b-8ffc-d4969bee3037 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:24.997110 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce49cc2-7ead-460b-8ffc-d4969bee3037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:24.998504 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce49cc2-7ead-460b-8ffc-d4969bee3037 admin admin] PATH_INFO: `/v3/projects/9bdb12011e414dd7b0b2883e130ebae3/users/fbc28c805e3b4af5b8607b6a9c54b7b6/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:25.012356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79f9cd-6916-45f4-97ec-29a73920b66f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:25.015655 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3c79f9cd-6916-45f4-97ec-29a73920b66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:25.066204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce49cc2-7ead-460b-8ffc-d4969bee3037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bdb12011e414dd7b0b2883e130ebae3, user_id=fbc28c805e3b4af5b8607b6a9c54b7b6, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:25.070931 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce49cc2-7ead-460b-8ffc-d4969bee3037 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:25.172876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 847/1669] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:24 2022] PUT /identity/v3/projects/9bdb12011e414dd7b0b2883e130ebae3/users/fbc28c805e3b4af5b8607b6a9c54b7b6/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:25.173645 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79f9cd-6916-45f4-97ec-29a73920b66f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:25.176967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ce0ba-f4f8-4f72-a876-d0ecf58c4b67 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:25.177329 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ce0ba-f4f8-4f72-a876-d0ecf58c4b67 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:25.177687 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ce0ba-f4f8-4f72-a876-d0ecf58c4b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:25.301793 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2c9ce0ba-f4f8-4f72-a876-d0ecf58c4b67 None None] MFA Rules not processed for user `fbc28c805e3b4af5b8607b6a9c54b7b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:25.303040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2c9ce0ba-f4f8-4f72-a876-d0ecf58c4b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:25.383292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f008b7-0a6f-439f-80d3-edb193b39c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:25.384012 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f008b7-0a6f-439f-80d3-edb193b39c26 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:25.384299 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f008b7-0a6f-439f-80d3-edb193b39c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:25.384573 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f008b7-0a6f-439f-80d3-edb193b39c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:25.521599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 848/1670] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:25.537217 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ce0ba-f4f8-4f72-a876-d0ecf58c4b67 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:25.537217 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2c9ce0ba-f4f8-4f72-a876-d0ecf58c4b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:25.573170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f008b7-0a6f-439f-80d3-edb193b39c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:25.574651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f008b7-0a6f-439f-80d3-edb193b39c26 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:25.615646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 823/1671] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:25.617146 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f37947-ff37-4ee3-bcda-baf3c0c888f0 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:25.617334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f37947-ff37-4ee3-bcda-baf3c0c888f0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:25.617595 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f37947-ff37-4ee3-bcda-baf3c0c888f0 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:25.627287 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 824/1672] 10.222.0.141 () {54 vars in 917 bytes} [Tue Jul 26 16:23:25 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:23:25.628212 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f37947-ff37-4ee3-bcda-baf3c0c888f0 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:25.661046 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f37947-ff37-4ee3-bcda-baf3c0c888f0 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:25.671389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f08c4-991a-4c18-97fa-bc7cfdf743d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:25.672078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f08c4-991a-4c18-97fa-bc7cfdf743d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:25.672364 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f08c4-991a-4c18-97fa-bc7cfdf743d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:25.672568 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f08c4-991a-4c18-97fa-bc7cfdf743d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:25.673584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f08c4-991a-4c18-97fa-bc7cfdf743d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:25.681404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f08c4-991a-4c18-97fa-bc7cfdf743d4 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:25.717167 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ce0ba-f4f8-4f72-a876-d0ecf58c4b67 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:25.724095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1e3af-71aa-423b-95c0-77d7fb6e32df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:25.725025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1e3af-71aa-423b-95c0-77d7fb6e32df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:25.731298 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1e3af-71aa-423b-95c0-77d7fb6e32df admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:25.731298 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1e3af-71aa-423b-95c0-77d7fb6e32df admin admin] PATH_INFO: `/v3/projects/285fe70bd1a24e1a83f7d655356630a8` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:25.731298 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1e3af-71aa-423b-95c0-77d7fb6e32df admin admin] RBAC: Authorizing `identity:delete_project(project_id=285fe70bd1a24e1a83f7d655356630a8)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:25.731298 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1e3af-71aa-423b-95c0-77d7fb6e32df admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:25.851975 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 825/1673] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:25 2022] POST /identity/v3/projects => generated 386 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:25.853363 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592d2d9-de11-4c2f-a02a-e5f21c339cab None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:25.853659 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592d2d9-de11-4c2f-a02a-e5f21c339cab None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:25.853939 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592d2d9-de11-4c2f-a02a-e5f21c339cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:25.943986 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b4f1e3af-71aa-423b-95c0-77d7fb6e32df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '285fe70bd1a24e1a83f7d655356630a8', 'request_id': 'req-b4f1e3af-71aa-423b-95c0-77d7fb6e32df'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:25.956057 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:25.965071 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b4f1e3af-71aa-423b-95c0-77d7fb6e32df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '285fe70bd1a24e1a83f7d655356630a8', 'request_id': 'req-b4f1e3af-71aa-423b-95c0-77d7fb6e32df'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:25.988158 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b4f1e3af-71aa-423b-95c0-77d7fb6e32df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '285fe70bd1a24e1a83f7d655356630a8', 'request_id': 'req-b4f1e3af-71aa-423b-95c0-77d7fb6e32df'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:26.041128 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b592d2d9-de11-4c2f-a02a-e5f21c339cab None None] MFA Rules not processed for user `d1a99faad91b4357973f4bbb6632c724`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:26.052469 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b592d2d9-de11-4c2f-a02a-e5f21c339cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:26.119775 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b4f1e3af-71aa-423b-95c0-77d7fb6e32df admin admin] The token cache is being invalidate because project 285fe70bd1a24e1a83f7d655356630a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:23:26.120328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b4f1e3af-71aa-423b-95c0-77d7fb6e32df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:26.121636 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b4f1e3af-71aa-423b-95c0-77d7fb6e32df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:26.123851 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 849/1674] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:23:25 2022] DELETE /identity/v3/projects/285fe70bd1a24e1a83f7d655356630a8 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:26.126916 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1e3af-71aa-423b-95c0-77d7fb6e32df admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:26.131919 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b4f1e3af-71aa-423b-95c0-77d7fb6e32df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:26.192877 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 826/1675] 10.222.0.141 () {58 vars in 1014 bytes} [Tue Jul 26 16:23:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:26.194261 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35e1bf-31eb-4ca9-9e81-d104c7760eef None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:26.194598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35e1bf-31eb-4ca9-9e81-d104c7760eef None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:26.194886 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35e1bf-31eb-4ca9-9e81-d104c7760eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:26.245275 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-3d35e1bf-31eb-4ca9-9e81-d104c7760eef None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:26.246566 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3d35e1bf-31eb-4ca9-9e81-d104c7760eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:26.279565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:26.352405 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1e3af-71aa-423b-95c0-77d7fb6e32df admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:26.360970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f9c3e-7664-4ba1-8f04-4a6ac3d6f456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:26.361672 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f9c3e-7664-4ba1-8f04-4a6ac3d6f456 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:26.361958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f9c3e-7664-4ba1-8f04-4a6ac3d6f456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:26.362237 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f9c3e-7664-4ba1-8f04-4a6ac3d6f456 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:26.362919 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f9c3e-7664-4ba1-8f04-4a6ac3d6f456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:26.367193 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f9c3e-7664-4ba1-8f04-4a6ac3d6f456 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:26.504953 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 850/1677] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:26 2022] POST /identity/v3/users => generated 300 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:26.504953 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb0b16-6320-4f6c-b92f-2b33b3194931 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:26.504953 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb0b16-6320-4f6c-b92f-2b33b3194931 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:26.504953 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb0b16-6320-4f6c-b92f-2b33b3194931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:26.505269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 827/1677] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:26.509642 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35e1bf-31eb-4ca9-9e81-d104c7760eef None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:26.549140 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35e1bf-31eb-4ca9-9e81-d104c7760eef None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:26.574540 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64401a9-6459-4b34-9122-42d10c68c1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:26.575284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64401a9-6459-4b34-9122-42d10c68c1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:26.575566 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64401a9-6459-4b34-9122-42d10c68c1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:26.575838 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64401a9-6459-4b34-9122-42d10c68c1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:26.576550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64401a9-6459-4b34-9122-42d10c68c1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:26.590045 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64401a9-6459-4b34-9122-42d10c68c1c0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:26.605783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-efcb0b16-6320-4f6c-b92f-2b33b3194931 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:26.610464 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-efcb0b16-6320-4f6c-b92f-2b33b3194931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:26.632046 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 828/1678] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:26 2022] GET /identity/v3/roles => generated 1427 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:26.636137 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64401a9-6459-4b34-9122-42d10c68c1c0 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:26.637517 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 851/1679] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:26.640749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb0b16-6320-4f6c-b92f-2b33b3194931 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:26.642831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d64401a9-6459-4b34-9122-42d10c68c1c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:26.662226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb0b16-6320-4f6c-b92f-2b33b3194931 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:26.678012 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec83a7-e229-4bb6-8c41-9c245130fa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:26.693011 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64401a9-6459-4b34-9122-42d10c68c1c0 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:26.693605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec83a7-e229-4bb6-8c41-9c245130fa2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:26.694205 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec83a7-e229-4bb6-8c41-9c245130fa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:26.695305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec83a7-e229-4bb6-8c41-9c245130fa2e admin admin] PATH_INFO: `/v3/projects/80e35f28c4a94fd2af0798477f05ea26/users/d2337bb488e447a1a57802806b150842/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:26.708428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9de04-dfd1-42fd-a77e-ea483bc53760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:26.709295 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9de04-dfd1-42fd-a77e-ea483bc53760 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:26.716399 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9de04-dfd1-42fd-a77e-ea483bc53760 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:26.717507 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9de04-dfd1-42fd-a77e-ea483bc53760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:26.728321 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec83a7-e229-4bb6-8c41-9c245130fa2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=80e35f28c4a94fd2af0798477f05ea26, user_id=d2337bb488e447a1a57802806b150842, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:26.731202 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec83a7-e229-4bb6-8c41-9c245130fa2e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:26.738757 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9de04-dfd1-42fd-a77e-ea483bc53760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:26.742431 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9de04-dfd1-42fd-a77e-ea483bc53760 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:26.765782 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 829/1680] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:26.766819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9de04-dfd1-42fd-a77e-ea483bc53760 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:26.797098 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9de04-dfd1-42fd-a77e-ea483bc53760 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:26.810074 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78658bbb-cf27-4495-b969-e5feaa222536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:26.812028 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78658bbb-cf27-4495-b969-e5feaa222536 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:26.813136 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78658bbb-cf27-4495-b969-e5feaa222536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:26.814970 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78658bbb-cf27-4495-b969-e5feaa222536 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:26.816164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78658bbb-cf27-4495-b969-e5feaa222536 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:23:26.816585 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78658bbb-cf27-4495-b969-e5feaa222536 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:26.820754 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78658bbb-cf27-4495-b969-e5feaa222536 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:26.853438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 830/1681] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:23:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:23:26.854815 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78658bbb-cf27-4495-b969-e5feaa222536 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:26.861848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 852/1682] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:26 2022] PUT /identity/v3/projects/80e35f28c4a94fd2af0798477f05ea26/users/d2337bb488e447a1a57802806b150842/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:26.865714 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec83a7-e229-4bb6-8c41-9c245130fa2e admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:26.894963 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78658bbb-cf27-4495-b969-e5feaa222536 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:26.987539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec83a7-e229-4bb6-8c41-9c245130fa2e admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:26.994878 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8253e-294f-4d42-8779-00630d2e45f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:26.995643 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8253e-294f-4d42-8779-00630d2e45f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:26.996105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8253e-294f-4d42-8779-00630d2e45f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:26.996459 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8253e-294f-4d42-8779-00630d2e45f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:26.997382 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8253e-294f-4d42-8779-00630d2e45f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:26.999580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8253e-294f-4d42-8779-00630d2e45f1 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:27.033368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 853/1683] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:26 2022] GET /identity/v3/roles => generated 1427 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:23:27.039092 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d743b2-44d3-419f-880d-d35f982e7dee None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:27.039092 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d743b2-44d3-419f-880d-d35f982e7dee None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:27.039403 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d743b2-44d3-419f-880d-d35f982e7dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:27.103437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a48c5-2571-4cdd-b44b-78f3f7a3b530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:27.104231 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a48c5-2571-4cdd-b44b-78f3f7a3b530 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:27.105045 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a7d743b2-44d3-419f-880d-d35f982e7dee None None] MFA Rules not processed for user `2e75b38158404b298375fab5234851b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:27.110523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a48c5-2571-4cdd-b44b-78f3f7a3b530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:27.110523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a48c5-2571-4cdd-b44b-78f3f7a3b530 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:27.110523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a48c5-2571-4cdd-b44b-78f3f7a3b530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:27.110778 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a7d743b2-44d3-419f-880d-d35f982e7dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:27.110863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a48c5-2571-4cdd-b44b-78f3f7a3b530 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:27.225077 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 831/1684] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:26 2022] POST /identity/v3/projects => generated 364 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:27.226047 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a48c5-2571-4cdd-b44b-78f3f7a3b530 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:27.228601 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8d4a48c5-2571-4cdd-b44b-78f3f7a3b530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:27.276305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 854/1685] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:27.277863 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d743b2-44d3-419f-880d-d35f982e7dee None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:27.303669 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d743b2-44d3-419f-880d-d35f982e7dee None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:27.418606 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a48c5-2571-4cdd-b44b-78f3f7a3b530 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:27.435684 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a36f3c-fd55-4818-b0ca-b961a345b23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:27.439466 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a36f3c-fd55-4818-b0ca-b961a345b23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:27.439466 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a36f3c-fd55-4818-b0ca-b961a345b23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:27.439466 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a36f3c-fd55-4818-b0ca-b961a345b23f admin admin] PATH_INFO: `/v3/users/11a137eec22440ce9b26d5e207355c05` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:27.439710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:27.440126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a36f3c-fd55-4818-b0ca-b961a345b23f admin admin] RBAC: Authorizing `identity:delete_user(user_id=11a137eec22440ce9b26d5e207355c05)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:27.442152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a36f3c-fd55-4818-b0ca-b961a345b23f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:27.459447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60102c1-d49c-4579-8ee0-9240ece86506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:27.460341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60102c1-d49c-4579-8ee0-9240ece86506 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:27.461561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60102c1-d49c-4579-8ee0-9240ece86506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:27.461561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60102c1-d49c-4579-8ee0-9240ece86506 admin admin] PATH_INFO: `/v3/projects/80e35f28c4a94fd2af0798477f05ea26/users/d2337bb488e447a1a57802806b150842/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:27.464589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60102c1-d49c-4579-8ee0-9240ece86506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80e35f28c4a94fd2af0798477f05ea26, user_id=d2337bb488e447a1a57802806b150842, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:27.468145 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60102c1-d49c-4579-8ee0-9240ece86506 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:27.482046 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 855/1686] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:27 2022] PUT /identity/v3/projects/80e35f28c4a94fd2af0798477f05ea26/users/d2337bb488e447a1a57802806b150842/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:27.484489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60102c1-d49c-4579-8ee0-9240ece86506 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:27.503724 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:27.617637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60102c1-d49c-4579-8ee0-9240ece86506 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:27.624525 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea9968-bbb6-477a-a40c-8854ba6df72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:27.625317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea9968-bbb6-477a-a40c-8854ba6df72f admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:27.625487 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea9968-bbb6-477a-a40c-8854ba6df72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:27.625896 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea9968-bbb6-477a-a40c-8854ba6df72f admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:27.626746 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea9968-bbb6-477a-a40c-8854ba6df72f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:27.628851 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea9968-bbb6-477a-a40c-8854ba6df72f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:27.745935 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 856/1687] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:27 2022] POST /identity/v3/users => generated 283 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:27.745935 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea9968-bbb6-477a-a40c-8854ba6df72f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:27.746652 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-50ea9968-bbb6-477a-a40c-8854ba6df72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:27.799893 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-35a36f3c-fd55-4818-b0ca-b961a345b23f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11a137eec22440ce9b26d5e207355c05'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:27.802654 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-35a36f3c-fd55-4818-b0ca-b961a345b23f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11a137eec22440ce9b26d5e207355c05'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:27.845229 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-35a36f3c-fd55-4818-b0ca-b961a345b23f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11a137eec22440ce9b26d5e207355c05'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:27.874303 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-35a36f3c-fd55-4818-b0ca-b961a345b23f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11a137eec22440ce9b26d5e207355c05'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:27.963716 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea9968-bbb6-477a-a40c-8854ba6df72f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:27.969256 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-35a36f3c-fd55-4818-b0ca-b961a345b23f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11a137eec22440ce9b26d5e207355c05'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:27.970442 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074eecbd-f2d2-4069-ab66-ec74de8e5492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:27.971172 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074eecbd-f2d2-4069-ab66-ec74de8e5492 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:27.971485 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074eecbd-f2d2-4069-ab66-ec74de8e5492 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:27.971707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074eecbd-f2d2-4069-ab66-ec74de8e5492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:27.977922 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-074eecbd-f2d2-4069-ab66-ec74de8e5492 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:27.979864 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 832/1688] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:23:27 2022] DELETE /identity/v3/users/11a137eec22440ce9b26d5e207355c05 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:27.981322 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390a461-492b-4b81-a0df-75aece90fb32 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:27.984312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390a461-492b-4b81-a0df-75aece90fb32 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:27.987493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390a461-492b-4b81-a0df-75aece90fb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:28.047850 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b390a461-492b-4b81-a0df-75aece90fb32 None None] MFA Rules not processed for user `d2337bb488e447a1a57802806b150842`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:28.049695 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b390a461-492b-4b81-a0df-75aece90fb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:28.140592 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074eecbd-f2d2-4069-ab66-ec74de8e5492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:28.142253 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074eecbd-f2d2-4069-ab66-ec74de8e5492 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:28.177670 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 857/1689] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:28.180263 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78830809-f081-4778-b88f-5a3686d5dcc4 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:28.180811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78830809-f081-4778-b88f-5a3686d5dcc4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:28.183239 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78830809-f081-4778-b88f-5a3686d5dcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:28.222887 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 833/1690] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:28.224030 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390a461-492b-4b81-a0df-75aece90fb32 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:28.228373 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b390a461-492b-4b81-a0df-75aece90fb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:28.244131 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-78830809-f081-4778-b88f-5a3686d5dcc4 None None] MFA Rules not processed for user `ab89e3033bb949dfb468c2013bc6b096`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:28.245412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-78830809-f081-4778-b88f-5a3686d5dcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:28.340643 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:28.420225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 858/1691] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:28.421602 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f7108-fd0a-43c5-9f11-3aa97db28aad None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:28.421892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f7108-fd0a-43c5-9f11-3aa97db28aad None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:28.422175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f7108-fd0a-43c5-9f11-3aa97db28aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:28.456401 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-8d2f7108-fd0a-43c5-9f11-3aa97db28aad None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:28.461014 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8d2f7108-fd0a-43c5-9f11-3aa97db28aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:28.483673 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 859/1692] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:28.489249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f7108-fd0a-43c5-9f11-3aa97db28aad None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:28.489249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8d2f7108-fd0a-43c5-9f11-3aa97db28aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:28.489637 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390a461-492b-4b81-a0df-75aece90fb32 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:28.535299 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2fe71-8ee0-4bbd-b637-f96e5ad8435d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:28.535299 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2fe71-8ee0-4bbd-b637-f96e5ad8435d admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:28.535299 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2fe71-8ee0-4bbd-b637-f96e5ad8435d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:28.535299 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2fe71-8ee0-4bbd-b637-f96e5ad8435d admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:28.535902 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2fe71-8ee0-4bbd-b637-f96e5ad8435d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:28.535902 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2fe71-8ee0-4bbd-b637-f96e5ad8435d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:28.550647 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 834/1693] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:28 2022] GET /identity/v3/roles => generated 1427 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:28.552181 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6bf44-992e-4c0b-b0e4-2904c4ade853 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:28.552693 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6bf44-992e-4c0b-b0e4-2904c4ade853 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:28.553131 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6bf44-992e-4c0b-b0e4-2904c4ade853 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:28.555305 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 835/1694] 10.222.0.141 () {54 vars in 966 bytes} [Tue Jul 26 16:23:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:23:28.556068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6bf44-992e-4c0b-b0e4-2904c4ade853 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:28.558190 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d7a6bf44-992e-4c0b-b0e4-2904c4ade853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:28.654012 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f7108-fd0a-43c5-9f11-3aa97db28aad None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:28.668312 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc299aa-944a-41b9-9d22-7a624f0e0c83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:28.669956 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc299aa-944a-41b9-9d22-7a624f0e0c83 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:28.669956 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc299aa-944a-41b9-9d22-7a624f0e0c83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:28.670433 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc299aa-944a-41b9-9d22-7a624f0e0c83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:28.676147 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6bf44-992e-4c0b-b0e4-2904c4ade853 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:28.687947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc299aa-944a-41b9-9d22-7a624f0e0c83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:28.688117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea46cb-cdb0-46c9-960b-e7d52cba3db1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:28.688117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea46cb-cdb0-46c9-960b-e7d52cba3db1 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:28.688117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea46cb-cdb0-46c9-960b-e7d52cba3db1 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:28.688117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea46cb-cdb0-46c9-960b-e7d52cba3db1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:28.688453 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc299aa-944a-41b9-9d22-7a624f0e0c83 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:28.697684 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea46cb-cdb0-46c9-960b-e7d52cba3db1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:28.699533 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea46cb-cdb0-46c9-960b-e7d52cba3db1 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:28.708972 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:28.715367 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 860/1695] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:28.720545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc299aa-944a-41b9-9d22-7a624f0e0c83 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:28.722187 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 836/1696] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:28.731491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13437eb-ee14-42f5-8dc2-7296389d7872 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:28.731491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13437eb-ee14-42f5-8dc2-7296389d7872 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:28.731491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13437eb-ee14-42f5-8dc2-7296389d7872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:28.739608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc299aa-944a-41b9-9d22-7a624f0e0c83 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:28.746551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aba00f-d9b3-4076-9b1c-e647dfe1bf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:28.747685 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aba00f-d9b3-4076-9b1c-e647dfe1bf9b admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:28.749856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aba00f-d9b3-4076-9b1c-e647dfe1bf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:28.754387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aba00f-d9b3-4076-9b1c-e647dfe1bf9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:28.756129 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aba00f-d9b3-4076-9b1c-e647dfe1bf9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:28.756255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-f13437eb-ee14-42f5-8dc2-7296389d7872 None None] MFA Rules not processed for user `fda05b7b9675423e992470819d1c150a`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:28.758116 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f13437eb-ee14-42f5-8dc2-7296389d7872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:28.762360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aba00f-d9b3-4076-9b1c-e647dfe1bf9b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:28.775227 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 861/1697] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:28 2022] GET /identity/v3/roles => generated 1427 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:28.777343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aba00f-d9b3-4076-9b1c-e647dfe1bf9b admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:28.779883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-40aba00f-d9b3-4076-9b1c-e647dfe1bf9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:28.908225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aba00f-d9b3-4076-9b1c-e647dfe1bf9b admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:28.912845 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fd610-2f14-44e6-ac50-25b6cdc5d5be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:28.913642 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fd610-2f14-44e6-ac50-25b6cdc5d5be service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:28.913967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fd610-2f14-44e6-ac50-25b6cdc5d5be service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:28.914243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fd610-2f14-44e6-ac50-25b6cdc5d5be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:28.927877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fd610-2f14-44e6-ac50-25b6cdc5d5be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:28.931832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fd610-2f14-44e6-ac50-25b6cdc5d5be service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:28.939224 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 837/1698] 10.222.0.141 () {58 vars in 1063 bytes} [Tue Jul 26 16:23:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:28.948023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81f1f0-f2de-4621-b674-ed51c9ca2ca3 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:28.948322 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81f1f0-f2de-4621-b674-ed51c9ca2ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:28.948603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81f1f0-f2de-4621-b674-ed51c9ca2ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:28.985317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 862/1699] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:28.985317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fd610-2f14-44e6-ac50-25b6cdc5d5be service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:28.994918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8f81f1f0-f2de-4621-b674-ed51c9ca2ca3 None None] MFA Rules not processed for user `b867401639e74527adb079981496b19f`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:28.999530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8f81f1f0-f2de-4621-b674-ed51c9ca2ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:29.001453 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fd610-2f14-44e6-ac50-25b6cdc5d5be service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:29.012427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aaf371-1d1b-4f32-b9e5-38123b99503b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:29.013339 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aaf371-1d1b-4f32-b9e5-38123b99503b admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:29.017071 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aaf371-1d1b-4f32-b9e5-38123b99503b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:29.017071 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aaf371-1d1b-4f32-b9e5-38123b99503b admin admin] PATH_INFO: `/v3/projects/ca8037eddf434ac6aa966303f4f5556a/users/b1c74b8fa63644388db43c05e0cde9bf/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:29.041625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aaf371-1d1b-4f32-b9e5-38123b99503b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca8037eddf434ac6aa966303f4f5556a, user_id=b1c74b8fa63644388db43c05e0cde9bf, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:29.044630 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aaf371-1d1b-4f32-b9e5-38123b99503b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:29.147400 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 838/1700] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:29.148331 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 863/1701] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:28 2022] PUT /identity/v3/projects/ca8037eddf434ac6aa966303f4f5556a/users/b1c74b8fa63644388db43c05e0cde9bf/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:29.148847 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81f1f0-f2de-4621-b674-ed51c9ca2ca3 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:29.149326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aaf371-1d1b-4f32-b9e5-38123b99503b admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:29.150442 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8f81f1f0-f2de-4621-b674-ed51c9ca2ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:29.171629 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81f1f0-f2de-4621-b674-ed51c9ca2ca3 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:29.269771 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b46bb4-d623-4969-bb7b-1551908205d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:29.270895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b46bb4-d623-4969-bb7b-1551908205d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:29.271952 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b46bb4-d623-4969-bb7b-1551908205d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:29.272613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b46bb4-d623-4969-bb7b-1551908205d2 admin admin] PATH_INFO: `/v3/users/fbc28c805e3b4af5b8607b6a9c54b7b6` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:29.275026 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b46bb4-d623-4969-bb7b-1551908205d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbc28c805e3b4af5b8607b6a9c54b7b6)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:29.278685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b46bb4-d623-4969-bb7b-1551908205d2 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:29.338361 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aaf371-1d1b-4f32-b9e5-38123b99503b admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:29.347524 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea003b8-ac24-4a8a-ab6b-2e55df6ee4f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda05b7b9675423e992470819d1c150a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:29.348924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea003b8-ac24-4a8a-ab6b-2e55df6ee4f3 service placement] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:29.349638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea003b8-ac24-4a8a-ab6b-2e55df6ee4f3 service placement] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:29.350186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea003b8-ac24-4a8a-ab6b-2e55df6ee4f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:29.353376 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-eea003b8-ac24-4a8a-ab6b-2e55df6ee4f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:29.375110 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea003b8-ac24-4a8a-ab6b-2e55df6ee4f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:29.384320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea003b8-ac24-4a8a-ab6b-2e55df6ee4f3 service placement] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:29.422788 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 864/1702] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:29.425622 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5ed97-92bf-4eb7-80ac-311bbbf527a6 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:29.425911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5ed97-92bf-4eb7-80ac-311bbbf527a6 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:29.426188 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5ed97-92bf-4eb7-80ac-311bbbf527a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:29.466110 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-47b5ed97-92bf-4eb7-80ac-311bbbf527a6 None None] MFA Rules not processed for user `b867401639e74527adb079981496b19f`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:29.471120 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-47b5ed97-92bf-4eb7-80ac-311bbbf527a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:29.565928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:29.595463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d8b46bb4-d623-4969-bb7b-1551908205d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbc28c805e3b4af5b8607b6a9c54b7b6'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:29.596466 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d8b46bb4-d623-4969-bb7b-1551908205d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbc28c805e3b4af5b8607b6a9c54b7b6'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:29.645507 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d8b46bb4-d623-4969-bb7b-1551908205d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbc28c805e3b4af5b8607b6a9c54b7b6'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:29.660705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 865/1703] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:29.663919 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db1d2a-c9e7-4e06-8be3-9426487f78d4 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:29.663919 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db1d2a-c9e7-4e06-8be3-9426487f78d4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:29.663919 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db1d2a-c9e7-4e06-8be3-9426487f78d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:29.674556 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d8b46bb4-d623-4969-bb7b-1551908205d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbc28c805e3b4af5b8607b6a9c54b7b6'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:29.721581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f6db1d2a-c9e7-4e06-8be3-9426487f78d4 None None] MFA Rules not processed for user `b1c74b8fa63644388db43c05e0cde9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:29.722908 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f6db1d2a-c9e7-4e06-8be3-9426487f78d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:29.774984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d8b46bb4-d623-4969-bb7b-1551908205d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbc28c805e3b4af5b8607b6a9c54b7b6'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:29.788942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 839/1704] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:23:29 2022] DELETE /identity/v3/users/fbc28c805e3b4af5b8607b6a9c54b7b6 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:29.789997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b46bb4-d623-4969-bb7b-1551908205d2 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:29.793201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d8b46bb4-d623-4969-bb7b-1551908205d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:29.873171 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 866/1705] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:29.875244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d6044-5a89-48df-bd8f-5b0fe200793a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:29.877109 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d6044-5a89-48df-bd8f-5b0fe200793a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:29.877413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d6044-5a89-48df-bd8f-5b0fe200793a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:29.909914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-656d6044-5a89-48df-bd8f-5b0fe200793a None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:29.911591 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-656d6044-5a89-48df-bd8f-5b0fe200793a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:29.965886 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b46bb4-d623-4969-bb7b-1551908205d2 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:29.983812 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39403ea4-2189-4c43-a314-dd87fb98903c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:29.984862 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39403ea4-2189-4c43-a314-dd87fb98903c service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:29.985309 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39403ea4-2189-4c43-a314-dd87fb98903c service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:29.985742 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39403ea4-2189-4c43-a314-dd87fb98903c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:29.993266 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-39403ea4-2189-4c43-a314-dd87fb98903c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:30.086830 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 867/1706] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:30.093009 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d6044-5a89-48df-bd8f-5b0fe200793a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:30.095763 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-656d6044-5a89-48df-bd8f-5b0fe200793a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:30.125624 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d6044-5a89-48df-bd8f-5b0fe200793a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:30.137308 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39403ea4-2189-4c43-a314-dd87fb98903c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:30.137501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec677a08-98f1-4bce-9ffb-9daa65a80efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:30.138187 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec677a08-98f1-4bce-9ffb-9daa65a80efc admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:30.138573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec677a08-98f1-4bce-9ffb-9daa65a80efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:30.138938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39403ea4-2189-4c43-a314-dd87fb98903c service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:30.139054 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec677a08-98f1-4bce-9ffb-9daa65a80efc admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:30.139835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec677a08-98f1-4bce-9ffb-9daa65a80efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:30.143330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec677a08-98f1-4bce-9ffb-9daa65a80efc admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:30.162797 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 840/1707] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:30.236131 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39403ea4-2189-4c43-a314-dd87fb98903c service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:30.238383 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-39403ea4-2189-4c43-a314-dd87fb98903c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:30.292569 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 868/1708] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:30 2022] POST /identity/v3/projects => generated 366 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:30.294051 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec677a08-98f1-4bce-9ffb-9daa65a80efc admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:30.469658 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39403ea4-2189-4c43-a314-dd87fb98903c service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:30.496199 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec677a08-98f1-4bce-9ffb-9daa65a80efc admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:30.517377 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8311f52-223c-4c30-8d46-8dee5d2ae421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:30.518232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8311f52-223c-4c30-8d46-8dee5d2ae421 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:30.518992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8311f52-223c-4c30-8d46-8dee5d2ae421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:30.521364 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8311f52-223c-4c30-8d46-8dee5d2ae421 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:30.524320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8311f52-223c-4c30-8d46-8dee5d2ae421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:30.528143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8311f52-223c-4c30-8d46-8dee5d2ae421 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:30.591149 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98059fca-c25f-4a25-bf0e-60c009dc2908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:30.591802 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98059fca-c25f-4a25-bf0e-60c009dc2908 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:30.592085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98059fca-c25f-4a25-bf0e-60c009dc2908 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:30.592358 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98059fca-c25f-4a25-bf0e-60c009dc2908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:30.613697 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98059fca-c25f-4a25-bf0e-60c009dc2908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:30.617904 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98059fca-c25f-4a25-bf0e-60c009dc2908 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:30.650180 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 841/1709] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:30.650487 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 869/1710] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:30 2022] POST /identity/v3/users => generated 290 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:30.650609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98059fca-c25f-4a25-bf0e-60c009dc2908 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:30.652072 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8311f52-223c-4c30-8d46-8dee5d2ae421 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:30.653329 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-98059fca-c25f-4a25-bf0e-60c009dc2908 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:30.681790 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8311f52-223c-4c30-8d46-8dee5d2ae421 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:30.697631 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98059fca-c25f-4a25-bf0e-60c009dc2908 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:30.698473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0f9dc-2790-4c9a-b95f-b0e2765b33b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:30.699324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0f9dc-2790-4c9a-b95f-b0e2765b33b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:30.699811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0f9dc-2790-4c9a-b95f-b0e2765b33b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:30.700097 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0f9dc-2790-4c9a-b95f-b0e2765b33b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:30.701333 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0f9dc-2790-4c9a-b95f-b0e2765b33b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:30.704812 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0f9dc-2790-4c9a-b95f-b0e2765b33b4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:30.708406 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a5018-77c6-451e-9c9f-ac6315ded757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:30.709251 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a5018-77c6-451e-9c9f-ac6315ded757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:30.709628 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a5018-77c6-451e-9c9f-ac6315ded757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:30.710935 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a5018-77c6-451e-9c9f-ac6315ded757 admin admin] PATH_INFO: `/v3/projects/ba6c01fd15c14c60acfee84923870003` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:30.713455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a5018-77c6-451e-9c9f-ac6315ded757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba6c01fd15c14c60acfee84923870003)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:30.716155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a5018-77c6-451e-9c9f-ac6315ded757 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:30.769134 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 870/1711] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:30 2022] GET /identity/v3/roles => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:23:30.769134 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0f9dc-2790-4c9a-b95f-b0e2765b33b4 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:30.780207 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0f9dc-2790-4c9a-b95f-b0e2765b33b4 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:30.808007 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07357d-2e51-4d6c-b963-2b331105ba7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:30.809060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07357d-2e51-4d6c-b963-2b331105ba7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:30.809660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07357d-2e51-4d6c-b963-2b331105ba7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:30.810149 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07357d-2e51-4d6c-b963-2b331105ba7e admin admin] PATH_INFO: `/v3/projects/7c95334f684643ca88e77fa8dce0885b/users/6fa4b75a067a4ba6b65a4818c2ec3511/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:30.867032 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:30.888902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07357d-2e51-4d6c-b963-2b331105ba7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c95334f684643ca88e77fa8dce0885b, user_id=6fa4b75a067a4ba6b65a4818c2ec3511, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:30.891844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07357d-2e51-4d6c-b963-2b331105ba7e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:31.033086 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 871/1712] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:30 2022] PUT /identity/v3/projects/7c95334f684643ca88e77fa8dce0885b/users/6fa4b75a067a4ba6b65a4818c2ec3511/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:23:31.033086 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca44676-17f2-4f61-9efa-bba1ea6315f7 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:31.033086 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca44676-17f2-4f61-9efa-bba1ea6315f7 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:31.033086 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca44676-17f2-4f61-9efa-bba1ea6315f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:31.058315 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2d8a5018-77c6-451e-9c9f-ac6315ded757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba6c01fd15c14c60acfee84923870003', 'request_id': 'req-2d8a5018-77c6-451e-9c9f-ac6315ded757'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:31.076456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2ca44676-17f2-4f61-9efa-bba1ea6315f7 None None] MFA Rules not processed for user `7d96314143f7446caf8a1caf1ebfec9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:31.077353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2d8a5018-77c6-451e-9c9f-ac6315ded757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba6c01fd15c14c60acfee84923870003', 'request_id': 'req-2d8a5018-77c6-451e-9c9f-ac6315ded757'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:31.078233 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2ca44676-17f2-4f61-9efa-bba1ea6315f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:31.095024 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2d8a5018-77c6-451e-9c9f-ac6315ded757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba6c01fd15c14c60acfee84923870003', 'request_id': 'req-2d8a5018-77c6-451e-9c9f-ac6315ded757'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:31.220362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2d8a5018-77c6-451e-9c9f-ac6315ded757 admin admin] The token cache is being invalidate because project ba6c01fd15c14c60acfee84923870003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:23:31.221137 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2d8a5018-77c6-451e-9c9f-ac6315ded757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:31.223066 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2d8a5018-77c6-451e-9c9f-ac6315ded757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:31.225613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 842/1713] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:23:30 2022] DELETE /identity/v3/projects/ba6c01fd15c14c60acfee84923870003 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:31.229125 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 872/1714] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:31 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:31.229564 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4991ba-ad49-4e86-a749-4db34646f513 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:31.229841 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4991ba-ad49-4e86-a749-4db34646f513 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:31.231393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4991ba-ad49-4e86-a749-4db34646f513 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:31.234436 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a5018-77c6-451e-9c9f-ac6315ded757 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:31.235680 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 873/1715] 10.222.0.141 () {54 vars in 917 bytes} [Tue Jul 26 16:23:31 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:23:31.238591 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb0d39-7930-4d26-bb77-02257dc91965 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:31.238891 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb0d39-7930-4d26-bb77-02257dc91965 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:31.240219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb0d39-7930-4d26-bb77-02257dc91965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:31.248008 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2d8a5018-77c6-451e-9c9f-ac6315ded757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:31.294356 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-b2fb0d39-7930-4d26-bb77-02257dc91965 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:31.299068 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b2fb0d39-7930-4d26-bb77-02257dc91965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:31.388373 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a5018-77c6-451e-9c9f-ac6315ded757 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:31.490174 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1914f-7eee-4ba6-bf03-693875663018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:31.490900 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1914f-7eee-4ba6-bf03-693875663018 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:31.491320 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1914f-7eee-4ba6-bf03-693875663018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:31.491667 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1914f-7eee-4ba6-bf03-693875663018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:31.492569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1914f-7eee-4ba6-bf03-693875663018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:31.498650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1914f-7eee-4ba6-bf03-693875663018 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:31.500818 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 874/1716] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:31.501761 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb0d39-7930-4d26-bb77-02257dc91965 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:31.504576 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b2fb0d39-7930-4d26-bb77-02257dc91965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:31.527417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 843/1717] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:31 2022] GET /identity/v3/roles => generated 1427 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:31.529333 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67961b76-0b61-4b0f-88dd-742262181afc None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:31.529895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67961b76-0b61-4b0f-88dd-742262181afc None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:31.530180 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67961b76-0b61-4b0f-88dd-742262181afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:31.565141 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-67961b76-0b61-4b0f-88dd-742262181afc None None] MFA Rules not processed for user `d1a99faad91b4357973f4bbb6632c724`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:31.565833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb0d39-7930-4d26-bb77-02257dc91965 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:31.568804 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-67961b76-0b61-4b0f-88dd-742262181afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:31.587962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503514d2-edae-491b-9162-d48efc41c3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:31.588713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503514d2-edae-491b-9162-d48efc41c3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:31.588987 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503514d2-edae-491b-9162-d48efc41c3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:31.589294 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503514d2-edae-491b-9162-d48efc41c3b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:31.590651 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503514d2-edae-491b-9162-d48efc41c3b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:31.595564 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503514d2-edae-491b-9162-d48efc41c3b8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:31.661599 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 844/1718] 10.222.0.141 () {58 vars in 1014 bytes} [Tue Jul 26 16:23:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:31.665067 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8b6d2-ae75-4bb4-a954-c371c7d39bf3 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:31.665485 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8b6d2-ae75-4bb4-a954-c371c7d39bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:31.666049 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8b6d2-ae75-4bb4-a954-c371c7d39bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:31.695372 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-2bc8b6d2-ae75-4bb4-a954-c371c7d39bf3 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:31.697449 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2bc8b6d2-ae75-4bb4-a954-c371c7d39bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:31.710607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 845/1719] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:31.713585 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8b6d2-ae75-4bb4-a954-c371c7d39bf3 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:31.724613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8b6d2-ae75-4bb4-a954-c371c7d39bf3 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:31.734109 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb270fae-5525-498f-9e77-ea2d584a2c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:31.736483 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb270fae-5525-498f-9e77-ea2d584a2c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:31.736483 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb270fae-5525-498f-9e77-ea2d584a2c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:31.737239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb270fae-5525-498f-9e77-ea2d584a2c66 admin admin] PATH_INFO: `/v3/projects/7c95334f684643ca88e77fa8dce0885b/users/6fa4b75a067a4ba6b65a4818c2ec3511/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:31.739590 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb270fae-5525-498f-9e77-ea2d584a2c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c95334f684643ca88e77fa8dce0885b, user_id=6fa4b75a067a4ba6b65a4818c2ec3511, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:31.742520 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 875/1720] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:31 2022] POST /identity/v3/projects => generated 406 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:31.745352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503514d2-edae-491b-9162-d48efc41c3b8 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:31.748250 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb270fae-5525-498f-9e77-ea2d584a2c66 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:31.764106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 846/1721] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:31 2022] PUT /identity/v3/projects/7c95334f684643ca88e77fa8dce0885b/users/6fa4b75a067a4ba6b65a4818c2ec3511/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:31.765194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb270fae-5525-498f-9e77-ea2d584a2c66 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:31.767479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-eb270fae-5525-498f-9e77-ea2d584a2c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:31.945426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503514d2-edae-491b-9162-d48efc41c3b8 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:31.957467 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb270fae-5525-498f-9e77-ea2d584a2c66 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:31.967310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a2bfa-0032-476d-be9b-91beec44c588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:31.968434 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a2bfa-0032-476d-be9b-91beec44c588 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:31.968808 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a2bfa-0032-476d-be9b-91beec44c588 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:31.969917 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a2bfa-0032-476d-be9b-91beec44c588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:32.006617 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a2bfa-0032-476d-be9b-91beec44c588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:32.014369 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a2bfa-0032-476d-be9b-91beec44c588 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:32.058101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 847/1722] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:32.061397 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a2bfa-0032-476d-be9b-91beec44c588 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:32.066091 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:32.150557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b084a-3082-496c-ade8-4b07d7232239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:32.153646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b084a-3082-496c-ade8-4b07d7232239 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:32.154066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b084a-3082-496c-ade8-4b07d7232239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:32.154267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b084a-3082-496c-ade8-4b07d7232239 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:32.154949 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b084a-3082-496c-ade8-4b07d7232239 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:23:32.155281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b084a-3082-496c-ade8-4b07d7232239 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:32.165514 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b084a-3082-496c-ade8-4b07d7232239 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:32.209645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 876/1723] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:23:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:23:32.224023 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fda04-9696-4610-b6fd-6623413bc697 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:32.224023 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fda04-9696-4610-b6fd-6623413bc697 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:32.224023 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fda04-9696-4610-b6fd-6623413bc697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:32.290841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a2bfa-0032-476d-be9b-91beec44c588 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:32.307455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c83400-cd65-487d-affa-140f3649fec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:32.309364 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c83400-cd65-487d-affa-140f3649fec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:32.309831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c83400-cd65-487d-affa-140f3649fec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:32.309926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c83400-cd65-487d-affa-140f3649fec6 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:32.311183 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c83400-cd65-487d-affa-140f3649fec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:32.319644 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c83400-cd65-487d-affa-140f3649fec6 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:32.322074 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5b0fda04-9696-4610-b6fd-6623413bc697 None None] MFA Rules not processed for user `6fa4b75a067a4ba6b65a4818c2ec3511`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:32.325470 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5b0fda04-9696-4610-b6fd-6623413bc697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:32.469395 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 848/1724] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:32 2022] POST /identity/v3/users => generated 310 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:32.470468 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c83400-cd65-487d-affa-140f3649fec6 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:32.473396 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:32.473752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-80c83400-cd65-487d-affa-140f3649fec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:32.502705 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c83400-cd65-487d-affa-140f3649fec6 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:32.524955 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 877/1725] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:32.526087 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fda04-9696-4610-b6fd-6623413bc697 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:32.527178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf597a44-d710-4011-af30-0f3f1e37a7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:32.528121 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf597a44-d710-4011-af30-0f3f1e37a7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:32.528420 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf597a44-d710-4011-af30-0f3f1e37a7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:32.528715 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf597a44-d710-4011-af30-0f3f1e37a7ee admin admin] PATH_INFO: `/v3/projects/9bdb12011e414dd7b0b2883e130ebae3` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:32.530122 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf597a44-d710-4011-af30-0f3f1e37a7ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bdb12011e414dd7b0b2883e130ebae3)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:32.533362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf597a44-d710-4011-af30-0f3f1e37a7ee admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:32.552525 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fda04-9696-4610-b6fd-6623413bc697 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:32.569196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda70045-5cd1-40e0-b835-143c7f5aea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:32.571529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda70045-5cd1-40e0-b835-143c7f5aea55 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:32.571812 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda70045-5cd1-40e0-b835-143c7f5aea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:32.572089 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda70045-5cd1-40e0-b835-143c7f5aea55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:32.574627 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda70045-5cd1-40e0-b835-143c7f5aea55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:32.580622 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda70045-5cd1-40e0-b835-143c7f5aea55 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:32.719844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 878/1726] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:32 2022] POST /identity/v3/projects => generated 380 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:32.724299 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda70045-5cd1-40e0-b835-143c7f5aea55 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:32.764303 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bf597a44-d710-4011-af30-0f3f1e37a7ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bdb12011e414dd7b0b2883e130ebae3', 'request_id': 'req-bf597a44-d710-4011-af30-0f3f1e37a7ee'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:32.791617 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bf597a44-d710-4011-af30-0f3f1e37a7ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bdb12011e414dd7b0b2883e130ebae3', 'request_id': 'req-bf597a44-d710-4011-af30-0f3f1e37a7ee'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:32.811027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bf597a44-d710-4011-af30-0f3f1e37a7ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bdb12011e414dd7b0b2883e130ebae3', 'request_id': 'req-bf597a44-d710-4011-af30-0f3f1e37a7ee'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:32.919530 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda70045-5cd1-40e0-b835-143c7f5aea55 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:32.933947 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bf597a44-d710-4011-af30-0f3f1e37a7ee admin admin] The token cache is being invalidate because project 9bdb12011e414dd7b0b2883e130ebae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:23:32.933947 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bf597a44-d710-4011-af30-0f3f1e37a7ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:32.935525 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bf597a44-d710-4011-af30-0f3f1e37a7ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:32.938446 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 849/1727] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:23:32 2022] DELETE /identity/v3/projects/9bdb12011e414dd7b0b2883e130ebae3 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:32.941874 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01705700-55dd-4a40-8e54-ac2ef4be0b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:32.942272 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf597a44-d710-4011-af30-0f3f1e37a7ee admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:32.943198 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01705700-55dd-4a40-8e54-ac2ef4be0b09 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:32.943639 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01705700-55dd-4a40-8e54-ac2ef4be0b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:32.944081 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01705700-55dd-4a40-8e54-ac2ef4be0b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:32.945859 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01705700-55dd-4a40-8e54-ac2ef4be0b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:32.948523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01705700-55dd-4a40-8e54-ac2ef4be0b09 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:32.951948 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-bf597a44-d710-4011-af30-0f3f1e37a7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:32.971982 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 879/1728] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:32 2022] GET /identity/v3/roles => generated 1427 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:32.973187 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01705700-55dd-4a40-8e54-ac2ef4be0b09 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:32.975270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-01705700-55dd-4a40-8e54-ac2ef4be0b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:32.996035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01705700-55dd-4a40-8e54-ac2ef4be0b09 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:33.004121 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb1eb5-2187-47b7-bac4-c904db51aa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:33.008631 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb1eb5-2187-47b7-bac4-c904db51aa77 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:33.008631 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb1eb5-2187-47b7-bac4-c904db51aa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:33.008631 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb1eb5-2187-47b7-bac4-c904db51aa77 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:33.008631 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb1eb5-2187-47b7-bac4-c904db51aa77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:33.010089 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb1eb5-2187-47b7-bac4-c904db51aa77 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:33.152605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 880/1729] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:32 2022] POST /identity/v3/users => generated 291 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:33.157542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:33.159494 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb1eb5-2187-47b7-bac4-c904db51aa77 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:33.161935 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-43fb1eb5-2187-47b7-bac4-c904db51aa77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:33.180712 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf597a44-d710-4011-af30-0f3f1e37a7ee admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:33.191604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb1eb5-2187-47b7-bac4-c904db51aa77 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:33.204520 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8d485-30ee-414c-a174-08173fb67cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:33.205544 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8d485-30ee-414c-a174-08173fb67cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:33.206144 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8d485-30ee-414c-a174-08173fb67cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:33.206625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8d485-30ee-414c-a174-08173fb67cee admin admin] PATH_INFO: `/v3/users/d2337bb488e447a1a57802806b150842` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:33.209238 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8d485-30ee-414c-a174-08173fb67cee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2337bb488e447a1a57802806b150842)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:33.215046 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8d485-30ee-414c-a174-08173fb67cee admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:33.285541 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdd6c6-f6c5-4f0f-a545-2d6278ee6c79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:33.286257 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdd6c6-f6c5-4f0f-a545-2d6278ee6c79 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:33.286614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdd6c6-f6c5-4f0f-a545-2d6278ee6c79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:33.287048 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdd6c6-f6c5-4f0f-a545-2d6278ee6c79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:33.289131 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e8bdd6c6-f6c5-4f0f-a545-2d6278ee6c79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:33.391079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bdd6c6-f6c5-4f0f-a545-2d6278ee6c79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:33.392724 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bdd6c6-f6c5-4f0f-a545-2d6278ee6c79 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:33.419512 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 850/1730] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:32 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:33.420496 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdd6c6-f6c5-4f0f-a545-2d6278ee6c79 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:33.423006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e8bdd6c6-f6c5-4f0f-a545-2d6278ee6c79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:33.441993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdd6c6-f6c5-4f0f-a545-2d6278ee6c79 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:33.449692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a45105-bf8e-421e-9f0b-1889b56c5070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:33.450700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a45105-bf8e-421e-9f0b-1889b56c5070 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:33.451049 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a45105-bf8e-421e-9f0b-1889b56c5070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:33.452178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a45105-bf8e-421e-9f0b-1889b56c5070 admin admin] PATH_INFO: `/v3/projects/879717ff23c4492e9018f026100069ec/users/dac17cb3a7634d4ba09e5e289909beb7/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:33.509717 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a45105-bf8e-421e-9f0b-1889b56c5070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879717ff23c4492e9018f026100069ec, user_id=dac17cb3a7634d4ba09e5e289909beb7, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:33.512426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a45105-bf8e-421e-9f0b-1889b56c5070 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:33.536130 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-00b8d485-30ee-414c-a174-08173fb67cee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2337bb488e447a1a57802806b150842'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:33.539161 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-00b8d485-30ee-414c-a174-08173fb67cee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2337bb488e447a1a57802806b150842'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:33.623149 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 851/1731] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:33 2022] PUT /identity/v3/projects/879717ff23c4492e9018f026100069ec/users/dac17cb3a7634d4ba09e5e289909beb7/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:33.623149 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a45105-bf8e-421e-9f0b-1889b56c5070 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:33.634100 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-00b8d485-30ee-414c-a174-08173fb67cee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2337bb488e447a1a57802806b150842'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:33.698439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-00b8d485-30ee-414c-a174-08173fb67cee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2337bb488e447a1a57802806b150842'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:33.699663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-00b8d485-30ee-414c-a174-08173fb67cee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2337bb488e447a1a57802806b150842'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:33.722912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 881/1732] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:23:33 2022] DELETE /identity/v3/users/d2337bb488e447a1a57802806b150842 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:33.725293 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8d485-30ee-414c-a174-08173fb67cee admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:33.728199 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-00b8d485-30ee-414c-a174-08173fb67cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:33.924168 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a45105-bf8e-421e-9f0b-1889b56c5070 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:33.954644 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8d485-30ee-414c-a174-08173fb67cee admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:33.954924 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24111d08-f2fa-4371-b286-79196f9158ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:33.955772 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24111d08-f2fa-4371-b286-79196f9158ac admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:33.958844 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24111d08-f2fa-4371-b286-79196f9158ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:33.959344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24111d08-f2fa-4371-b286-79196f9158ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:33.961698 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24111d08-f2fa-4371-b286-79196f9158ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:33.964688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7409c-386c-4ad6-a4aa-2ee6c64081e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:33.964688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7409c-386c-4ad6-a4aa-2ee6c64081e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:33.964688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7409c-386c-4ad6-a4aa-2ee6c64081e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:33.964688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7409c-386c-4ad6-a4aa-2ee6c64081e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:33.968347 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7409c-386c-4ad6-a4aa-2ee6c64081e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:33.968347 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7409c-386c-4ad6-a4aa-2ee6c64081e7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:33.972092 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24111d08-f2fa-4371-b286-79196f9158ac admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:33.992576 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 882/1733] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:33 2022] GET /identity/v3/roles => generated 1427 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:33.992576 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384acf5-f7e8-48da-8487-1469e9b468aa None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:33.996909 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384acf5-f7e8-48da-8487-1469e9b468aa None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:33.996909 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384acf5-f7e8-48da-8487-1469e9b468aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:34.005962 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 852/1734] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:33 2022] GET /identity/v3/roles => generated 1427 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:34.008459 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24111d08-f2fa-4371-b286-79196f9158ac admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:34.011438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-24111d08-f2fa-4371-b286-79196f9158ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:34.057133 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-8384acf5-f7e8-48da-8487-1469e9b468aa None None] MFA Rules not processed for user `b867401639e74527adb079981496b19f`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:34.058902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8384acf5-f7e8-48da-8487-1469e9b468aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:34.078790 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:34.160993 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 883/1735] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:34.162325 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384acf5-f7e8-48da-8487-1469e9b468aa None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:34.180418 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384acf5-f7e8-48da-8487-1469e9b468aa None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:34.188074 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35e6a7-5188-447c-80b5-bacbb724c73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:34.189130 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35e6a7-5188-447c-80b5-bacbb724c73a admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:34.189659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35e6a7-5188-447c-80b5-bacbb724c73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:34.190132 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35e6a7-5188-447c-80b5-bacbb724c73a admin admin] PATH_INFO: `/v3/projects/879717ff23c4492e9018f026100069ec/users/dac17cb3a7634d4ba09e5e289909beb7/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:34.193231 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35e6a7-5188-447c-80b5-bacbb724c73a admin admin] RBAC: Authorizing `identity:create_grant(project_id=879717ff23c4492e9018f026100069ec, user_id=dac17cb3a7634d4ba09e5e289909beb7, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:34.198687 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35e6a7-5188-447c-80b5-bacbb724c73a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:34.217989 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 884/1736] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:34 2022] PUT /identity/v3/projects/879717ff23c4492e9018f026100069ec/users/dac17cb3a7634d4ba09e5e289909beb7/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:34.221740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35e6a7-5188-447c-80b5-bacbb724c73a admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:34.223023 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9b35e6a7-5188-447c-80b5-bacbb724c73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:34.236086 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24111d08-f2fa-4371-b286-79196f9158ac admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:34.362827 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ed53d-ed5d-4fdc-b0c6-29572ffbe5c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:34.365291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ed53d-ed5d-4fdc-b0c6-29572ffbe5c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:34.365872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ed53d-ed5d-4fdc-b0c6-29572ffbe5c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:34.367000 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ed53d-ed5d-4fdc-b0c6-29572ffbe5c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:34.369374 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9f4ed53d-ed5d-4fdc-b0c6-29572ffbe5c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:34.373166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35e6a7-5188-447c-80b5-bacbb724c73a admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:34.382330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124d1ce-0744-4854-bfce-1a0c02fe8e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:34.383161 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124d1ce-0744-4854-bfce-1a0c02fe8e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:34.383575 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124d1ce-0744-4854-bfce-1a0c02fe8e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:34.383929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124d1ce-0744-4854-bfce-1a0c02fe8e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:34.385464 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124d1ce-0744-4854-bfce-1a0c02fe8e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:34.387703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124d1ce-0744-4854-bfce-1a0c02fe8e29 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:34.432768 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 885/1737] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:34 2022] GET /identity/v3/roles => generated 1427 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:34.437050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124d1ce-0744-4854-bfce-1a0c02fe8e29 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:34.462770 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124d1ce-0744-4854-bfce-1a0c02fe8e29 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:34.476637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298c482-1525-4ac6-b008-ca4662acd25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:34.477725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298c482-1525-4ac6-b008-ca4662acd25c admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:34.478878 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ed53d-ed5d-4fdc-b0c6-29572ffbe5c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:34.479267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298c482-1525-4ac6-b008-ca4662acd25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:34.479890 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298c482-1525-4ac6-b008-ca4662acd25c admin admin] PATH_INFO: `/v3/projects/04496afb723f491daa387c7c23056e34/users/6a65c974638a454ea88d52dee9ca8738/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:34.485238 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ed53d-ed5d-4fdc-b0c6-29572ffbe5c3 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:34.516608 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 853/1738] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:34.524689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298c482-1525-4ac6-b008-ca4662acd25c admin admin] RBAC: Authorizing `identity:create_grant(project_id=04496afb723f491daa387c7c23056e34, user_id=6a65c974638a454ea88d52dee9ca8738, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:34.532265 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298c482-1525-4ac6-b008-ca4662acd25c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:34.546158 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:34.655047 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:34.660082 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 886/1739] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:34 2022] PUT /identity/v3/projects/04496afb723f491daa387c7c23056e34/users/6a65c974638a454ea88d52dee9ca8738/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:34.672060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c4aa8-a547-4a60-b5e0-e01c04e0bf57 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:34.672703 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c4aa8-a547-4a60-b5e0-e01c04e0bf57 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:34.673056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c4aa8-a547-4a60-b5e0-e01c04e0bf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:34.752695 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ab4c4aa8-a547-4a60-b5e0-e01c04e0bf57 None None] MFA Rules not processed for user `6a65c974638a454ea88d52dee9ca8738`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:34.754274 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ab4c4aa8-a547-4a60-b5e0-e01c04e0bf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:34.839228 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a668e-4511-42f9-b9d0-4cad327b8eb6 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:34.840708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a668e-4511-42f9-b9d0-4cad327b8eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:34.840708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a668e-4511-42f9-b9d0-4cad327b8eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:34.856401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 854/1740] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:23:34.857498 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c4aa8-a547-4a60-b5e0-e01c04e0bf57 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:34.968619 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-4a4a668e-4511-42f9-b9d0-4cad327b8eb6 None None] MFA Rules not processed for user `02af03095e48472d96a995a530e78035`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:34.969998 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4a4a668e-4511-42f9-b9d0-4cad327b8eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:34.972278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c4aa8-a547-4a60-b5e0-e01c04e0bf57 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:34.990674 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109854f-7d8e-43f4-8e26-a6fa69df9f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:34.992942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109854f-7d8e-43f4-8e26-a6fa69df9f57 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:34.993340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109854f-7d8e-43f4-8e26-a6fa69df9f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:34.993721 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109854f-7d8e-43f4-8e26-a6fa69df9f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:34.994508 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109854f-7d8e-43f4-8e26-a6fa69df9f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:34.996568 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109854f-7d8e-43f4-8e26-a6fa69df9f57 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:35.149170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 855/1741] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:34 2022] POST /identity/v3/projects => generated 382 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:35.166136 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109854f-7d8e-43f4-8e26-a6fa69df9f57 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:35.249611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 887/1742] 10.222.0.141 () {58 vars in 1014 bytes} [Tue Jul 26 16:23:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:35.253345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e08a1-9d31-4f70-b57f-bd721c135b40 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:35.256089 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e08a1-9d31-4f70-b57f-bd721c135b40 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:35.260421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e08a1-9d31-4f70-b57f-bd721c135b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:35.297883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c97e08a1-9d31-4f70-b57f-bd721c135b40 None None] MFA Rules not processed for user `ab89e3033bb949dfb468c2013bc6b096`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:35.299417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c97e08a1-9d31-4f70-b57f-bd721c135b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:35.342934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109854f-7d8e-43f4-8e26-a6fa69df9f57 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:35.349252 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7c591-ab7c-4fa5-8a08-0c4ed635de51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:35.353281 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7c591-ab7c-4fa5-8a08-0c4ed635de51 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:35.353460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7c591-ab7c-4fa5-8a08-0c4ed635de51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:35.353766 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7c591-ab7c-4fa5-8a08-0c4ed635de51 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:35.355025 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7c591-ab7c-4fa5-8a08-0c4ed635de51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:35.357298 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7c591-ab7c-4fa5-8a08-0c4ed635de51 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:35.393334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 888/1743] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:35.516566 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 856/1744] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:35 2022] POST /identity/v3/users => generated 298 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:35.520595 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e08a1-9d31-4f70-b57f-bd721c135b40 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:35.542553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e08a1-9d31-4f70-b57f-bd721c135b40 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:35.551198 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91becbfa-66c2-4846-bcdc-8245ae8ac01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:35.551888 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91becbfa-66c2-4846-bcdc-8245ae8ac01f admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:35.552009 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91becbfa-66c2-4846-bcdc-8245ae8ac01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:35.552422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91becbfa-66c2-4846-bcdc-8245ae8ac01f admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:35.553338 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91becbfa-66c2-4846-bcdc-8245ae8ac01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:35.555208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91becbfa-66c2-4846-bcdc-8245ae8ac01f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:35.568524 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 889/1745] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:35 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:35.573441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7c591-ab7c-4fa5-8a08-0c4ed635de51 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:35.586977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7c591-ab7c-4fa5-8a08-0c4ed635de51 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:35.594172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e02e2f-5b6c-4763-8d7b-466b6a5b5343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:35.595692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e02e2f-5b6c-4763-8d7b-466b6a5b5343 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:35.595692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e02e2f-5b6c-4763-8d7b-466b6a5b5343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:35.595692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e02e2f-5b6c-4763-8d7b-466b6a5b5343 admin admin] PATH_INFO: `/v3/projects/a0801b8dca2e43e782b97ae9c8a3e067/users/661a50f8f6f04e0aac70a61a8a54d457/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:35.614336 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e02e2f-5b6c-4763-8d7b-466b6a5b5343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0801b8dca2e43e782b97ae9c8a3e067, user_id=661a50f8f6f04e0aac70a61a8a54d457, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:35.629618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e02e2f-5b6c-4763-8d7b-466b6a5b5343 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:35.764376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 857/1746] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:35 2022] PUT /identity/v3/projects/a0801b8dca2e43e782b97ae9c8a3e067/users/661a50f8f6f04e0aac70a61a8a54d457/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:23:35.769986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e02e2f-5b6c-4763-8d7b-466b6a5b5343 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:35.772340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91becbfa-66c2-4846-bcdc-8245ae8ac01f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:35.782877 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-98e02e2f-5b6c-4763-8d7b-466b6a5b5343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:35.808722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91becbfa-66c2-4846-bcdc-8245ae8ac01f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:35.955494 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1d08b-60d5-4323-a757-2f47c53182bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:35.956516 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1d08b-60d5-4323-a757-2f47c53182bf admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:35.956928 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1d08b-60d5-4323-a757-2f47c53182bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:35.957313 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1d08b-60d5-4323-a757-2f47c53182bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:35.958407 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1d08b-60d5-4323-a757-2f47c53182bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:35.966406 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1d08b-60d5-4323-a757-2f47c53182bf admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:36.009953 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 890/1747] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:35 2022] GET /identity/v3/roles => generated 1427 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:36.009953 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1d08b-60d5-4323-a757-2f47c53182bf admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:36.011884 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c5a1d08b-60d5-4323-a757-2f47c53182bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:36.032076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1d08b-60d5-4323-a757-2f47c53182bf admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:36.039816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df87c2e-b88c-4ffb-905c-484f54963614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:36.040623 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df87c2e-b88c-4ffb-905c-484f54963614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:36.041046 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df87c2e-b88c-4ffb-905c-484f54963614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:36.041403 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df87c2e-b88c-4ffb-905c-484f54963614 admin admin] PATH_INFO: `/v3/projects/80e35f28c4a94fd2af0798477f05ea26` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:36.043143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df87c2e-b88c-4ffb-905c-484f54963614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80e35f28c4a94fd2af0798477f05ea26)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:36.046459 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df87c2e-b88c-4ffb-905c-484f54963614 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:36.049760 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e02e2f-5b6c-4763-8d7b-466b6a5b5343 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:36.059707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e44c6-06c5-4bf6-a7ca-c49e14b07362 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c5f92f21868436a99a5c7aaa1fc40b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:36.063047 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e44c6-06c5-4bf6-a7ca-c49e14b07362 service swift] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:36.064188 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e44c6-06c5-4bf6-a7ca-c49e14b07362 service swift] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:36.065045 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e44c6-06c5-4bf6-a7ca-c49e14b07362 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:36.114699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:36.167207 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e44c6-06c5-4bf6-a7ca-c49e14b07362 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:36.169671 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e44c6-06c5-4bf6-a7ca-c49e14b07362 service swift] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:36.180976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 858/1748] 10.222.0.141 () {60 vars in 1389 bytes} [Tue Jul 26 16:23:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 16:23:36.182039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e44c6-06c5-4bf6-a7ca-c49e14b07362 service swift] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:36.210501 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e44c6-06c5-4bf6-a7ca-c49e14b07362 service swift] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:36.222962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-9df87c2e-b88c-4ffb-905c-484f54963614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80e35f28c4a94fd2af0798477f05ea26', 'request_id': 'req-9df87c2e-b88c-4ffb-905c-484f54963614'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:36.264401 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-9df87c2e-b88c-4ffb-905c-484f54963614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80e35f28c4a94fd2af0798477f05ea26', 'request_id': 'req-9df87c2e-b88c-4ffb-905c-484f54963614'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:36.290791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-9df87c2e-b88c-4ffb-905c-484f54963614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80e35f28c4a94fd2af0798477f05ea26', 'request_id': 'req-9df87c2e-b88c-4ffb-905c-484f54963614'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:36.402272 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a0b6f-f17b-4823-95e7-d02bbbde8c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:36.404122 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a0b6f-f17b-4823-95e7-d02bbbde8c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:36.404466 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a0b6f-f17b-4823-95e7-d02bbbde8c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:36.404804 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a0b6f-f17b-4823-95e7-d02bbbde8c2f admin admin] PATH_INFO: `/v3/projects/a0801b8dca2e43e782b97ae9c8a3e067/users/661a50f8f6f04e0aac70a61a8a54d457/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:36.407427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a0b6f-f17b-4823-95e7-d02bbbde8c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0801b8dca2e43e782b97ae9c8a3e067, user_id=661a50f8f6f04e0aac70a61a8a54d457, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:36.410438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a0b6f-f17b-4823-95e7-d02bbbde8c2f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:36.430937 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 859/1749] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:36 2022] PUT /identity/v3/projects/a0801b8dca2e43e782b97ae9c8a3e067/users/661a50f8f6f04e0aac70a61a8a54d457/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:36.483004 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29791f7b-ca27-446d-a7c5-27bb04f8c3ac None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:36.486219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29791f7b-ca27-446d-a7c5-27bb04f8c3ac None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:36.490859 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29791f7b-ca27-446d-a7c5-27bb04f8c3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:36.557031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-9df87c2e-b88c-4ffb-905c-484f54963614 admin admin] The token cache is being invalidate because project 80e35f28c4a94fd2af0798477f05ea26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:23:36.557634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-9df87c2e-b88c-4ffb-905c-484f54963614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:36.560186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-9df87c2e-b88c-4ffb-905c-484f54963614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:36.562487 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 891/1750] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:23:36 2022] DELETE /identity/v3/projects/80e35f28c4a94fd2af0798477f05ea26 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:36.570304 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1dacb-0122-43ec-a4ea-b40c3e213cf5 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:36.575749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1dacb-0122-43ec-a4ea-b40c3e213cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:36.577722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1dacb-0122-43ec-a4ea-b40c3e213cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:36.602360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-29791f7b-ca27-446d-a7c5-27bb04f8c3ac None None] MFA Rules not processed for user `661a50f8f6f04e0aac70a61a8a54d457`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:36.606685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-29791f7b-ca27-446d-a7c5-27bb04f8c3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:36.646172 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-02e1dacb-0122-43ec-a4ea-b40c3e213cf5 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:36.661952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-02e1dacb-0122-43ec-a4ea-b40c3e213cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:36.832697 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 860/1751] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:36.845319 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29791f7b-ca27-446d-a7c5-27bb04f8c3ac None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:36.847268 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-29791f7b-ca27-446d-a7c5-27bb04f8c3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:36.886343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 892/1752] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:36.894168 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67028282-648b-43de-a683-2e3bca650303 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:36.894470 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67028282-648b-43de-a683-2e3bca650303 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:36.894752 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67028282-648b-43de-a683-2e3bca650303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:36.937115 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-67028282-648b-43de-a683-2e3bca650303 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:36.940694 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-67028282-648b-43de-a683-2e3bca650303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:36.976905 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 893/1753] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:23:36.977022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29791f7b-ca27-446d-a7c5-27bb04f8c3ac None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:36.977788 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67028282-648b-43de-a683-2e3bca650303 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:36.985530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64cf46-5aa5-4c55-918b-81793b724321 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:36.986386 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64cf46-5aa5-4c55-918b-81793b724321 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:36.986865 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64cf46-5aa5-4c55-918b-81793b724321 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:36.987238 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64cf46-5aa5-4c55-918b-81793b724321 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:36.989559 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67028282-648b-43de-a683-2e3bca650303 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:37.002981 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64cf46-5aa5-4c55-918b-81793b724321 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:37.004573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d0c41-8de9-4c02-bf58-2d069cbc6089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:37.005307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d0c41-8de9-4c02-bf58-2d069cbc6089 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:37.005593 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d0c41-8de9-4c02-bf58-2d069cbc6089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:37.005872 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d0c41-8de9-4c02-bf58-2d069cbc6089 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:37.006665 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d0c41-8de9-4c02-bf58-2d069cbc6089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:23:37.007709 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64cf46-5aa5-4c55-918b-81793b724321 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:37.018463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d0c41-8de9-4c02-bf58-2d069cbc6089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:37.018463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d0c41-8de9-4c02-bf58-2d069cbc6089 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:37.033963 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 861/1754] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:37.037389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10648c-8b9b-4e69-8c3f-2986f4f970c7 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:37.037741 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10648c-8b9b-4e69-8c3f-2986f4f970c7 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:37.038553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10648c-8b9b-4e69-8c3f-2986f4f970c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:37.049624 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 894/1755] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:23:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:23:37.051701 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d0c41-8de9-4c02-bf58-2d069cbc6089 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:37.072481 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d0c41-8de9-4c02-bf58-2d069cbc6089 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:37.113813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21287e3-7818-45ce-8986-f4bcc1cc33a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:37.114849 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21287e3-7818-45ce-8986-f4bcc1cc33a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:37.115135 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21287e3-7818-45ce-8986-f4bcc1cc33a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:37.121040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21287e3-7818-45ce-8986-f4bcc1cc33a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:37.121785 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21287e3-7818-45ce-8986-f4bcc1cc33a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:37.129641 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-7e10648c-8b9b-4e69-8c3f-2986f4f970c7 None None] MFA Rules not processed for user `2e75b38158404b298375fab5234851b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:37.130758 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21287e3-7818-45ce-8986-f4bcc1cc33a1 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:37.133986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7e10648c-8b9b-4e69-8c3f-2986f4f970c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:37.268511 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 862/1756] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:37.401215 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:37.428317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 895/1757] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:37 2022] POST /identity/v3/projects => generated 388 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:37.438564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10648c-8b9b-4e69-8c3f-2986f4f970c7 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:37.502321 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10648c-8b9b-4e69-8c3f-2986f4f970c7 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:37.505171 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21287e3-7818-45ce-8986-f4bcc1cc33a1 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:37.709778 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53ab1b-8654-4e26-abb4-da9455a53e7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:37.716895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53ab1b-8654-4e26-abb4-da9455a53e7e service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:37.716895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53ab1b-8654-4e26-abb4-da9455a53e7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:37.716895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53ab1b-8654-4e26-abb4-da9455a53e7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:37.744077 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0a53ab1b-8654-4e26-abb4-da9455a53e7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:37.836093 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21287e3-7818-45ce-8986-f4bcc1cc33a1 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:37.875824 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69f46a-aaca-4928-8205-6c9bbd1570a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:37.875824 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69f46a-aaca-4928-8205-6c9bbd1570a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:37.875824 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69f46a-aaca-4928-8205-6c9bbd1570a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:37.875824 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69f46a-aaca-4928-8205-6c9bbd1570a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:37.876792 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69f46a-aaca-4928-8205-6c9bbd1570a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:37.876792 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69f46a-aaca-4928-8205-6c9bbd1570a7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:37.921981 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53ab1b-8654-4e26-abb4-da9455a53e7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:37.923484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53ab1b-8654-4e26-abb4-da9455a53e7e service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:37.935299 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 863/1758] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:38.003045 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 896/1759] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:37 2022] POST /identity/v3/users => generated 295 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:38.003228 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53ab1b-8654-4e26-abb4-da9455a53e7e service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:38.031950 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53ab1b-8654-4e26-abb4-da9455a53e7e service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:38.049567 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bc855-a989-4f31-a94f-9102fbd46343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:38.050216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bc855-a989-4f31-a94f-9102fbd46343 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:38.050537 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bc855-a989-4f31-a94f-9102fbd46343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:38.050776 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bc855-a989-4f31-a94f-9102fbd46343 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:38.051537 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bc855-a989-4f31-a94f-9102fbd46343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:38.084864 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bc855-a989-4f31-a94f-9102fbd46343 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:38.135473 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 864/1760] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:38 2022] GET /identity/v3/roles => generated 1427 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:38.143460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69f46a-aaca-4928-8205-6c9bbd1570a7 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:38.158331 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69f46a-aaca-4928-8205-6c9bbd1570a7 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:38.177295 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec127a17-abd3-4fc0-8b22-bac9ed08e4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:38.180006 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec127a17-abd3-4fc0-8b22-bac9ed08e4ff admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:38.180006 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec127a17-abd3-4fc0-8b22-bac9ed08e4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:38.180244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec127a17-abd3-4fc0-8b22-bac9ed08e4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:38.181096 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec127a17-abd3-4fc0-8b22-bac9ed08e4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:38.192333 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec127a17-abd3-4fc0-8b22-bac9ed08e4ff admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:38.220246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:38.248717 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 897/1761] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:38 2022] GET /identity/v3/roles => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:38.265747 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bc855-a989-4f31-a94f-9102fbd46343 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:38.287305 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bc855-a989-4f31-a94f-9102fbd46343 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:38.312446 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d50ff-167b-41ba-98c8-140694659e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:38.313612 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d50ff-167b-41ba-98c8-140694659e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:38.313906 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d50ff-167b-41ba-98c8-140694659e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:38.314188 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d50ff-167b-41ba-98c8-140694659e60 admin admin] PATH_INFO: `/v3/projects/5980fcbdd1674a15a7de7d57e35c616e/users/109345b07d3a478688bf10dfd9ec1702/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:38.361086 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d50ff-167b-41ba-98c8-140694659e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5980fcbdd1674a15a7de7d57e35c616e, user_id=109345b07d3a478688bf10dfd9ec1702, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:38.403032 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d50ff-167b-41ba-98c8-140694659e60 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:38.536191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 865/1762] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:38 2022] PUT /identity/v3/projects/5980fcbdd1674a15a7de7d57e35c616e/users/109345b07d3a478688bf10dfd9ec1702/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:38.550016 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f87808-5a0a-4b94-849b-674d9faa2ff6 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:38.552095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f87808-5a0a-4b94-849b-674d9faa2ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:38.553595 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f87808-5a0a-4b94-849b-674d9faa2ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:38.587880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8b647-2f48-4a18-896c-e02773af3239 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:38.588575 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8b647-2f48-4a18-896c-e02773af3239 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:38.589113 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8b647-2f48-4a18-896c-e02773af3239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:38.678883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c5f87808-5a0a-4b94-849b-674d9faa2ff6 None None] MFA Rules not processed for user `109345b07d3a478688bf10dfd9ec1702`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:38.682396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-1af8b647-2f48-4a18-896c-e02773af3239 None None] MFA Rules not processed for user `d1a99faad91b4357973f4bbb6632c724`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:38.684453 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c5f87808-5a0a-4b94-849b-674d9faa2ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:38.686677 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1af8b647-2f48-4a18-896c-e02773af3239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:38.907142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 866/1763] 10.222.0.39 () {58 vars in 1019 bytes} [Tue Jul 26 16:23:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:38.943539 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8b647-2f48-4a18-896c-e02773af3239 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:38.945792 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1af8b647-2f48-4a18-896c-e02773af3239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:38.963183 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8b647-2f48-4a18-896c-e02773af3239 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:38.969194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82eb900-3fb0-4210-977a-a032d098fb73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:38.982308 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82eb900-3fb0-4210-977a-a032d098fb73 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:38.982756 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82eb900-3fb0-4210-977a-a032d098fb73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:38.984410 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 898/1764] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:38.985526 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82eb900-3fb0-4210-977a-a032d098fb73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:38.989325 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f87808-5a0a-4b94-849b-674d9faa2ff6 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:39.037432 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82eb900-3fb0-4210-977a-a032d098fb73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:39.043976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82eb900-3fb0-4210-977a-a032d098fb73 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:39.089375 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 867/1765] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:39.194508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f87808-5a0a-4b94-849b-674d9faa2ff6 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:39.211668 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2be83d-f5ac-4bcc-b5cb-311ef8082039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:39.215293 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2be83d-f5ac-4bcc-b5cb-311ef8082039 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:39.216841 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2be83d-f5ac-4bcc-b5cb-311ef8082039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:39.217895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2be83d-f5ac-4bcc-b5cb-311ef8082039 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:39.222649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2be83d-f5ac-4bcc-b5cb-311ef8082039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:39.230824 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2be83d-f5ac-4bcc-b5cb-311ef8082039 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:39.657031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 899/1766] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:38 2022] POST /identity/v3/projects => generated 386 bytes in 665 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:39.658482 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82eb900-3fb0-4210-977a-a032d098fb73 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:39.676275 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82eb900-3fb0-4210-977a-a032d098fb73 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:39.781409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eed78c-1e8e-45ed-b495-cefbdbbb2cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:39.782422 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eed78c-1e8e-45ed-b495-cefbdbbb2cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:39.783025 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eed78c-1e8e-45ed-b495-cefbdbbb2cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:39.783385 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eed78c-1e8e-45ed-b495-cefbdbbb2cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:39.784255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eed78c-1e8e-45ed-b495-cefbdbbb2cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:39.787703 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eed78c-1e8e-45ed-b495-cefbdbbb2cc8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:39.932801 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 868/1767] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:39 2022] POST /identity/v3/users => generated 294 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:39.942091 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2be83d-f5ac-4bcc-b5cb-311ef8082039 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:39.968696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2be83d-f5ac-4bcc-b5cb-311ef8082039 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:39.992850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24801774-2593-4e58-9f0b-e255520377ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:39.995102 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24801774-2593-4e58-9f0b-e255520377ec admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:39.995645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24801774-2593-4e58-9f0b-e255520377ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:39.996488 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24801774-2593-4e58-9f0b-e255520377ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:40.000796 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:40.001290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24801774-2593-4e58-9f0b-e255520377ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:40.003321 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24801774-2593-4e58-9f0b-e255520377ec admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:40.031266 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eed78c-1e8e-45ed-b495-cefbdbbb2cc8 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:40.032908 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 900/1768] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:39 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:40.059313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eed78c-1e8e-45ed-b495-cefbdbbb2cc8 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:40.090474 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291faa0-63e4-4dfc-a289-3e6c26d7f1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:40.091330 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291faa0-63e4-4dfc-a289-3e6c26d7f1bc admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:40.091677 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291faa0-63e4-4dfc-a289-3e6c26d7f1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:40.092069 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291faa0-63e4-4dfc-a289-3e6c26d7f1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:40.092952 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291faa0-63e4-4dfc-a289-3e6c26d7f1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:40.099428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291faa0-63e4-4dfc-a289-3e6c26d7f1bc admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:40.136026 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 869/1769] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:40 2022] GET /identity/v3/roles => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:23:40.137481 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24801774-2593-4e58-9f0b-e255520377ec admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:40.157430 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24801774-2593-4e58-9f0b-e255520377ec admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:40.201220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e1301-331f-4828-a889-e6b257ceeaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:40.201220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e1301-331f-4828-a889-e6b257ceeaa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:40.201220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e1301-331f-4828-a889-e6b257ceeaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:40.201220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e1301-331f-4828-a889-e6b257ceeaa6 admin admin] PATH_INFO: `/v3/projects/55e497172350425185f6148abd3acf9a/users/fb12379981194a2f883619fdf78d021a/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:40.289684 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e1301-331f-4828-a889-e6b257ceeaa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e497172350425185f6148abd3acf9a, user_id=fb12379981194a2f883619fdf78d021a, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:40.292481 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e1301-331f-4828-a889-e6b257ceeaa6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:40.412310 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 901/1770] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:40 2022] PUT /identity/v3/projects/55e497172350425185f6148abd3acf9a/users/fb12379981194a2f883619fdf78d021a/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:40.424694 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd189e8c-5f95-4c43-99fa-e40fcdf302ba None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:40.424999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd189e8c-5f95-4c43-99fa-e40fcdf302ba None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:40.425280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd189e8c-5f95-4c43-99fa-e40fcdf302ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:40.497251 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:40.564430 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-fd189e8c-5f95-4c43-99fa-e40fcdf302ba None None] MFA Rules not processed for user `fb12379981194a2f883619fdf78d021a`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:40.568952 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fd189e8c-5f95-4c43-99fa-e40fcdf302ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:40.580901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020e61e-c7be-4a4f-a534-d8da4c6c4f69 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:40.581218 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020e61e-c7be-4a4f-a534-d8da4c6c4f69 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:40.581552 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020e61e-c7be-4a4f-a534-d8da4c6c4f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:40.659686 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-b020e61e-c7be-4a4f-a534-d8da4c6c4f69 None None] MFA Rules not processed for user `dac17cb3a7634d4ba09e5e289909beb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:40.661007 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b020e61e-c7be-4a4f-a534-d8da4c6c4f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:40.820532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 870/1771] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:40.821513 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd189e8c-5f95-4c43-99fa-e40fcdf302ba None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:40.878941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 902/1772] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:40 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:40.987287 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd189e8c-5f95-4c43-99fa-e40fcdf302ba None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:41.004295 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8dc0d0-4c13-477c-8184-b8de281526cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:41.005123 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dc0d0-4c13-477c-8184-b8de281526cb admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:41.005659 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dc0d0-4c13-477c-8184-b8de281526cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:41.006156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dc0d0-4c13-477c-8184-b8de281526cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:41.007581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8dc0d0-4c13-477c-8184-b8de281526cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:41.012155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8dc0d0-4c13-477c-8184-b8de281526cb admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:41.309113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020e61e-c7be-4a4f-a534-d8da4c6c4f69 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:41.320878 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 871/1773] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:40 2022] POST /identity/v3/projects => generated 388 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:41.322634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020e61e-c7be-4a4f-a534-d8da4c6c4f69 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:41.703434 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9e55b-4ffe-424f-bd4d-b5224b03e2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:41.703434 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9e55b-4ffe-424f-bd4d-b5224b03e2fb admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:41.703434 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9e55b-4ffe-424f-bd4d-b5224b03e2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:41.703434 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9e55b-4ffe-424f-bd4d-b5224b03e2fb admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:41.744596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9e55b-4ffe-424f-bd4d-b5224b03e2fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:41.755189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9e55b-4ffe-424f-bd4d-b5224b03e2fb admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:42.068444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8dc0d0-4c13-477c-8184-b8de281526cb admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:42.070766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 903/1774] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:41 2022] POST /identity/v3/users => generated 301 bytes in 761 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:23:42.105198 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8dc0d0-4c13-477c-8184-b8de281526cb admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:42.128613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b87b9-7063-49cc-b77a-6109f8fc54e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:42.129322 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b87b9-7063-49cc-b77a-6109f8fc54e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:42.129608 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b87b9-7063-49cc-b77a-6109f8fc54e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:42.129883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b87b9-7063-49cc-b77a-6109f8fc54e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:42.130602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b87b9-7063-49cc-b77a-6109f8fc54e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:42.137161 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b87b9-7063-49cc-b77a-6109f8fc54e1 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:42.218948 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9e55b-4ffe-424f-bd4d-b5224b03e2fb admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:42.227909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 872/1775] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:42 2022] GET /identity/v3/roles => generated 1427 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:23:42.266327 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9e55b-4ffe-424f-bd4d-b5224b03e2fb admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:42.284652 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b5f3a-688e-4e1a-8fe4-f157b05b227c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:42.285629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b5f3a-688e-4e1a-8fe4-f157b05b227c admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:42.287343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b5f3a-688e-4e1a-8fe4-f157b05b227c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:42.287880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b5f3a-688e-4e1a-8fe4-f157b05b227c admin admin] PATH_INFO: `/v3/projects/5703da96b7764b4e81311f8665941a90/users/bd5013f9f2264c4688d71559e6576d9a/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:42.332296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b5f3a-688e-4e1a-8fe4-f157b05b227c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5703da96b7764b4e81311f8665941a90, user_id=bd5013f9f2264c4688d71559e6576d9a, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:42.336578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b5f3a-688e-4e1a-8fe4-f157b05b227c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:42.433445 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 904/1776] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:42 2022] PUT /identity/v3/projects/5703da96b7764b4e81311f8665941a90/users/bd5013f9f2264c4688d71559e6576d9a/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:42.440071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b87b9-7063-49cc-b77a-6109f8fc54e1 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:42.465321 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b87b9-7063-49cc-b77a-6109f8fc54e1 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:42.577697 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:42.667651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab00bb-bf25-4822-b64a-7c56d7afbcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:42.673931 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab00bb-bf25-4822-b64a-7c56d7afbcdd admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:42.674370 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab00bb-bf25-4822-b64a-7c56d7afbcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:42.684731 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab00bb-bf25-4822-b64a-7c56d7afbcdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:42.687263 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab00bb-bf25-4822-b64a-7c56d7afbcdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:42.693404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab00bb-bf25-4822-b64a-7c56d7afbcdd admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:42.727300 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 873/1777] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:42 2022] GET /identity/v3/roles => generated 1427 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:42.731544 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b5f3a-688e-4e1a-8fe4-f157b05b227c admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:42.752549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b5f3a-688e-4e1a-8fe4-f157b05b227c admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:42.764632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf76fa4-81af-4582-9c93-5c3b0d45986e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:42.766553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf76fa4-81af-4582-9c93-5c3b0d45986e admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:42.767098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf76fa4-81af-4582-9c93-5c3b0d45986e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:42.767588 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf76fa4-81af-4582-9c93-5c3b0d45986e admin admin] PATH_INFO: `/v3/projects/5703da96b7764b4e81311f8665941a90/users/bd5013f9f2264c4688d71559e6576d9a/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:42.776560 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf76fa4-81af-4582-9c93-5c3b0d45986e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5703da96b7764b4e81311f8665941a90, user_id=bd5013f9f2264c4688d71559e6576d9a, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:42.779746 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf76fa4-81af-4582-9c93-5c3b0d45986e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:42.815396 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 905/1778] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:42 2022] PUT /identity/v3/projects/5703da96b7764b4e81311f8665941a90/users/bd5013f9f2264c4688d71559e6576d9a/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:42.816016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0b162-9b8c-4fb5-bae5-5ba3880e8412 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:42.816304 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0b162-9b8c-4fb5-bae5-5ba3880e8412 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:42.816577 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0b162-9b8c-4fb5-bae5-5ba3880e8412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:42.945990 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-04e0b162-9b8c-4fb5-bae5-5ba3880e8412 None None] MFA Rules not processed for user `bd5013f9f2264c4688d71559e6576d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:42.951584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-04e0b162-9b8c-4fb5-bae5-5ba3880e8412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:43.327631 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 874/1779] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:23:43.362972 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed99c7-2351-4609-91b1-66ace06a9785 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:43.364042 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed99c7-2351-4609-91b1-66ace06a9785 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:43.364545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed99c7-2351-4609-91b1-66ace06a9785 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:43.366402 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 906/1780] 10.222.0.141 () {54 vars in 926 bytes} [Tue Jul 26 16:23:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:23:43.425465 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e6be7-e451-450b-96a4-7dfd5f2adf46 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:43.425764 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e6be7-e451-450b-96a4-7dfd5f2adf46 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:43.426292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e6be7-e451-450b-96a4-7dfd5f2adf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:43.600614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d35e6be7-e451-450b-96a4-7dfd5f2adf46 None None] MFA Rules not processed for user `f7eac931cabf4921b6dbd42f63b9300f`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:43.600614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d35e6be7-e451-450b-96a4-7dfd5f2adf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:43.644506 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 875/1781] 10.222.0.141 () {58 vars in 1023 bytes} [Tue Jul 26 16:23:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:43.658482 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed99c7-2351-4609-91b1-66ace06a9785 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:43.660865 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8bed99c7-2351-4609-91b1-66ace06a9785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:43.697866 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed99c7-2351-4609-91b1-66ace06a9785 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:43.730049 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598ea11-7bfc-46e4-9e57-27fc25ee9965 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:43.731021 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598ea11-7bfc-46e4-9e57-27fc25ee9965 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:43.731413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598ea11-7bfc-46e4-9e57-27fc25ee9965 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:43.731843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598ea11-7bfc-46e4-9e57-27fc25ee9965 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:43.775828 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598ea11-7bfc-46e4-9e57-27fc25ee9965 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:43.789124 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598ea11-7bfc-46e4-9e57-27fc25ee9965 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:43.798484 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:43.835011 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 907/1782] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:43.893966 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e6be7-e451-450b-96a4-7dfd5f2adf46 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:43.895912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d35e6be7-e451-450b-96a4-7dfd5f2adf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:44.053737 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e6be7-e451-450b-96a4-7dfd5f2adf46 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:44.058141 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0be8e2-4094-4443-b567-32e2be59c68e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:44.065487 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0be8e2-4094-4443-b567-32e2be59c68e service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:44.065487 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0be8e2-4094-4443-b567-32e2be59c68e service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:44.069850 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0be8e2-4094-4443-b567-32e2be59c68e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:44.108416 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0be8e2-4094-4443-b567-32e2be59c68e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:44.111659 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0be8e2-4094-4443-b567-32e2be59c68e service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:44.139919 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 876/1783] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:43 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:45.619250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ea801-1081-40cc-8b03-bcbf1b221216 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:45.620160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ea801-1081-40cc-8b03-bcbf1b221216 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:45.620618 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ea801-1081-40cc-8b03-bcbf1b221216 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:45.622468 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 908/1784] 10.222.0.141 () {54 vars in 926 bytes} [Tue Jul 26 16:23:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:23:45.661126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fd7f8-a7e8-4cd6-a653-f45a9ede0127 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:45.662058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fd7f8-a7e8-4cd6-a653-f45a9ede0127 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:45.663020 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fd7f8-a7e8-4cd6-a653-f45a9ede0127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:45.704602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-757fd7f8-a7e8-4cd6-a653-f45a9ede0127 None None] MFA Rules not processed for user `fda05b7b9675423e992470819d1c150a`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:45.706302 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-757fd7f8-a7e8-4cd6-a653-f45a9ede0127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:45.861992 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 877/1785] 10.222.0.141 () {58 vars in 1023 bytes} [Tue Jul 26 16:23:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:23:45.899413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ea801-1081-40cc-8b03-bcbf1b221216 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:45.901228 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-157ea801-1081-40cc-8b03-bcbf1b221216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:45.942963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ea801-1081-40cc-8b03-bcbf1b221216 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:45.951811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d50a6-3d0a-4b2e-b9b8-e9f616b2bb9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda05b7b9675423e992470819d1c150a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:45.954754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d50a6-3d0a-4b2e-b9b8-e9f616b2bb9a service placement] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:45.955387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d50a6-3d0a-4b2e-b9b8-e9f616b2bb9a service placement] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:45.955809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d50a6-3d0a-4b2e-b9b8-e9f616b2bb9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:45.980431 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d50a6-3d0a-4b2e-b9b8-e9f616b2bb9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:45.982160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d50a6-3d0a-4b2e-b9b8-e9f616b2bb9a service placement] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:46.002674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 909/1786] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:46.503566 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757fd7f8-a7e8-4cd6-a653-f45a9ede0127 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:46.519927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757fd7f8-a7e8-4cd6-a653-f45a9ede0127 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:46.541457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cfa74-8bf5-4f66-939e-deab4fb1185c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:46.542477 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cfa74-8bf5-4f66-939e-deab4fb1185c service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:46.542477 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cfa74-8bf5-4f66-939e-deab4fb1185c service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:46.542654 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cfa74-8bf5-4f66-939e-deab4fb1185c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:46.674519 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cfa74-8bf5-4f66-939e-deab4fb1185c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:46.677450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cfa74-8bf5-4f66-939e-deab4fb1185c service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:46.694772 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 878/1787] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:47.182808 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:47.706242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:48.565036 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d50a6-3d0a-4b2e-b9b8-e9f616b2bb9a service placement] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:48.570297 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1c8d50a6-3d0a-4b2e-b9b8-e9f616b2bb9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:48.759342 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d50a6-3d0a-4b2e-b9b8-e9f616b2bb9a service placement] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:48.763828 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03999caf-3c8a-4da7-b8c7-481ea95d091d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:48.764690 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03999caf-3c8a-4da7-b8c7-481ea95d091d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:48.765051 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03999caf-3c8a-4da7-b8c7-481ea95d091d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:48.765522 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03999caf-3c8a-4da7-b8c7-481ea95d091d admin admin] PATH_INFO: `/v3/users/b1c74b8fa63644388db43c05e0cde9bf` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:48.769546 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03999caf-3c8a-4da7-b8c7-481ea95d091d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1c74b8fa63644388db43c05e0cde9bf)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:48.773338 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03999caf-3c8a-4da7-b8c7-481ea95d091d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:49.168108 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-03999caf-3c8a-4da7-b8c7-481ea95d091d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1c74b8fa63644388db43c05e0cde9bf'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:49.168108 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-03999caf-3c8a-4da7-b8c7-481ea95d091d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1c74b8fa63644388db43c05e0cde9bf'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:49.260388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-03999caf-3c8a-4da7-b8c7-481ea95d091d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1c74b8fa63644388db43c05e0cde9bf'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:49.283172 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-03999caf-3c8a-4da7-b8c7-481ea95d091d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1c74b8fa63644388db43c05e0cde9bf'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:49.285433 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-03999caf-3c8a-4da7-b8c7-481ea95d091d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1c74b8fa63644388db43c05e0cde9bf'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:49.315162 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 910/1788] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:23:48 2022] DELETE /identity/v3/users/b1c74b8fa63644388db43c05e0cde9bf => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:49.316926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecfc76-c212-463e-9860-f5bd403375f6 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:49.317478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecfc76-c212-463e-9860-f5bd403375f6 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:49.317478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecfc76-c212-463e-9860-f5bd403375f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:49.383124 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-cfecfc76-c212-463e-9860-f5bd403375f6 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:49.384546 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-cfecfc76-c212-463e-9860-f5bd403375f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:49.567133 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 879/1789] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:49.604821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03999caf-3c8a-4da7-b8c7-481ea95d091d admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:49.607185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-03999caf-3c8a-4da7-b8c7-481ea95d091d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:49.827912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03999caf-3c8a-4da7-b8c7-481ea95d091d admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:49.841597 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b90be1-8fdf-40ec-9768-74f3863d6375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:49.842527 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b90be1-8fdf-40ec-9768-74f3863d6375 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:49.844920 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b90be1-8fdf-40ec-9768-74f3863d6375 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:49.845376 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b90be1-8fdf-40ec-9768-74f3863d6375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:49.874320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b90be1-8fdf-40ec-9768-74f3863d6375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:49.876601 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b90be1-8fdf-40ec-9768-74f3863d6375 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:49.922187 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 911/1790] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:50.290389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecfc76-c212-463e-9860-f5bd403375f6 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:50.292100 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-cfecfc76-c212-463e-9860-f5bd403375f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:50.314596 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecfc76-c212-463e-9860-f5bd403375f6 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:50.357353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafc43d-0dc5-49cc-a88b-ea1cfeab89af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:50.359195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafc43d-0dc5-49cc-a88b-ea1cfeab89af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:50.361849 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafc43d-0dc5-49cc-a88b-ea1cfeab89af admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:50.362351 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafc43d-0dc5-49cc-a88b-ea1cfeab89af admin admin] PATH_INFO: `/v3/users/7d96314143f7446caf8a1caf1ebfec9c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:50.379751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafc43d-0dc5-49cc-a88b-ea1cfeab89af admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d96314143f7446caf8a1caf1ebfec9c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:50.389334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafc43d-0dc5-49cc-a88b-ea1cfeab89af admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:50.461504 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0f394-eb32-442a-9b6d-949e50015906 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:50.461812 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0f394-eb32-442a-9b6d-949e50015906 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:50.462320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0f394-eb32-442a-9b6d-949e50015906 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:50.463993 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 912/1791] 10.222.0.141 () {54 vars in 926 bytes} [Tue Jul 26 16:23:50 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:23:50.492607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bd6f1-dcca-4ef4-b238-267c3d85493b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:50.498098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bd6f1-dcca-4ef4-b238-267c3d85493b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:50.498098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bd6f1-dcca-4ef4-b238-267c3d85493b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:50.541913 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6c6bd6f1-dcca-4ef4-b238-267c3d85493b None None] MFA Rules not processed for user `f7eac931cabf4921b6dbd42f63b9300f`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:50.543181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6c6bd6f1-dcca-4ef4-b238-267c3d85493b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:50.580608 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:50.741365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 913/1792] 10.222.0.141 () {58 vars in 1023 bytes} [Tue Jul 26 16:23:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:50.870557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bd6f1-dcca-4ef4-b238-267c3d85493b None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:50.871982 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6c6bd6f1-dcca-4ef4-b238-267c3d85493b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:50.889018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bd6f1-dcca-4ef4-b238-267c3d85493b None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:50.896959 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307593d-d36d-4438-a53b-e1b0106320a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:50.897595 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307593d-d36d-4438-a53b-e1b0106320a8 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:50.897879 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307593d-d36d-4438-a53b-e1b0106320a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:50.898156 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307593d-d36d-4438-a53b-e1b0106320a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:50.908044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307593d-d36d-4438-a53b-e1b0106320a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:50.909739 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307593d-d36d-4438-a53b-e1b0106320a8 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:50.936592 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 914/1793] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:23:50.977757 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3dafc43d-0dc5-49cc-a88b-ea1cfeab89af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d96314143f7446caf8a1caf1ebfec9c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:50.978871 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3dafc43d-0dc5-49cc-a88b-ea1cfeab89af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d96314143f7446caf8a1caf1ebfec9c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:50.996168 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3dafc43d-0dc5-49cc-a88b-ea1cfeab89af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d96314143f7446caf8a1caf1ebfec9c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:51.005249 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3dafc43d-0dc5-49cc-a88b-ea1cfeab89af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d96314143f7446caf8a1caf1ebfec9c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:51.068126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3dafc43d-0dc5-49cc-a88b-ea1cfeab89af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d96314143f7446caf8a1caf1ebfec9c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:51.080173 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 880/1794] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:23:50 2022] DELETE /identity/v3/users/7d96314143f7446caf8a1caf1ebfec9c => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:51.154439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307593d-d36d-4438-a53b-e1b0106320a8 service nova] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:51.155867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e307593d-d36d-4438-a53b-e1b0106320a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:51.182236 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307593d-d36d-4438-a53b-e1b0106320a8 service nova] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:51.265989 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8b168-9024-45c7-9a06-9ed525168e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:51.266371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8b168-9024-45c7-9a06-9ed525168e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:51.266656 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8b168-9024-45c7-9a06-9ed525168e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:51.266933 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8b168-9024-45c7-9a06-9ed525168e3f admin admin] PATH_INFO: `/v3/projects/ca8037eddf434ac6aa966303f4f5556a` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:51.268212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8b168-9024-45c7-9a06-9ed525168e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca8037eddf434ac6aa966303f4f5556a)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:51.270378 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8b168-9024-45c7-9a06-9ed525168e3f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:51.420943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2de8b168-9024-45c7-9a06-9ed525168e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca8037eddf434ac6aa966303f4f5556a', 'request_id': 'req-2de8b168-9024-45c7-9a06-9ed525168e3f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:51.447997 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2de8b168-9024-45c7-9a06-9ed525168e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca8037eddf434ac6aa966303f4f5556a', 'request_id': 'req-2de8b168-9024-45c7-9a06-9ed525168e3f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:51.468782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2de8b168-9024-45c7-9a06-9ed525168e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca8037eddf434ac6aa966303f4f5556a', 'request_id': 'req-2de8b168-9024-45c7-9a06-9ed525168e3f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:51.632123 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafc43d-0dc5-49cc-a88b-ea1cfeab89af admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:51.633637 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3dafc43d-0dc5-49cc-a88b-ea1cfeab89af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:51.653880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2de8b168-9024-45c7-9a06-9ed525168e3f admin admin] The token cache is being invalidate because project ca8037eddf434ac6aa966303f4f5556a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:23:51.653880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2de8b168-9024-45c7-9a06-9ed525168e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:51.660623 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafc43d-0dc5-49cc-a88b-ea1cfeab89af admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:51.665178 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2de8b168-9024-45c7-9a06-9ed525168e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:51.667397 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 915/1795] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:23:51 2022] DELETE /identity/v3/projects/ca8037eddf434ac6aa966303f4f5556a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:51.671398 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8b168-9024-45c7-9a06-9ed525168e3f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:51.678341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2de8b168-9024-45c7-9a06-9ed525168e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:51.808420 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88869a3e-660f-4811-951c-2bb391f1758b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:51.809532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88869a3e-660f-4811-951c-2bb391f1758b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:51.809900 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88869a3e-660f-4811-951c-2bb391f1758b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:51.810515 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88869a3e-660f-4811-951c-2bb391f1758b admin admin] PATH_INFO: `/v3/projects/64574ad71937449a8b091eb154db0f5a` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:51.812077 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88869a3e-660f-4811-951c-2bb391f1758b admin admin] RBAC: Authorizing `identity:delete_project(project_id=64574ad71937449a8b091eb154db0f5a)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:51.815618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88869a3e-660f-4811-951c-2bb391f1758b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:51.822167 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8b168-9024-45c7-9a06-9ed525168e3f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:51.829405 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db5664-21be-4383-8c4d-356c9bc6619a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:51.830513 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db5664-21be-4383-8c4d-356c9bc6619a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:51.831055 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db5664-21be-4383-8c4d-356c9bc6619a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:51.831531 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db5664-21be-4383-8c4d-356c9bc6619a admin admin] PATH_INFO: `/v3/users/6fa4b75a067a4ba6b65a4818c2ec3511` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:51.850441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db5664-21be-4383-8c4d-356c9bc6619a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fa4b75a067a4ba6b65a4818c2ec3511)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:51.854152 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db5664-21be-4383-8c4d-356c9bc6619a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:52.020249 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-88869a3e-660f-4811-951c-2bb391f1758b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64574ad71937449a8b091eb154db0f5a', 'request_id': 'req-88869a3e-660f-4811-951c-2bb391f1758b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:52.033018 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-88869a3e-660f-4811-951c-2bb391f1758b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64574ad71937449a8b091eb154db0f5a', 'request_id': 'req-88869a3e-660f-4811-951c-2bb391f1758b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:52.039529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:52.057648 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-88869a3e-660f-4811-951c-2bb391f1758b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64574ad71937449a8b091eb154db0f5a', 'request_id': 'req-88869a3e-660f-4811-951c-2bb391f1758b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:52.101714 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-23db5664-21be-4383-8c4d-356c9bc6619a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fa4b75a067a4ba6b65a4818c2ec3511'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:52.108700 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-23db5664-21be-4383-8c4d-356c9bc6619a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fa4b75a067a4ba6b65a4818c2ec3511'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:52.137391 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-88869a3e-660f-4811-951c-2bb391f1758b admin admin] The token cache is being invalidate because project 64574ad71937449a8b091eb154db0f5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:23:52.137877 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-88869a3e-660f-4811-951c-2bb391f1758b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:52.138723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-88869a3e-660f-4811-951c-2bb391f1758b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:52.140438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 881/1796] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:23:51 2022] DELETE /identity/v3/projects/64574ad71937449a8b091eb154db0f5a => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:52.144887 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88869a3e-660f-4811-951c-2bb391f1758b admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:52.147044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-88869a3e-660f-4811-951c-2bb391f1758b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:52.219504 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-23db5664-21be-4383-8c4d-356c9bc6619a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fa4b75a067a4ba6b65a4818c2ec3511'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:52.235153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-23db5664-21be-4383-8c4d-356c9bc6619a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fa4b75a067a4ba6b65a4818c2ec3511'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:52.235943 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88869a3e-660f-4811-951c-2bb391f1758b admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:52.236249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-23db5664-21be-4383-8c4d-356c9bc6619a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fa4b75a067a4ba6b65a4818c2ec3511'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:52.240830 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba35b1-3c89-4e42-a751-21255938f219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:52.241480 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba35b1-3c89-4e42-a751-21255938f219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:52.241766 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba35b1-3c89-4e42-a751-21255938f219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:52.242043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba35b1-3c89-4e42-a751-21255938f219 admin admin] PATH_INFO: `/v3/users/dac17cb3a7634d4ba09e5e289909beb7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:52.243214 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba35b1-3c89-4e42-a751-21255938f219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dac17cb3a7634d4ba09e5e289909beb7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:52.245177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba35b1-3c89-4e42-a751-21255938f219 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:52.249259 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 916/1797] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:23:51 2022] DELETE /identity/v3/users/6fa4b75a067a4ba6b65a4818c2ec3511 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:23:52.414970 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:52.492169 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9cba35b1-3c89-4e42-a751-21255938f219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dac17cb3a7634d4ba09e5e289909beb7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:52.496631 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9cba35b1-3c89-4e42-a751-21255938f219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dac17cb3a7634d4ba09e5e289909beb7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:52.513203 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9cba35b1-3c89-4e42-a751-21255938f219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dac17cb3a7634d4ba09e5e289909beb7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:52.522650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9cba35b1-3c89-4e42-a751-21255938f219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dac17cb3a7634d4ba09e5e289909beb7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:52.625384 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9cba35b1-3c89-4e42-a751-21255938f219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dac17cb3a7634d4ba09e5e289909beb7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:52.635883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 882/1798] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:23:52 2022] DELETE /identity/v3/users/dac17cb3a7634d4ba09e5e289909beb7 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:53.131802 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db5664-21be-4383-8c4d-356c9bc6619a admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:53.134313 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-23db5664-21be-4383-8c4d-356c9bc6619a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:53.293084 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db5664-21be-4383-8c4d-356c9bc6619a admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:53.381777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812913dc-6e79-4f0d-b2b7-7e6035705466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:53.383336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812913dc-6e79-4f0d-b2b7-7e6035705466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:53.383617 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812913dc-6e79-4f0d-b2b7-7e6035705466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:53.383938 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812913dc-6e79-4f0d-b2b7-7e6035705466 admin admin] PATH_INFO: `/v3/users/6a65c974638a454ea88d52dee9ca8738` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:53.385960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812913dc-6e79-4f0d-b2b7-7e6035705466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a65c974638a454ea88d52dee9ca8738)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:53.388330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812913dc-6e79-4f0d-b2b7-7e6035705466 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:53.594947 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba35b1-3c89-4e42-a751-21255938f219 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:53.596455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9cba35b1-3c89-4e42-a751-21255938f219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:53.609419 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba35b1-3c89-4e42-a751-21255938f219 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:53.618879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7970f-8dd5-47f2-a692-1fdd9943efb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:53.618879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7970f-8dd5-47f2-a692-1fdd9943efb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:53.618879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7970f-8dd5-47f2-a692-1fdd9943efb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:53.618879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7970f-8dd5-47f2-a692-1fdd9943efb5 admin admin] PATH_INFO: `/v3/projects/7c95334f684643ca88e77fa8dce0885b` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:53.619173 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7970f-8dd5-47f2-a692-1fdd9943efb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c95334f684643ca88e77fa8dce0885b)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:53.619709 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7970f-8dd5-47f2-a692-1fdd9943efb5 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:53.689569 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-812913dc-6e79-4f0d-b2b7-7e6035705466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a65c974638a454ea88d52dee9ca8738'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:53.690238 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-812913dc-6e79-4f0d-b2b7-7e6035705466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a65c974638a454ea88d52dee9ca8738'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:53.752854 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-812913dc-6e79-4f0d-b2b7-7e6035705466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a65c974638a454ea88d52dee9ca8738'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:53.765651 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-812913dc-6e79-4f0d-b2b7-7e6035705466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a65c974638a454ea88d52dee9ca8738'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:53.766332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-812913dc-6e79-4f0d-b2b7-7e6035705466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a65c974638a454ea88d52dee9ca8738'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:53.771115 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e6a7970f-8dd5-47f2-a692-1fdd9943efb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c95334f684643ca88e77fa8dce0885b', 'request_id': 'req-e6a7970f-8dd5-47f2-a692-1fdd9943efb5'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:53.777798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e6a7970f-8dd5-47f2-a692-1fdd9943efb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c95334f684643ca88e77fa8dce0885b', 'request_id': 'req-e6a7970f-8dd5-47f2-a692-1fdd9943efb5'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:53.779736 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 917/1799] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:23:53 2022] DELETE /identity/v3/users/6a65c974638a454ea88d52dee9ca8738 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:53.781412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812913dc-6e79-4f0d-b2b7-7e6035705466 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:53.782996 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-812913dc-6e79-4f0d-b2b7-7e6035705466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:53.784152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e6a7970f-8dd5-47f2-a692-1fdd9943efb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c95334f684643ca88e77fa8dce0885b', 'request_id': 'req-e6a7970f-8dd5-47f2-a692-1fdd9943efb5'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:53.846388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812913dc-6e79-4f0d-b2b7-7e6035705466 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:53.852066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de786bf5-9e6b-4cf9-851c-78a3b236ae0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:53.852773 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de786bf5-9e6b-4cf9-851c-78a3b236ae0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:53.853057 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de786bf5-9e6b-4cf9-851c-78a3b236ae0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:53.853332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de786bf5-9e6b-4cf9-851c-78a3b236ae0b admin admin] PATH_INFO: `/v3/projects/879717ff23c4492e9018f026100069ec` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:53.854715 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de786bf5-9e6b-4cf9-851c-78a3b236ae0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=879717ff23c4492e9018f026100069ec)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:53.855984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e6a7970f-8dd5-47f2-a692-1fdd9943efb5 admin admin] The token cache is being invalidate because project 7c95334f684643ca88e77fa8dce0885b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:23:53.856282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e6a7970f-8dd5-47f2-a692-1fdd9943efb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:53.856638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de786bf5-9e6b-4cf9-851c-78a3b236ae0b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:53.857001 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e6a7970f-8dd5-47f2-a692-1fdd9943efb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:53.858559 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 883/1800] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:23:53 2022] DELETE /identity/v3/projects/7c95334f684643ca88e77fa8dce0885b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:23:53.859318 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7970f-8dd5-47f2-a692-1fdd9943efb5 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:53.860910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e6a7970f-8dd5-47f2-a692-1fdd9943efb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:53.918348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7970f-8dd5-47f2-a692-1fdd9943efb5 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:53.988191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc320509-b7be-44f7-a176-d83019efbff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:53.989334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc320509-b7be-44f7-a176-d83019efbff7 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:53.989901 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc320509-b7be-44f7-a176-d83019efbff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:53.992353 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-de786bf5-9e6b-4cf9-851c-78a3b236ae0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879717ff23c4492e9018f026100069ec', 'request_id': 'req-de786bf5-9e6b-4cf9-851c-78a3b236ae0b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:53.994084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc320509-b7be-44f7-a176-d83019efbff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:54.001010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-dc320509-b7be-44f7-a176-d83019efbff7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:54.005144 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-de786bf5-9e6b-4cf9-851c-78a3b236ae0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879717ff23c4492e9018f026100069ec', 'request_id': 'req-de786bf5-9e6b-4cf9-851c-78a3b236ae0b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:54.023184 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-de786bf5-9e6b-4cf9-851c-78a3b236ae0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879717ff23c4492e9018f026100069ec', 'request_id': 'req-de786bf5-9e6b-4cf9-851c-78a3b236ae0b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:54.088857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc320509-b7be-44f7-a176-d83019efbff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:54.090358 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc320509-b7be-44f7-a176-d83019efbff7 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:54.100638 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 884/1801] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:54.102148 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cdefe-cb8d-45b4-9165-96ac8d4b1198 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:54.102573 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cdefe-cb8d-45b4-9165-96ac8d4b1198 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:54.103064 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cdefe-cb8d-45b4-9165-96ac8d4b1198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:54.112987 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-de786bf5-9e6b-4cf9-851c-78a3b236ae0b admin admin] The token cache is being invalidate because project 879717ff23c4492e9018f026100069ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:23:54.113282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-de786bf5-9e6b-4cf9-851c-78a3b236ae0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:54.113937 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-de786bf5-9e6b-4cf9-851c-78a3b236ae0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:54.122326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 918/1802] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:23:53 2022] DELETE /identity/v3/projects/879717ff23c4492e9018f026100069ec => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:54.122326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b642ce-6939-400a-8101-d7d49f637852 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:54.122326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b642ce-6939-400a-8101-d7d49f637852 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:54.122326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b642ce-6939-400a-8101-d7d49f637852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:54.150678 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-96b642ce-6939-400a-8101-d7d49f637852 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:54.151922 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-96b642ce-6939-400a-8101-d7d49f637852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:54.155700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-7a9cdefe-cb8d-45b4-9165-96ac8d4b1198 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:54.159241 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7a9cdefe-cb8d-45b4-9165-96ac8d4b1198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:54.240341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:54.240842 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 919/1803] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:54.242333 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0cf30-6300-45ac-9be1-a6cd41cb112e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:54.243267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0cf30-6300-45ac-9be1-a6cd41cb112e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:54.246148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0cf30-6300-45ac-9be1-a6cd41cb112e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:54.278674 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 885/1804] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:54.280225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e9c36-d564-482d-a87b-985bd45b7e6a None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:54.280750 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e9c36-d564-482d-a87b-985bd45b7e6a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:54.281647 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e9c36-d564-482d-a87b-985bd45b7e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:54.283456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-07a0cf30-6300-45ac-9be1-a6cd41cb112e None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:54.285071 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-07a0cf30-6300-45ac-9be1-a6cd41cb112e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:54.299980 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 920/1805] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:54.307875 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17bd35-4cce-46a0-aaa7-e5f30aa7c6f9 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:54.308500 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17bd35-4cce-46a0-aaa7-e5f30aa7c6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:54.309047 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17bd35-4cce-46a0-aaa7-e5f30aa7c6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:54.323011 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-0b2e9c36-d564-482d-a87b-985bd45b7e6a None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:54.324530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0b2e9c36-d564-482d-a87b-985bd45b7e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:54.334645 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 886/1806] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:54.334981 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e9c36-d564-482d-a87b-985bd45b7e6a None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:54.336412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-0c17bd35-4cce-46a0-aaa7-e5f30aa7c6f9 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:54.336824 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0b2e9c36-d564-482d-a87b-985bd45b7e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:54.337733 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0c17bd35-4cce-46a0-aaa7-e5f30aa7c6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:54.347717 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 921/1807] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:23:54.349107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17bd35-4cce-46a0-aaa7-e5f30aa7c6f9 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:54.366238 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17bd35-4cce-46a0-aaa7-e5f30aa7c6f9 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:54.369960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92735f-514d-4784-9799-a1929c5f9a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:54.370684 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92735f-514d-4784-9799-a1929c5f9a1f admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:54.370970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92735f-514d-4784-9799-a1929c5f9a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:54.371241 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92735f-514d-4784-9799-a1929c5f9a1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:54.372374 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92735f-514d-4784-9799-a1929c5f9a1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:23:54.372816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92735f-514d-4784-9799-a1929c5f9a1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:54.374680 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92735f-514d-4784-9799-a1929c5f9a1f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:54.392376 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 922/1808] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:23:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:23:54.393262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92735f-514d-4784-9799-a1929c5f9a1f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:54.404733 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92735f-514d-4784-9799-a1929c5f9a1f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:54.410193 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7d9c1-4d1f-49be-aa7a-87db9b69a829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:54.412869 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7d9c1-4d1f-49be-aa7a-87db9b69a829 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:54.412869 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7d9c1-4d1f-49be-aa7a-87db9b69a829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:54.412869 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7d9c1-4d1f-49be-aa7a-87db9b69a829 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:54.412869 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7d9c1-4d1f-49be-aa7a-87db9b69a829 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:23:54.413317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7d9c1-4d1f-49be-aa7a-87db9b69a829 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:54.415014 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7d9c1-4d1f-49be-aa7a-87db9b69a829 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:54.424245 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e9c36-d564-482d-a87b-985bd45b7e6a None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:54.428377 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5501d-7314-4818-a588-3776427785c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:54.429594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5501d-7314-4818-a588-3776427785c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:54.429879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5501d-7314-4818-a588-3776427785c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:54.430151 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5501d-7314-4818-a588-3776427785c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:54.435159 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 923/1809] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:23:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:23:54.436146 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7d9c1-4d1f-49be-aa7a-87db9b69a829 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:54.447108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5501d-7314-4818-a588-3776427785c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:54.447936 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7d9c1-4d1f-49be-aa7a-87db9b69a829 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:54.448979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5501d-7314-4818-a588-3776427785c6 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:54.453269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245f004-a621-444d-a820-7217fb8b98c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:54.454661 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245f004-a621-444d-a820-7217fb8b98c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:54.455049 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245f004-a621-444d-a820-7217fb8b98c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:54.455465 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245f004-a621-444d-a820-7217fb8b98c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:54.456237 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245f004-a621-444d-a820-7217fb8b98c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:54.458297 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245f004-a621-444d-a820-7217fb8b98c6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:54.461372 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 887/1810] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:54.462195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5501d-7314-4818-a588-3776427785c6 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:54.480894 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5501d-7314-4818-a588-3776427785c6 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:54.489001 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8884e93-87f4-4ce2-8977-ab46628bfd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:54.490116 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8884e93-87f4-4ce2-8977-ab46628bfd88 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:54.491036 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8884e93-87f4-4ce2-8977-ab46628bfd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:54.491385 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8884e93-87f4-4ce2-8977-ab46628bfd88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:54.492126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8884e93-87f4-4ce2-8977-ab46628bfd88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:54.499568 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8884e93-87f4-4ce2-8977-ab46628bfd88 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:54.652538 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 888/1811] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:54 2022] POST /identity/v3/projects => generated 364 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:54.656616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 924/1812] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:54 2022] POST /identity/v3/projects => generated 378 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:54.658562 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8884e93-87f4-4ce2-8977-ab46628bfd88 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:54.658696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245f004-a621-444d-a820-7217fb8b98c6 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:54.761743 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8884e93-87f4-4ce2-8977-ab46628bfd88 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:54.774887 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245f004-a621-444d-a820-7217fb8b98c6 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:54.779384 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:54.785529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647d180-0ae9-46d6-8766-fa86b94be5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:54.789024 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647d180-0ae9-46d6-8766-fa86b94be5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:54.789367 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647d180-0ae9-46d6-8766-fa86b94be5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:54.789746 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647d180-0ae9-46d6-8766-fa86b94be5b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:54.794146 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647d180-0ae9-46d6-8766-fa86b94be5b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:54.798365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647d180-0ae9-46d6-8766-fa86b94be5b7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:54.858812 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b19f2f-3982-42f3-aba9-a43cfe760dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:54.860019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b19f2f-3982-42f3-aba9-a43cfe760dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:54.860375 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b19f2f-3982-42f3-aba9-a43cfe760dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:54.860771 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b19f2f-3982-42f3-aba9-a43cfe760dc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:54.861811 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b19f2f-3982-42f3-aba9-a43cfe760dc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:54.864011 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b19f2f-3982-42f3-aba9-a43cfe760dc5 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:54.899055 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 925/1813] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:54 2022] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:54.907113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647d180-0ae9-46d6-8766-fa86b94be5b7 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:54.917773 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647d180-0ae9-46d6-8766-fa86b94be5b7 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:54.923347 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db1f07-63c8-401b-8115-fa050bb005c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:54.924079 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db1f07-63c8-401b-8115-fa050bb005c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:54.924323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db1f07-63c8-401b-8115-fa050bb005c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:54.924500 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db1f07-63c8-401b-8115-fa050bb005c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:54.925226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db1f07-63c8-401b-8115-fa050bb005c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:54.931986 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db1f07-63c8-401b-8115-fa050bb005c4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:54.944538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 926/1814] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:54 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:54.948641 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db1f07-63c8-401b-8115-fa050bb005c4 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:54.958621 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db1f07-63c8-401b-8115-fa050bb005c4 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:54.964014 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f8df3-a592-41b6-ba4f-fdf4e67a9e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:54.964633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f8df3-a592-41b6-ba4f-fdf4e67a9e9c admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:54.965266 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f8df3-a592-41b6-ba4f-fdf4e67a9e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:54.965266 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f8df3-a592-41b6-ba4f-fdf4e67a9e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:54.966014 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f8df3-a592-41b6-ba4f-fdf4e67a9e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:54.967900 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f8df3-a592-41b6-ba4f-fdf4e67a9e9c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:54.979526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 927/1815] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:54 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:54.984880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f8df3-a592-41b6-ba4f-fdf4e67a9e9c admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:54.990678 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 889/1816] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:54 2022] POST /identity/v3/users => generated 283 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:54.994838 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b19f2f-3982-42f3-aba9-a43cfe760dc5 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:54.998521 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f8df3-a592-41b6-ba4f-fdf4e67a9e9c admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:55.004023 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a6dca-73ce-4ac8-9bd7-47cc0a6c32f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:55.004791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a6dca-73ce-4ac8-9bd7-47cc0a6c32f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:55.005082 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a6dca-73ce-4ac8-9bd7-47cc0a6c32f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:55.005360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a6dca-73ce-4ac8-9bd7-47cc0a6c32f4 admin admin] PATH_INFO: `/v3/projects/6b2069f7bd6d45418bdd54208531ef4c/users/b6ce27d87bd34c89ac67a7edc124c797/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:55.020322 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b19f2f-3982-42f3-aba9-a43cfe760dc5 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:55.024192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a6dca-73ce-4ac8-9bd7-47cc0a6c32f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2069f7bd6d45418bdd54208531ef4c, user_id=b6ce27d87bd34c89ac67a7edc124c797, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:55.028112 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a6dca-73ce-4ac8-9bd7-47cc0a6c32f4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:55.030157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59faf901-6389-4318-8f26-f1e283b316c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:55.031651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59faf901-6389-4318-8f26-f1e283b316c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:55.031942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59faf901-6389-4318-8f26-f1e283b316c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:55.032825 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59faf901-6389-4318-8f26-f1e283b316c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:55.033715 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59faf901-6389-4318-8f26-f1e283b316c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:55.035568 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59faf901-6389-4318-8f26-f1e283b316c4 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:55.051266 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 890/1817] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:54 2022] GET /identity/v3/roles => generated 1427 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:55.055930 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59faf901-6389-4318-8f26-f1e283b316c4 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:55.071083 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59faf901-6389-4318-8f26-f1e283b316c4 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:55.076483 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713a97b-161b-4d17-8fec-729198c4eee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:55.076842 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713a97b-161b-4d17-8fec-729198c4eee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:55.077206 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713a97b-161b-4d17-8fec-729198c4eee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:55.077556 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713a97b-161b-4d17-8fec-729198c4eee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:55.078336 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713a97b-161b-4d17-8fec-729198c4eee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:55.080099 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713a97b-161b-4d17-8fec-729198c4eee3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:55.096861 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 891/1818] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:55 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:55.096861 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713a97b-161b-4d17-8fec-729198c4eee3 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:55.101317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 928/1819] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:54 2022] PUT /identity/v3/projects/6b2069f7bd6d45418bdd54208531ef4c/users/b6ce27d87bd34c89ac67a7edc124c797/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:23:55.101448 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7713a97b-161b-4d17-8fec-729198c4eee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:55.111340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a6dca-73ce-4ac8-9bd7-47cc0a6c32f4 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:55.114917 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713a97b-161b-4d17-8fec-729198c4eee3 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:55.181107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd948a0f-00bf-407d-ba84-38fcdcdae7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:55.181865 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd948a0f-00bf-407d-ba84-38fcdcdae7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:55.182306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd948a0f-00bf-407d-ba84-38fcdcdae7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:55.182586 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd948a0f-00bf-407d-ba84-38fcdcdae7c6 admin admin] PATH_INFO: `/v3/projects/04496afb723f491daa387c7c23056e34` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:55.184043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd948a0f-00bf-407d-ba84-38fcdcdae7c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04496afb723f491daa387c7c23056e34)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:55.188859 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd948a0f-00bf-407d-ba84-38fcdcdae7c6 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:55.195887 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a6dca-73ce-4ac8-9bd7-47cc0a6c32f4 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:55.202944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59883d9f-58e5-437b-ae0b-eade934d4a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:55.203839 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59883d9f-58e5-437b-ae0b-eade934d4a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:55.204269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59883d9f-58e5-437b-ae0b-eade934d4a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:55.204728 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59883d9f-58e5-437b-ae0b-eade934d4a7a admin admin] PATH_INFO: `/v3/projects/0deb9876e1474118ad983d31780f715c/users/1447b524732c4a70ba661a92f433731c/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:55.221281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59883d9f-58e5-437b-ae0b-eade934d4a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0deb9876e1474118ad983d31780f715c, user_id=1447b524732c4a70ba661a92f433731c, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:55.223954 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59883d9f-58e5-437b-ae0b-eade934d4a7a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:55.296190 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 929/1820] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:55 2022] PUT /identity/v3/projects/0deb9876e1474118ad983d31780f715c/users/1447b524732c4a70ba661a92f433731c/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:55.297598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71c7fb-3c64-43ca-9f22-13ad2e56dd12 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:55.297890 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71c7fb-3c64-43ca-9f22-13ad2e56dd12 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:55.298167 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71c7fb-3c64-43ca-9f22-13ad2e56dd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:55.319703 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cd948a0f-00bf-407d-ba84-38fcdcdae7c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04496afb723f491daa387c7c23056e34', 'request_id': 'req-cd948a0f-00bf-407d-ba84-38fcdcdae7c6'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:55.326540 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cd948a0f-00bf-407d-ba84-38fcdcdae7c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04496afb723f491daa387c7c23056e34', 'request_id': 'req-cd948a0f-00bf-407d-ba84-38fcdcdae7c6'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:55.332597 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-dd71c7fb-3c64-43ca-9f22-13ad2e56dd12 None None] MFA Rules not processed for user `b6ce27d87bd34c89ac67a7edc124c797`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:55.332597 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dd71c7fb-3c64-43ca-9f22-13ad2e56dd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:55.333083 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cd948a0f-00bf-407d-ba84-38fcdcdae7c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04496afb723f491daa387c7c23056e34', 'request_id': 'req-cd948a0f-00bf-407d-ba84-38fcdcdae7c6'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:55.395479 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 930/1821] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:55.397438 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f67b32-8cc9-400e-9102-c4271c204111 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:55.397754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f67b32-8cc9-400e-9102-c4271c204111 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:55.398115 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f67b32-8cc9-400e-9102-c4271c204111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:55.414983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cd948a0f-00bf-407d-ba84-38fcdcdae7c6 admin admin] The token cache is being invalidate because project 04496afb723f491daa387c7c23056e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:23:55.416149 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cd948a0f-00bf-407d-ba84-38fcdcdae7c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:55.417143 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cd948a0f-00bf-407d-ba84-38fcdcdae7c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:55.419613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 892/1822] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:23:55 2022] DELETE /identity/v3/projects/04496afb723f491daa387c7c23056e34 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:55.424583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd948a0f-00bf-407d-ba84-38fcdcdae7c6 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:55.426923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-cd948a0f-00bf-407d-ba84-38fcdcdae7c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:55.447378 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-04f67b32-8cc9-400e-9102-c4271c204111 None None] MFA Rules not processed for user `1447b524732c4a70ba661a92f433731c`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:55.449564 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-04f67b32-8cc9-400e-9102-c4271c204111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:55.522684 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd948a0f-00bf-407d-ba84-38fcdcdae7c6 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:55.527318 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452258bc-4579-4396-a59d-f36c0184d07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:55.527937 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452258bc-4579-4396-a59d-f36c0184d07f admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:55.528216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452258bc-4579-4396-a59d-f36c0184d07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:55.528723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452258bc-4579-4396-a59d-f36c0184d07f admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:55.529216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452258bc-4579-4396-a59d-f36c0184d07f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:55.531116 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452258bc-4579-4396-a59d-f36c0184d07f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:55.537244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 931/1823] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:55.540903 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f67b32-8cc9-400e-9102-c4271c204111 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:55.549559 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-04f67b32-8cc9-400e-9102-c4271c204111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:55.565371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f67b32-8cc9-400e-9102-c4271c204111 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:55.570731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c9160-fca0-4b7a-92bd-d873f76e2f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:55.571395 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c9160-fca0-4b7a-92bd-d873f76e2f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:55.571678 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c9160-fca0-4b7a-92bd-d873f76e2f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:55.571951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c9160-fca0-4b7a-92bd-d873f76e2f76 admin admin] PATH_INFO: `/v3/users/661a50f8f6f04e0aac70a61a8a54d457` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:55.573173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c9160-fca0-4b7a-92bd-d873f76e2f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=661a50f8f6f04e0aac70a61a8a54d457)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:55.575161 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c9160-fca0-4b7a-92bd-d873f76e2f76 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:55.622406 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 893/1824] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:55 2022] POST /identity/v3/projects => generated 380 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:55.622406 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452258bc-4579-4396-a59d-f36c0184d07f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:55.624221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-452258bc-4579-4396-a59d-f36c0184d07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:55.692986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452258bc-4579-4396-a59d-f36c0184d07f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:55.700183 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97b939-224d-46fe-a904-00d86678a242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:55.700880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97b939-224d-46fe-a904-00d86678a242 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:55.701166 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97b939-224d-46fe-a904-00d86678a242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:55.701439 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97b939-224d-46fe-a904-00d86678a242 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:55.702108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97b939-224d-46fe-a904-00d86678a242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:55.704111 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97b939-224d-46fe-a904-00d86678a242 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:55.835589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 894/1825] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:55 2022] POST /identity/v3/projects => generated 366 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:55.836767 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97b939-224d-46fe-a904-00d86678a242 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:55.852203 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ba1c9160-fca0-4b7a-92bd-d873f76e2f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '661a50f8f6f04e0aac70a61a8a54d457'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:55.852763 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ba1c9160-fca0-4b7a-92bd-d873f76e2f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '661a50f8f6f04e0aac70a61a8a54d457'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:55.931709 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97b939-224d-46fe-a904-00d86678a242 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:55.941253 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8654ff-3370-4c33-a2fa-f5f9c2bab368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:55.941414 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8654ff-3370-4c33-a2fa-f5f9c2bab368 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:55.942423 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8654ff-3370-4c33-a2fa-f5f9c2bab368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:55.942423 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8654ff-3370-4c33-a2fa-f5f9c2bab368 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:55.942614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8654ff-3370-4c33-a2fa-f5f9c2bab368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:55.945992 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8654ff-3370-4c33-a2fa-f5f9c2bab368 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:55.977286 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ba1c9160-fca0-4b7a-92bd-d873f76e2f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '661a50f8f6f04e0aac70a61a8a54d457'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:55.996332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ba1c9160-fca0-4b7a-92bd-d873f76e2f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '661a50f8f6f04e0aac70a61a8a54d457'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:55.999657 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ba1c9160-fca0-4b7a-92bd-d873f76e2f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '661a50f8f6f04e0aac70a61a8a54d457'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:56.017309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 932/1826] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:23:55 2022] DELETE /identity/v3/users/661a50f8f6f04e0aac70a61a8a54d457 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:56.017309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c9160-fca0-4b7a-92bd-d873f76e2f76 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:56.034812 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ba1c9160-fca0-4b7a-92bd-d873f76e2f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:56.063005 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 895/1827] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:55 2022] POST /identity/v3/users => generated 291 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:56.066077 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8654ff-3370-4c33-a2fa-f5f9c2bab368 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:56.069024 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ce8654ff-3370-4c33-a2fa-f5f9c2bab368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:56.104049 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8654ff-3370-4c33-a2fa-f5f9c2bab368 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:56.187256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c9160-fca0-4b7a-92bd-d873f76e2f76 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:56.192743 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808b401-9e58-484c-8f2e-4830fa0018c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:56.193977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808b401-9e58-484c-8f2e-4830fa0018c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:56.196932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808b401-9e58-484c-8f2e-4830fa0018c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:56.198287 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808b401-9e58-484c-8f2e-4830fa0018c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:56.199438 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808b401-9e58-484c-8f2e-4830fa0018c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:56.201836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808b401-9e58-484c-8f2e-4830fa0018c8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:56.203550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20d13c-f383-4dd3-8a56-369a8c3a7bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:56.204228 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20d13c-f383-4dd3-8a56-369a8c3a7bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:56.204481 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20d13c-f383-4dd3-8a56-369a8c3a7bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:56.208894 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20d13c-f383-4dd3-8a56-369a8c3a7bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:56.208894 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20d13c-f383-4dd3-8a56-369a8c3a7bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:56.208894 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20d13c-f383-4dd3-8a56-369a8c3a7bc8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:56.228108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 896/1828] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:56 2022] GET /identity/v3/roles => generated 1427 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:23:56.233947 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20d13c-f383-4dd3-8a56-369a8c3a7bc8 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:56.246716 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20d13c-f383-4dd3-8a56-369a8c3a7bc8 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:56.251845 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f24d1-d624-4a86-b4ff-5e021a43e995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:56.252692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f24d1-d624-4a86-b4ff-5e021a43e995 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:56.253315 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f24d1-d624-4a86-b4ff-5e021a43e995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:56.253474 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f24d1-d624-4a86-b4ff-5e021a43e995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:56.254280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f24d1-d624-4a86-b4ff-5e021a43e995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:56.256312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f24d1-d624-4a86-b4ff-5e021a43e995 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:56.269544 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 897/1829] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:56 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:56.274072 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f24d1-d624-4a86-b4ff-5e021a43e995 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:56.287493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f24d1-d624-4a86-b4ff-5e021a43e995 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:56.294141 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045902c3-521d-48a5-ad61-1002562f29ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:56.295033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045902c3-521d-48a5-ad61-1002562f29ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:56.295364 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 933/1830] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:56 2022] POST /identity/v3/users => generated 290 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:56.295484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045902c3-521d-48a5-ad61-1002562f29ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:56.295656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045902c3-521d-48a5-ad61-1002562f29ae admin admin] PATH_INFO: `/v3/projects/302589d0f4fc43fda6237ba460093225/users/d128d5b6cfc6415d9ebce9ef2538d10c/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:56.296518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808b401-9e58-484c-8f2e-4830fa0018c8 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:56.308458 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808b401-9e58-484c-8f2e-4830fa0018c8 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:56.314480 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa74890-d0c3-4287-b422-e09b32bc9223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:56.315506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa74890-d0c3-4287-b422-e09b32bc9223 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:56.315801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa74890-d0c3-4287-b422-e09b32bc9223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:56.316265 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa74890-d0c3-4287-b422-e09b32bc9223 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:56.317339 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa74890-d0c3-4287-b422-e09b32bc9223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:56.318718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045902c3-521d-48a5-ad61-1002562f29ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=302589d0f4fc43fda6237ba460093225, user_id=d128d5b6cfc6415d9ebce9ef2538d10c, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:56.319150 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa74890-d0c3-4287-b422-e09b32bc9223 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:56.321473 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045902c3-521d-48a5-ad61-1002562f29ae admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:56.330714 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 934/1831] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:56 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:56.335354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa74890-d0c3-4287-b422-e09b32bc9223 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:56.346102 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa74890-d0c3-4287-b422-e09b32bc9223 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:56.351447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97e5cd-83ca-41eb-b6bd-b0adf143636b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:56.352112 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e5cd-83ca-41eb-b6bd-b0adf143636b admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:56.352379 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e5cd-83ca-41eb-b6bd-b0adf143636b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:56.352650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e5cd-83ca-41eb-b6bd-b0adf143636b admin admin] PATH_INFO: `/v3/projects/3d9a0957f6b04c73a3dbff097de312b3/users/0dc95d93f4c1445a92e3a7cc606f1b10/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:56.375328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97e5cd-83ca-41eb-b6bd-b0adf143636b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9a0957f6b04c73a3dbff097de312b3, user_id=0dc95d93f4c1445a92e3a7cc606f1b10, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:56.379059 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97e5cd-83ca-41eb-b6bd-b0adf143636b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:56.480753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 898/1832] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:56 2022] PUT /identity/v3/projects/302589d0f4fc43fda6237ba460093225/users/d128d5b6cfc6415d9ebce9ef2538d10c/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:23:56.490750 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734f339-9d25-447f-88db-46f6a2869a7f None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:56.491037 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734f339-9d25-447f-88db-46f6a2869a7f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:56.491288 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734f339-9d25-447f-88db-46f6a2869a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:56.504619 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:56.513599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 935/1833] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:56 2022] PUT /identity/v3/projects/3d9a0957f6b04c73a3dbff097de312b3/users/0dc95d93f4c1445a92e3a7cc606f1b10/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:23:56.517583 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97e5cd-83ca-41eb-b6bd-b0adf143636b admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:56.530069 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d734f339-9d25-447f-88db-46f6a2869a7f None None] MFA Rules not processed for user `d128d5b6cfc6415d9ebce9ef2538d10c`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:56.531678 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d734f339-9d25-447f-88db-46f6a2869a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:56.620376 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97e5cd-83ca-41eb-b6bd-b0adf143636b admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:56.626087 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d53f9a-91c9-4475-b191-98b516db2e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:56.626725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d53f9a-91c9-4475-b191-98b516db2e4f admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:56.627052 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d53f9a-91c9-4475-b191-98b516db2e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:56.627333 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d53f9a-91c9-4475-b191-98b516db2e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:56.628032 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d53f9a-91c9-4475-b191-98b516db2e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:56.629826 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d53f9a-91c9-4475-b191-98b516db2e4f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:56.630513 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 899/1834] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:23:56.635744 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734f339-9d25-447f-88db-46f6a2869a7f None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:56.649020 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734f339-9d25-447f-88db-46f6a2869a7f None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:56.658260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf3d61-539d-4b4b-b21d-218a4e62516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:56.658956 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf3d61-539d-4b4b-b21d-218a4e62516a admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:56.659240 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf3d61-539d-4b4b-b21d-218a4e62516a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:56.659564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf3d61-539d-4b4b-b21d-218a4e62516a admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:56.660248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf3d61-539d-4b4b-b21d-218a4e62516a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:56.665231 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf3d61-539d-4b4b-b21d-218a4e62516a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:56.669237 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 936/1835] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:56 2022] GET /identity/v3/roles => generated 1427 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:23:56.673693 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d53f9a-91c9-4475-b191-98b516db2e4f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:56.689157 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d53f9a-91c9-4475-b191-98b516db2e4f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:56.695589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce17f72-b088-4980-852c-fe16142d1175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:56.696342 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce17f72-b088-4980-852c-fe16142d1175 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:56.696626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce17f72-b088-4980-852c-fe16142d1175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:56.696987 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce17f72-b088-4980-852c-fe16142d1175 admin admin] PATH_INFO: `/v3/projects/3d9a0957f6b04c73a3dbff097de312b3/users/0dc95d93f4c1445a92e3a7cc606f1b10/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:56.700210 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce17f72-b088-4980-852c-fe16142d1175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9a0957f6b04c73a3dbff097de312b3, user_id=0dc95d93f4c1445a92e3a7cc606f1b10, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:56.703250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce17f72-b088-4980-852c-fe16142d1175 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:56.722520 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 937/1836] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:56 2022] PUT /identity/v3/projects/3d9a0957f6b04c73a3dbff097de312b3/users/0dc95d93f4c1445a92e3a7cc606f1b10/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:56.736243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bbc91-d592-45fd-8a58-a64c1fe0a344 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:56.737852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bbc91-d592-45fd-8a58-a64c1fe0a344 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:56.737852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bbc91-d592-45fd-8a58-a64c1fe0a344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:56.773924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-305bbc91-d592-45fd-8a58-a64c1fe0a344 None None] MFA Rules not processed for user `0dc95d93f4c1445a92e3a7cc606f1b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:56.775333 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-305bbc91-d592-45fd-8a58-a64c1fe0a344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:56.801794 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 900/1837] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:56 2022] POST /identity/v3/projects => generated 380 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:56.807929 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf3d61-539d-4b4b-b21d-218a4e62516a admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:56.928370 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 938/1838] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:56.928370 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bbc91-d592-45fd-8a58-a64c1fe0a344 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:56.928370 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-305bbc91-d592-45fd-8a58-a64c1fe0a344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:56.939251 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf3d61-539d-4b4b-b21d-218a4e62516a admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:56.939730 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:56.946837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66669a-da1f-4d7a-b25c-e7b9d0f5f798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:56.947635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66669a-da1f-4d7a-b25c-e7b9d0f5f798 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:56.947916 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66669a-da1f-4d7a-b25c-e7b9d0f5f798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:56.948213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66669a-da1f-4d7a-b25c-e7b9d0f5f798 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:56.949334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66669a-da1f-4d7a-b25c-e7b9d0f5f798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:56.951429 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66669a-da1f-4d7a-b25c-e7b9d0f5f798 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:57.005304 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bbc91-d592-45fd-8a58-a64c1fe0a344 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:57.011658 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382032e-c2e1-404d-8877-2c2b2054724d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:57.012306 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382032e-c2e1-404d-8877-2c2b2054724d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:57.012588 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382032e-c2e1-404d-8877-2c2b2054724d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:57.012909 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382032e-c2e1-404d-8877-2c2b2054724d admin admin] PATH_INFO: `/v3/projects/a0801b8dca2e43e782b97ae9c8a3e067` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:57.014116 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382032e-c2e1-404d-8877-2c2b2054724d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0801b8dca2e43e782b97ae9c8a3e067)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:57.016034 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382032e-c2e1-404d-8877-2c2b2054724d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:57.070133 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 901/1839] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:56 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:57.070133 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66669a-da1f-4d7a-b25c-e7b9d0f5f798 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:57.070423 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1b66669a-da1f-4d7a-b25c-e7b9d0f5f798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:57.145747 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66669a-da1f-4d7a-b25c-e7b9d0f5f798 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:57.150660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fabed-bf40-4725-9339-aa722724451e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:57.152066 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fabed-bf40-4725-9339-aa722724451e service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:57.152287 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fabed-bf40-4725-9339-aa722724451e service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:57.152984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fabed-bf40-4725-9339-aa722724451e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:57.169265 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6382032e-c2e1-404d-8877-2c2b2054724d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0801b8dca2e43e782b97ae9c8a3e067', 'request_id': 'req-6382032e-c2e1-404d-8877-2c2b2054724d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:57.178086 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6382032e-c2e1-404d-8877-2c2b2054724d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0801b8dca2e43e782b97ae9c8a3e067', 'request_id': 'req-6382032e-c2e1-404d-8877-2c2b2054724d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:57.192712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6382032e-c2e1-404d-8877-2c2b2054724d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0801b8dca2e43e782b97ae9c8a3e067', 'request_id': 'req-6382032e-c2e1-404d-8877-2c2b2054724d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:57.234168 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fabed-bf40-4725-9339-aa722724451e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:57.235656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fabed-bf40-4725-9339-aa722724451e service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:57.245769 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 902/1840] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:57.246896 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef379b60-8043-4040-bc40-9ae3b6203b6d None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:57.247180 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef379b60-8043-4040-bc40-9ae3b6203b6d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:57.247456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef379b60-8043-4040-bc40-9ae3b6203b6d None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:57.248703 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 903/1841] 10.222.0.141 () {54 vars in 926 bytes} [Tue Jul 26 16:23:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:23:57.249382 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef379b60-8043-4040-bc40-9ae3b6203b6d None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:57.299783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6382032e-c2e1-404d-8877-2c2b2054724d admin admin] The token cache is being invalidate because project a0801b8dca2e43e782b97ae9c8a3e067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:23:57.300315 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6382032e-c2e1-404d-8877-2c2b2054724d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:57.301106 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6382032e-c2e1-404d-8877-2c2b2054724d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:57.306983 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 939/1842] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:23:56 2022] DELETE /identity/v3/projects/a0801b8dca2e43e782b97ae9c8a3e067 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:57.306983 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d6044-64ae-4e8b-893f-4d810967db64 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:57.306983 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d6044-64ae-4e8b-893f-4d810967db64 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:57.306983 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d6044-64ae-4e8b-893f-4d810967db64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:57.320604 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef379b60-8043-4040-bc40-9ae3b6203b6d None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:57.326545 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104febe1-0206-47b5-8964-e763b6faabae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:57.327057 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104febe1-0206-47b5-8964-e763b6faabae admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:57.327459 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104febe1-0206-47b5-8964-e763b6faabae admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:57.327802 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104febe1-0206-47b5-8964-e763b6faabae admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:57.328583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104febe1-0206-47b5-8964-e763b6faabae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:57.330171 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-e26d6044-64ae-4e8b-893f-4d810967db64 None None] MFA Rules not processed for user `f7eac931cabf4921b6dbd42f63b9300f`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:57.330438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104febe1-0206-47b5-8964-e763b6faabae admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:57.331468 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e26d6044-64ae-4e8b-893f-4d810967db64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:57.341520 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 904/1843] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:57 2022] GET /identity/v3/roles => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:57.342785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ecb22-775c-458d-b8cf-88d08c956c84 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:57.343076 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ecb22-775c-458d-b8cf-88d08c956c84 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:57.343351 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ecb22-775c-458d-b8cf-88d08c956c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:57.375561 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-955ecb22-775c-458d-b8cf-88d08c956c84 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:57.378816 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-955ecb22-775c-458d-b8cf-88d08c956c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:57.395085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 905/1844] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:57.395951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ecb22-775c-458d-b8cf-88d08c956c84 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:57.397508 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-955ecb22-775c-458d-b8cf-88d08c956c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:57.410559 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ecb22-775c-458d-b8cf-88d08c956c84 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:57.415538 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dcb89-0127-45c2-b13d-c3b325796de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:57.416237 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dcb89-0127-45c2-b13d-c3b325796de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:57.416859 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dcb89-0127-45c2-b13d-c3b325796de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:57.416859 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dcb89-0127-45c2-b13d-c3b325796de5 admin admin] PATH_INFO: `/v3/projects/60cb17ef2fbc456eb1481c8d6aa445a4/users/74614c884d074ddd9d5b66126c203ee6/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:57.438722 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dcb89-0127-45c2-b13d-c3b325796de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60cb17ef2fbc456eb1481c8d6aa445a4, user_id=74614c884d074ddd9d5b66126c203ee6, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:57.441460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dcb89-0127-45c2-b13d-c3b325796de5 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:57.450184 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 940/1845] 10.222.0.141 () {58 vars in 1023 bytes} [Tue Jul 26 16:23:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:57.454747 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d692f-c488-4acb-b2bd-6065835353c5 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:57.454747 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d692f-c488-4acb-b2bd-6065835353c5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:57.454747 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d692f-c488-4acb-b2bd-6065835353c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:57.473387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c44d692f-c488-4acb-b2bd-6065835353c5 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:57.475303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c44d692f-c488-4acb-b2bd-6065835353c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:57.485978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 941/1846] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:57.486914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d692f-c488-4acb-b2bd-6065835353c5 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:57.490675 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c44d692f-c488-4acb-b2bd-6065835353c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:57.505972 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d692f-c488-4acb-b2bd-6065835353c5 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:57.512492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cb213-7dd0-4030-bfc8-a9861b695dc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:57.512492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cb213-7dd0-4030-bfc8-a9861b695dc7 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:57.512873 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cb213-7dd0-4030-bfc8-a9861b695dc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:57.513241 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cb213-7dd0-4030-bfc8-a9861b695dc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:57.535598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cb213-7dd0-4030-bfc8-a9861b695dc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:57.537747 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cb213-7dd0-4030-bfc8-a9861b695dc7 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:57.551557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 942/1847] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:57.552405 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cb213-7dd0-4030-bfc8-a9861b695dc7 service nova] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:57.565360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cb213-7dd0-4030-bfc8-a9861b695dc7 service nova] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:57.570240 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6ab6e-6977-4cf6-915f-60fa7e3e44c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:57.570866 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6ab6e-6977-4cf6-915f-60fa7e3e44c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:57.571145 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6ab6e-6977-4cf6-915f-60fa7e3e44c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:57.571416 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6ab6e-6977-4cf6-915f-60fa7e3e44c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:57.572113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6ab6e-6977-4cf6-915f-60fa7e3e44c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:23:57.572501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6ab6e-6977-4cf6-915f-60fa7e3e44c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:57.574703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6ab6e-6977-4cf6-915f-60fa7e3e44c5 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:57.590795 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 943/1848] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:23:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:23:57.591798 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6ab6e-6977-4cf6-915f-60fa7e3e44c5 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:57.597480 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-14f6ab6e-6977-4cf6-915f-60fa7e3e44c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:57.610075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 906/1849] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:57 2022] PUT /identity/v3/projects/60cb17ef2fbc456eb1481c8d6aa445a4/users/74614c884d074ddd9d5b66126c203ee6/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:57.615756 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dcb89-0127-45c2-b13d-c3b325796de5 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:57.671717 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6ab6e-6977-4cf6-915f-60fa7e3e44c5 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:57.742615 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dcb89-0127-45c2-b13d-c3b325796de5 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:57.749367 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e375b-65ec-4816-af06-e4a9a32ca51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:57.749999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e375b-65ec-4816-af06-e4a9a32ca51b admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:57.750280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e375b-65ec-4816-af06-e4a9a32ca51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:57.750553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e375b-65ec-4816-af06-e4a9a32ca51b admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:57.751713 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e375b-65ec-4816-af06-e4a9a32ca51b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:57.753656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e375b-65ec-4816-af06-e4a9a32ca51b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:57.771966 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bddaf1d-7928-469c-9e3b-6980f23d94f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:57.771966 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddaf1d-7928-469c-9e3b-6980f23d94f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:57.771966 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddaf1d-7928-469c-9e3b-6980f23d94f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:57.771966 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddaf1d-7928-469c-9e3b-6980f23d94f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:57.773264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0bddaf1d-7928-469c-9e3b-6980f23d94f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:57.860431 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bddaf1d-7928-469c-9e3b-6980f23d94f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:57.862236 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bddaf1d-7928-469c-9e3b-6980f23d94f3 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:57.872021 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 944/1850] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:57.872868 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bddaf1d-7928-469c-9e3b-6980f23d94f3 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:57.880539 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 907/1851] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:23:57 2022] POST /identity/v3/projects => generated 376 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:57.885101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e375b-65ec-4816-af06-e4a9a32ca51b admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:57.885233 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bddaf1d-7928-469c-9e3b-6980f23d94f3 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:57.982101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e375b-65ec-4816-af06-e4a9a32ca51b admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:57.989853 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b1c91-2ed3-468c-a968-b6c477c21602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:57.990497 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b1c91-2ed3-468c-a968-b6c477c21602 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:57.990882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b1c91-2ed3-468c-a968-b6c477c21602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:57.991177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b1c91-2ed3-468c-a968-b6c477c21602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:57.991909 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b1c91-2ed3-468c-a968-b6c477c21602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:57.993672 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b1c91-2ed3-468c-a968-b6c477c21602 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:57.997322 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2eefbd-cbdb-4fd5-b607-71825e3cc158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:57.998136 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eefbd-cbdb-4fd5-b607-71825e3cc158 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:57.998583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eefbd-cbdb-4fd5-b607-71825e3cc158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:57.998999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eefbd-cbdb-4fd5-b607-71825e3cc158 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:57.999882 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2eefbd-cbdb-4fd5-b607-71825e3cc158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:58.002097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2eefbd-cbdb-4fd5-b607-71825e3cc158 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:58.004022 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 945/1852] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:57 2022] GET /identity/v3/roles => generated 1427 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:58.008211 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b1c91-2ed3-468c-a968-b6c477c21602 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:58.019289 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b1c91-2ed3-468c-a968-b6c477c21602 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:58.024606 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a5409-da85-4f18-9d24-12f533b67971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:58.025240 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a5409-da85-4f18-9d24-12f533b67971 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:58.025524 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a5409-da85-4f18-9d24-12f533b67971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:58.025801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a5409-da85-4f18-9d24-12f533b67971 admin admin] PATH_INFO: `/v3/projects/60cb17ef2fbc456eb1481c8d6aa445a4/users/74614c884d074ddd9d5b66126c203ee6/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:58.027735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a5409-da85-4f18-9d24-12f533b67971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60cb17ef2fbc456eb1481c8d6aa445a4, user_id=74614c884d074ddd9d5b66126c203ee6, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:58.030444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a5409-da85-4f18-9d24-12f533b67971 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:58.041787 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 946/1853] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:58 2022] PUT /identity/v3/projects/60cb17ef2fbc456eb1481c8d6aa445a4/users/74614c884d074ddd9d5b66126c203ee6/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:58.053621 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373b2c8-5b25-4b09-879c-fad6fb3d9667 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:58.053915 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373b2c8-5b25-4b09-879c-fad6fb3d9667 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:58.054198 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373b2c8-5b25-4b09-879c-fad6fb3d9667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:58.083408 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-b373b2c8-5b25-4b09-879c-fad6fb3d9667 None None] MFA Rules not processed for user `74614c884d074ddd9d5b66126c203ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:58.085216 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b373b2c8-5b25-4b09-879c-fad6fb3d9667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:58.103838 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 908/1854] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:23:57 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:23:58.108060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2eefbd-cbdb-4fd5-b607-71825e3cc158 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:58.118899 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2eefbd-cbdb-4fd5-b607-71825e3cc158 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:58.166692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 947/1855] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:23:58.196654 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485340e-a056-49ba-a453-bd6f943d15bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:58.197306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485340e-a056-49ba-a453-bd6f943d15bd admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:58.197594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485340e-a056-49ba-a453-bd6f943d15bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:58.197869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485340e-a056-49ba-a453-bd6f943d15bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:58.198564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485340e-a056-49ba-a453-bd6f943d15bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:58.200195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485340e-a056-49ba-a453-bd6f943d15bd admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:58.212060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 909/1856] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:58 2022] GET /identity/v3/roles => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:23:58.216543 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373b2c8-5b25-4b09-879c-fad6fb3d9667 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:58.230298 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373b2c8-5b25-4b09-879c-fad6fb3d9667 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:58.235745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9c32f-5de9-414a-a8cf-48f082676a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:58.236490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9c32f-5de9-414a-a8cf-48f082676a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:58.240226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9c32f-5de9-414a-a8cf-48f082676a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:58.240226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9c32f-5de9-414a-a8cf-48f082676a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:58.240226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9c32f-5de9-414a-a8cf-48f082676a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:58.240226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9c32f-5de9-414a-a8cf-48f082676a91 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:58.255083 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 948/1857] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:23:58 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:23:58.257523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485340e-a056-49ba-a453-bd6f943d15bd admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:58.273524 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485340e-a056-49ba-a453-bd6f943d15bd admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:58.281091 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20115a-d747-4bd1-8e1c-7c57a93828fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:58.284306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20115a-d747-4bd1-8e1c-7c57a93828fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:58.284936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20115a-d747-4bd1-8e1c-7c57a93828fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:58.285497 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20115a-d747-4bd1-8e1c-7c57a93828fe admin admin] PATH_INFO: `/v3/projects/e3ed6df036c24225be9bb00dc1ed9bbf/users/00110f2898d64ccd8ff0b6090637b013/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:58.321464 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9c32f-5de9-414a-a8cf-48f082676a91 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:58.326387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-70c9c32f-5de9-414a-a8cf-48f082676a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:58.330668 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20115a-d747-4bd1-8e1c-7c57a93828fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ed6df036c24225be9bb00dc1ed9bbf, user_id=00110f2898d64ccd8ff0b6090637b013, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:58.335570 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20115a-d747-4bd1-8e1c-7c57a93828fe admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:58.448127 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 910/1858] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:23:58 2022] PUT /identity/v3/projects/e3ed6df036c24225be9bb00dc1ed9bbf/users/00110f2898d64ccd8ff0b6090637b013/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:23:58.458525 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c1d85-0624-4475-948b-d8205b58d6df None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:58.459482 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c1d85-0624-4475-948b-d8205b58d6df None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:58.459671 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c1d85-0624-4475-948b-d8205b58d6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:58.462030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9c32f-5de9-414a-a8cf-48f082676a91 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:58.502316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d70c1d85-0624-4475-948b-d8205b58d6df None None] MFA Rules not processed for user `00110f2898d64ccd8ff0b6090637b013`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:23:58.503757 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d70c1d85-0624-4475-948b-d8205b58d6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:58.589501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae169b19-894d-4cbc-8c1c-8d9004b2caa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:58.590451 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae169b19-894d-4cbc-8c1c-8d9004b2caa2 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:58.590905 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae169b19-894d-4cbc-8c1c-8d9004b2caa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:58.591517 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae169b19-894d-4cbc-8c1c-8d9004b2caa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:58.594364 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 911/1859] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:23:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:23:58.602902 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:58.681730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae169b19-894d-4cbc-8c1c-8d9004b2caa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:58.683558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae169b19-894d-4cbc-8c1c-8d9004b2caa2 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:58.694961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 949/1860] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:58.849189 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c1d85-0624-4475-948b-d8205b58d6df None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:58.859810 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c1d85-0624-4475-948b-d8205b58d6df None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:58.864428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f924b6-a002-4cd9-b8d8-547a5e4e92e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:58.867258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f924b6-a002-4cd9-b8d8-547a5e4e92e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:58.867549 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f924b6-a002-4cd9-b8d8-547a5e4e92e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:58.868523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f924b6-a002-4cd9-b8d8-547a5e4e92e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:58.877590 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f924b6-a002-4cd9-b8d8-547a5e4e92e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:58.879257 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f924b6-a002-4cd9-b8d8-547a5e4e92e9 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:58.890598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 912/1861] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:59.050812 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:23:59.075422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae169b19-894d-4cbc-8c1c-8d9004b2caa2 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:59.083856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae169b19-894d-4cbc-8c1c-8d9004b2caa2 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:59.087545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f44e0-b657-4f18-b664-0dcf5c018352 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:59.088159 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f44e0-b657-4f18-b664-0dcf5c018352 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:59.088439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f44e0-b657-4f18-b664-0dcf5c018352 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:59.088741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f44e0-b657-4f18-b664-0dcf5c018352 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:59.090488 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d85f44e0-b657-4f18-b664-0dcf5c018352 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:59.152054 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f44e0-b657-4f18-b664-0dcf5c018352 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:59.153605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f44e0-b657-4f18-b664-0dcf5c018352 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:59.163158 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 950/1862] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:23:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:23:59.504050 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f924b6-a002-4cd9-b8d8-547a5e4e92e9 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:23:59.506894 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e2f924b6-a002-4cd9-b8d8-547a5e4e92e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:23:59.597276 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f924b6-a002-4cd9-b8d8-547a5e4e92e9 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:23:59.597692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88532c-05b0-48be-959b-9c6d5bf1efd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:23:59.598365 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88532c-05b0-48be-959b-9c6d5bf1efd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:23:59.598940 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88532c-05b0-48be-959b-9c6d5bf1efd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:23:59.600253 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88532c-05b0-48be-959b-9c6d5bf1efd5 admin admin] PATH_INFO: `/v3/users/109345b07d3a478688bf10dfd9ec1702` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:23:59.601795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88532c-05b0-48be-959b-9c6d5bf1efd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=109345b07d3a478688bf10dfd9ec1702)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:23:59.603916 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88532c-05b0-48be-959b-9c6d5bf1efd5 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:23:59.950450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5d88532c-05b0-48be-959b-9c6d5bf1efd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109345b07d3a478688bf10dfd9ec1702'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:59.951441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5d88532c-05b0-48be-959b-9c6d5bf1efd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109345b07d3a478688bf10dfd9ec1702'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:59.967780 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5d88532c-05b0-48be-959b-9c6d5bf1efd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109345b07d3a478688bf10dfd9ec1702'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:23:59.982282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5d88532c-05b0-48be-959b-9c6d5bf1efd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109345b07d3a478688bf10dfd9ec1702'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:00.099830 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5d88532c-05b0-48be-959b-9c6d5bf1efd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109345b07d3a478688bf10dfd9ec1702'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:00.109550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 913/1863] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:23:59 2022] DELETE /identity/v3/users/109345b07d3a478688bf10dfd9ec1702 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:00.115993 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bc9f5-f15c-421f-8ac1-8c1a8c0be1f3 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:00.116454 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bc9f5-f15c-421f-8ac1-8c1a8c0be1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:00.116566 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bc9f5-f15c-421f-8ac1-8c1a8c0be1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:00.140765 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d39bc9f5-f15c-421f-8ac1-8c1a8c0be1f3 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:00.142934 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d39bc9f5-f15c-421f-8ac1-8c1a8c0be1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:00.216446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 951/1864] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:00.236823 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88532c-05b0-48be-959b-9c6d5bf1efd5 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:00.238239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5d88532c-05b0-48be-959b-9c6d5bf1efd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:00.301283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88532c-05b0-48be-959b-9c6d5bf1efd5 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:00.305748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac425b-eca5-4526-97f4-02905e239355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:00.306468 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac425b-eca5-4526-97f4-02905e239355 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:00.306754 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac425b-eca5-4526-97f4-02905e239355 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:00.307027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac425b-eca5-4526-97f4-02905e239355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:00.325719 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac425b-eca5-4526-97f4-02905e239355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:00.327436 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac425b-eca5-4526-97f4-02905e239355 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:00.347616 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 914/1865] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:00.655859 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:00.936862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bc9f5-f15c-421f-8ac1-8c1a8c0be1f3 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:00.938315 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d39bc9f5-f15c-421f-8ac1-8c1a8c0be1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:00.960646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bc9f5-f15c-421f-8ac1-8c1a8c0be1f3 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:00.965597 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4464a12-48d3-47a5-8fb0-7ce378aa71e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:00.966387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4464a12-48d3-47a5-8fb0-7ce378aa71e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:00.966899 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4464a12-48d3-47a5-8fb0-7ce378aa71e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:00.967240 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4464a12-48d3-47a5-8fb0-7ce378aa71e2 admin admin] PATH_INFO: `/v3/projects/5980fcbdd1674a15a7de7d57e35c616e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:00.968485 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4464a12-48d3-47a5-8fb0-7ce378aa71e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5980fcbdd1674a15a7de7d57e35c616e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:00.970702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4464a12-48d3-47a5-8fb0-7ce378aa71e2 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:01.125473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a4464a12-48d3-47a5-8fb0-7ce378aa71e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5980fcbdd1674a15a7de7d57e35c616e', 'request_id': 'req-a4464a12-48d3-47a5-8fb0-7ce378aa71e2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:01.131907 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a4464a12-48d3-47a5-8fb0-7ce378aa71e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5980fcbdd1674a15a7de7d57e35c616e', 'request_id': 'req-a4464a12-48d3-47a5-8fb0-7ce378aa71e2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:01.138659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a4464a12-48d3-47a5-8fb0-7ce378aa71e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5980fcbdd1674a15a7de7d57e35c616e', 'request_id': 'req-a4464a12-48d3-47a5-8fb0-7ce378aa71e2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:01.262687 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a4464a12-48d3-47a5-8fb0-7ce378aa71e2 admin admin] The token cache is being invalidate because project 5980fcbdd1674a15a7de7d57e35c616e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:01.263125 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a4464a12-48d3-47a5-8fb0-7ce378aa71e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:01.263892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a4464a12-48d3-47a5-8fb0-7ce378aa71e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:01.266378 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 952/1866] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:00 2022] DELETE /identity/v3/projects/5980fcbdd1674a15a7de7d57e35c616e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:01.270702 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac425b-eca5-4526-97f4-02905e239355 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:01.282950 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac425b-eca5-4526-97f4-02905e239355 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:01.348327 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f075cbb-3114-4931-b3c8-cf3107f5b636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:01.349297 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f075cbb-3114-4931-b3c8-cf3107f5b636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:01.349684 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f075cbb-3114-4931-b3c8-cf3107f5b636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:01.350089 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f075cbb-3114-4931-b3c8-cf3107f5b636 admin admin] PATH_INFO: `/v3/users/fb12379981194a2f883619fdf78d021a` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:01.351459 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f075cbb-3114-4931-b3c8-cf3107f5b636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb12379981194a2f883619fdf78d021a)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:01.353617 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f075cbb-3114-4931-b3c8-cf3107f5b636 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:01.699034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4f075cbb-3114-4931-b3c8-cf3107f5b636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb12379981194a2f883619fdf78d021a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:01.712362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4f075cbb-3114-4931-b3c8-cf3107f5b636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb12379981194a2f883619fdf78d021a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:01.740393 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4f075cbb-3114-4931-b3c8-cf3107f5b636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb12379981194a2f883619fdf78d021a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:01.750077 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4f075cbb-3114-4931-b3c8-cf3107f5b636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb12379981194a2f883619fdf78d021a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:01.844747 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4f075cbb-3114-4931-b3c8-cf3107f5b636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb12379981194a2f883619fdf78d021a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:01.854982 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 915/1867] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:01 2022] DELETE /identity/v3/users/fb12379981194a2f883619fdf78d021a => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:02.075423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4464a12-48d3-47a5-8fb0-7ce378aa71e2 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:02.077325 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a4464a12-48d3-47a5-8fb0-7ce378aa71e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:02.093899 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4464a12-48d3-47a5-8fb0-7ce378aa71e2 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:02.173300 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2435e9d-2fa5-4d13-909d-3d4bd9934ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:02.178512 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2435e9d-2fa5-4d13-909d-3d4bd9934ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:02.178512 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2435e9d-2fa5-4d13-909d-3d4bd9934ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:02.178512 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2435e9d-2fa5-4d13-909d-3d4bd9934ae8 admin admin] PATH_INFO: `/v3/users/1447b524732c4a70ba661a92f433731c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:02.178512 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2435e9d-2fa5-4d13-909d-3d4bd9934ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1447b524732c4a70ba661a92f433731c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:02.178512 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2435e9d-2fa5-4d13-909d-3d4bd9934ae8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:02.401675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f075cbb-3114-4931-b3c8-cf3107f5b636 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:02.403074 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4f075cbb-3114-4931-b3c8-cf3107f5b636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:02.419051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f075cbb-3114-4931-b3c8-cf3107f5b636 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:02.424811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:02.430209 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8b238-1d45-4573-94bf-676dfeeef92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:02.430209 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8b238-1d45-4573-94bf-676dfeeef92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:02.430209 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8b238-1d45-4573-94bf-676dfeeef92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:02.430209 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8b238-1d45-4573-94bf-676dfeeef92c admin admin] PATH_INFO: `/v3/projects/55e497172350425185f6148abd3acf9a` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:02.430759 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8b238-1d45-4573-94bf-676dfeeef92c admin admin] RBAC: Authorizing `identity:delete_project(project_id=55e497172350425185f6148abd3acf9a)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:02.432102 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8b238-1d45-4573-94bf-676dfeeef92c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:02.445930 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f2435e9d-2fa5-4d13-909d-3d4bd9934ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1447b524732c4a70ba661a92f433731c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:02.446716 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f2435e9d-2fa5-4d13-909d-3d4bd9934ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1447b524732c4a70ba661a92f433731c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:02.536287 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f2435e9d-2fa5-4d13-909d-3d4bd9934ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1447b524732c4a70ba661a92f433731c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:02.555807 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f2435e9d-2fa5-4d13-909d-3d4bd9934ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1447b524732c4a70ba661a92f433731c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:02.556541 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f2435e9d-2fa5-4d13-909d-3d4bd9934ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1447b524732c4a70ba661a92f433731c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:02.569396 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 953/1868] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:02 2022] DELETE /identity/v3/users/1447b524732c4a70ba661a92f433731c => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:02.573660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7916193-2f16-4879-af06-ff340acdcd74 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:02.573952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7916193-2f16-4879-af06-ff340acdcd74 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:02.574229 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7916193-2f16-4879-af06-ff340acdcd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:02.593224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-b7916193-2f16-4879-af06-ff340acdcd74 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:02.594420 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b7916193-2f16-4879-af06-ff340acdcd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:02.651584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-91f8b238-1d45-4573-94bf-676dfeeef92c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55e497172350425185f6148abd3acf9a', 'request_id': 'req-91f8b238-1d45-4573-94bf-676dfeeef92c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:02.654593 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 954/1869] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:02.658046 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-91f8b238-1d45-4573-94bf-676dfeeef92c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55e497172350425185f6148abd3acf9a', 'request_id': 'req-91f8b238-1d45-4573-94bf-676dfeeef92c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:02.664585 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-91f8b238-1d45-4573-94bf-676dfeeef92c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55e497172350425185f6148abd3acf9a', 'request_id': 'req-91f8b238-1d45-4573-94bf-676dfeeef92c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:02.665304 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7916193-2f16-4879-af06-ff340acdcd74 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:02.668941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b7916193-2f16-4879-af06-ff340acdcd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:02.724604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7916193-2f16-4879-af06-ff340acdcd74 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:02.777989 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-91f8b238-1d45-4573-94bf-676dfeeef92c admin admin] The token cache is being invalidate because project 55e497172350425185f6148abd3acf9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:02.777989 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-91f8b238-1d45-4573-94bf-676dfeeef92c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:02.778560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-91f8b238-1d45-4573-94bf-676dfeeef92c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:02.779116 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486972c5-45b5-446e-8e36-9f879e69c37f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:02.779751 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486972c5-45b5-446e-8e36-9f879e69c37f service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:02.780057 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486972c5-45b5-446e-8e36-9f879e69c37f service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:02.780342 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486972c5-45b5-446e-8e36-9f879e69c37f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:02.782205 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-486972c5-45b5-446e-8e36-9f879e69c37f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:02.783481 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 916/1870] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:02 2022] DELETE /identity/v3/projects/55e497172350425185f6148abd3acf9a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:02.784383 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8b238-1d45-4573-94bf-676dfeeef92c admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:02.786064 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-91f8b238-1d45-4573-94bf-676dfeeef92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:02.859745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486972c5-45b5-446e-8e36-9f879e69c37f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:02.865715 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486972c5-45b5-446e-8e36-9f879e69c37f service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:02.872091 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8b238-1d45-4573-94bf-676dfeeef92c admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:02.875162 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 955/1871] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:24:02.879074 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d877dee-165f-43a3-8be8-48e87acd5522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:02.880008 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d877dee-165f-43a3-8be8-48e87acd5522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:02.880983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d877dee-165f-43a3-8be8-48e87acd5522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:02.881272 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d877dee-165f-43a3-8be8-48e87acd5522 admin admin] PATH_INFO: `/v3/users/bd5013f9f2264c4688d71559e6576d9a` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:02.883048 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d877dee-165f-43a3-8be8-48e87acd5522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd5013f9f2264c4688d71559e6576d9a)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:02.885371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d877dee-165f-43a3-8be8-48e87acd5522 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:02.913737 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:03.174949 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1d877dee-165f-43a3-8be8-48e87acd5522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd5013f9f2264c4688d71559e6576d9a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:03.175631 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1d877dee-165f-43a3-8be8-48e87acd5522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd5013f9f2264c4688d71559e6576d9a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:03.188647 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1d877dee-165f-43a3-8be8-48e87acd5522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd5013f9f2264c4688d71559e6576d9a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:03.196913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1d877dee-165f-43a3-8be8-48e87acd5522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd5013f9f2264c4688d71559e6576d9a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:03.350385 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1d877dee-165f-43a3-8be8-48e87acd5522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd5013f9f2264c4688d71559e6576d9a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:03.356969 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 917/1872] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:02 2022] DELETE /identity/v3/users/bd5013f9f2264c4688d71559e6576d9a => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:03.391779 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486972c5-45b5-446e-8e36-9f879e69c37f service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:03.393299 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-486972c5-45b5-446e-8e36-9f879e69c37f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:03.415971 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486972c5-45b5-446e-8e36-9f879e69c37f service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:03.486534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc242c4-8c8f-48d7-baaf-936c397807c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:03.487088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc242c4-8c8f-48d7-baaf-936c397807c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:03.487397 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc242c4-8c8f-48d7-baaf-936c397807c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:03.487682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc242c4-8c8f-48d7-baaf-936c397807c8 admin admin] PATH_INFO: `/v3/projects/0deb9876e1474118ad983d31780f715c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:03.489529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc242c4-8c8f-48d7-baaf-936c397807c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0deb9876e1474118ad983d31780f715c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:03.492213 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc242c4-8c8f-48d7-baaf-936c397807c8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:03.597613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4bc242c4-8c8f-48d7-baaf-936c397807c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0deb9876e1474118ad983d31780f715c', 'request_id': 'req-4bc242c4-8c8f-48d7-baaf-936c397807c8'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:03.604499 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4bc242c4-8c8f-48d7-baaf-936c397807c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0deb9876e1474118ad983d31780f715c', 'request_id': 'req-4bc242c4-8c8f-48d7-baaf-936c397807c8'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:03.610488 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4bc242c4-8c8f-48d7-baaf-936c397807c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0deb9876e1474118ad983d31780f715c', 'request_id': 'req-4bc242c4-8c8f-48d7-baaf-936c397807c8'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:03.711132 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4bc242c4-8c8f-48d7-baaf-936c397807c8 admin admin] The token cache is being invalidate because project 0deb9876e1474118ad983d31780f715c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:03.711132 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4bc242c4-8c8f-48d7-baaf-936c397807c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:03.712010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4bc242c4-8c8f-48d7-baaf-936c397807c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:03.713913 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 956/1873] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:03 2022] DELETE /identity/v3/projects/0deb9876e1474118ad983d31780f715c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:03.717472 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d877dee-165f-43a3-8be8-48e87acd5522 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:03.719035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1d877dee-165f-43a3-8be8-48e87acd5522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:03.732983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d877dee-165f-43a3-8be8-48e87acd5522 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:03.792964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563675d-38ab-4576-95b7-8bd1e5b2ada1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:03.794119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563675d-38ab-4576-95b7-8bd1e5b2ada1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:03.794403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563675d-38ab-4576-95b7-8bd1e5b2ada1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:03.794693 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563675d-38ab-4576-95b7-8bd1e5b2ada1 admin admin] PATH_INFO: `/v3/users/0dc95d93f4c1445a92e3a7cc606f1b10` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:03.795834 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563675d-38ab-4576-95b7-8bd1e5b2ada1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc95d93f4c1445a92e3a7cc606f1b10)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:03.797790 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563675d-38ab-4576-95b7-8bd1e5b2ada1 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:03.927190 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc242c4-8c8f-48d7-baaf-936c397807c8 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:03.932712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4bc242c4-8c8f-48d7-baaf-936c397807c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:03.949942 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc242c4-8c8f-48d7-baaf-936c397807c8 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:03.955891 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156fa56-19ae-4bf7-ba7f-f604ce75b371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:03.956528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156fa56-19ae-4bf7-ba7f-f604ce75b371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:03.956894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156fa56-19ae-4bf7-ba7f-f604ce75b371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:03.957112 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156fa56-19ae-4bf7-ba7f-f604ce75b371 admin admin] PATH_INFO: `/v3/projects/5703da96b7764b4e81311f8665941a90` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:03.958253 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156fa56-19ae-4bf7-ba7f-f604ce75b371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5703da96b7764b4e81311f8665941a90)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:03.960844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156fa56-19ae-4bf7-ba7f-f604ce75b371 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:04.033686 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a563675d-38ab-4576-95b7-8bd1e5b2ada1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc95d93f4c1445a92e3a7cc606f1b10'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:04.034936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a563675d-38ab-4576-95b7-8bd1e5b2ada1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc95d93f4c1445a92e3a7cc606f1b10'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:04.049508 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a563675d-38ab-4576-95b7-8bd1e5b2ada1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc95d93f4c1445a92e3a7cc606f1b10'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:04.057042 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a563675d-38ab-4576-95b7-8bd1e5b2ada1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc95d93f4c1445a92e3a7cc606f1b10'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:04.071822 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5156fa56-19ae-4bf7-ba7f-f604ce75b371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5703da96b7764b4e81311f8665941a90', 'request_id': 'req-5156fa56-19ae-4bf7-ba7f-f604ce75b371'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:04.078594 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5156fa56-19ae-4bf7-ba7f-f604ce75b371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5703da96b7764b4e81311f8665941a90', 'request_id': 'req-5156fa56-19ae-4bf7-ba7f-f604ce75b371'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:04.085718 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5156fa56-19ae-4bf7-ba7f-f604ce75b371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5703da96b7764b4e81311f8665941a90', 'request_id': 'req-5156fa56-19ae-4bf7-ba7f-f604ce75b371'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:04.204389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a563675d-38ab-4576-95b7-8bd1e5b2ada1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc95d93f4c1445a92e3a7cc606f1b10'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:04.208138 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:04.214814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 918/1874] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:03 2022] DELETE /identity/v3/users/0dc95d93f4c1445a92e3a7cc606f1b10 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:04.216008 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563675d-38ab-4576-95b7-8bd1e5b2ada1 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:04.217670 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a563675d-38ab-4576-95b7-8bd1e5b2ada1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:04.285607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5156fa56-19ae-4bf7-ba7f-f604ce75b371 admin admin] The token cache is being invalidate because project 5703da96b7764b4e81311f8665941a90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:04.286292 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5156fa56-19ae-4bf7-ba7f-f604ce75b371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:04.287554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5156fa56-19ae-4bf7-ba7f-f604ce75b371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:04.289906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 957/1875] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:03 2022] DELETE /identity/v3/projects/5703da96b7764b4e81311f8665941a90 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:04.296990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed3bf5-1cc9-41a9-8ce0-e111744ca959 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:04.297635 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed3bf5-1cc9-41a9-8ce0-e111744ca959 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:04.305627 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed3bf5-1cc9-41a9-8ce0-e111744ca959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:04.311594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563675d-38ab-4576-95b7-8bd1e5b2ada1 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:04.317154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68d16e-c504-409f-b7dc-a5f26d11404d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:04.318690 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68d16e-c504-409f-b7dc-a5f26d11404d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:04.319045 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68d16e-c504-409f-b7dc-a5f26d11404d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:04.319328 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68d16e-c504-409f-b7dc-a5f26d11404d admin admin] PATH_INFO: `/v3/users/b6ce27d87bd34c89ac67a7edc124c797` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:04.320656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68d16e-c504-409f-b7dc-a5f26d11404d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ce27d87bd34c89ac67a7edc124c797)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:04.322744 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68d16e-c504-409f-b7dc-a5f26d11404d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:04.349468 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-0aed3bf5-1cc9-41a9-8ce0-e111744ca959 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:04.351040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0aed3bf5-1cc9-41a9-8ce0-e111744ca959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:04.360232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 958/1876] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:04.367931 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c9616-b721-47e5-a379-1ebd4eccf385 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:04.368242 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c9616-b721-47e5-a379-1ebd4eccf385 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:04.368537 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c9616-b721-47e5-a379-1ebd4eccf385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:04.388863 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f10c9616-b721-47e5-a379-1ebd4eccf385 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:04.390161 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f10c9616-b721-47e5-a379-1ebd4eccf385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:04.398928 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 959/1877] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:04.403217 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c9616-b721-47e5-a379-1ebd4eccf385 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:04.412571 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c9616-b721-47e5-a379-1ebd4eccf385 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:04.418696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d53ce-4704-460e-811e-d4709f8db18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:04.425350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d53ce-4704-460e-811e-d4709f8db18f admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:04.425350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d53ce-4704-460e-811e-d4709f8db18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:04.425350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d53ce-4704-460e-811e-d4709f8db18f admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:04.425350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d53ce-4704-460e-811e-d4709f8db18f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:04.425350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d53ce-4704-460e-811e-d4709f8db18f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:04.425350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d53ce-4704-460e-811e-d4709f8db18f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:04.450666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 960/1878] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:24:04.455176 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d53ce-4704-460e-811e-d4709f8db18f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:04.466929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d53ce-4704-460e-811e-d4709f8db18f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:04.472607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2bedf-defd-4296-92a8-cb9a0287bdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:04.473271 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2bedf-defd-4296-92a8-cb9a0287bdea admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:04.473553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2bedf-defd-4296-92a8-cb9a0287bdea admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:04.473824 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2bedf-defd-4296-92a8-cb9a0287bdea admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:04.474635 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2bedf-defd-4296-92a8-cb9a0287bdea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:04.476761 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2bedf-defd-4296-92a8-cb9a0287bdea admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:04.566896 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 961/1879] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:04 2022] POST /identity/v3/projects => generated 400 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:24:04.576686 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2bedf-defd-4296-92a8-cb9a0287bdea admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:04.581871 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3c68d16e-c504-409f-b7dc-a5f26d11404d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ce27d87bd34c89ac67a7edc124c797'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:04.582690 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3c68d16e-c504-409f-b7dc-a5f26d11404d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ce27d87bd34c89ac67a7edc124c797'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:04.600294 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3c68d16e-c504-409f-b7dc-a5f26d11404d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ce27d87bd34c89ac67a7edc124c797'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:04.617302 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3c68d16e-c504-409f-b7dc-a5f26d11404d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ce27d87bd34c89ac67a7edc124c797'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:04.650638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2bedf-defd-4296-92a8-cb9a0287bdea admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:04.656222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a3725-66ab-43e2-9839-8fd941acfcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:04.656953 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a3725-66ab-43e2-9839-8fd941acfcd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:04.657305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a3725-66ab-43e2-9839-8fd941acfcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:04.658209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a3725-66ab-43e2-9839-8fd941acfcd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:04.658501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a3725-66ab-43e2-9839-8fd941acfcd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:04.660613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a3725-66ab-43e2-9839-8fd941acfcd3 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:04.759084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3c68d16e-c504-409f-b7dc-a5f26d11404d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ce27d87bd34c89ac67a7edc124c797'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:04.766796 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 919/1880] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:04 2022] DELETE /identity/v3/users/b6ce27d87bd34c89ac67a7edc124c797 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:04.767973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 962/1881] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:04 2022] POST /identity/v3/users => generated 301 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:04.771058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47604cf2-2236-431a-b8cb-d09eceab4b19 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:04.771565 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47604cf2-2236-431a-b8cb-d09eceab4b19 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:04.772021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47604cf2-2236-431a-b8cb-d09eceab4b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:04.773390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a3725-66ab-43e2-9839-8fd941acfcd3 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:04.775183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b59a3725-66ab-43e2-9839-8fd941acfcd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:04.793973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-47604cf2-2236-431a-b8cb-d09eceab4b19 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:04.795225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-47604cf2-2236-431a-b8cb-d09eceab4b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:04.801677 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a3725-66ab-43e2-9839-8fd941acfcd3 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:04.865862 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 920/1882] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:04.866982 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47604cf2-2236-431a-b8cb-d09eceab4b19 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:04.868292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-47604cf2-2236-431a-b8cb-d09eceab4b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:04.874724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13637fb-7608-49e7-92db-a59bcb060dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:04.875376 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13637fb-7608-49e7-92db-a59bcb060dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:04.875661 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13637fb-7608-49e7-92db-a59bcb060dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:04.875993 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13637fb-7608-49e7-92db-a59bcb060dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:04.876782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13637fb-7608-49e7-92db-a59bcb060dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:04.878602 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13637fb-7608-49e7-92db-a59bcb060dc5 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:04.891868 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47604cf2-2236-431a-b8cb-d09eceab4b19 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:04.893430 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0396e-a995-410f-a705-2c6e4cd8e0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:04.895312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0396e-a995-410f-a705-2c6e4cd8e0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:04.895312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0396e-a995-410f-a705-2c6e4cd8e0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:04.895312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0396e-a995-410f-a705-2c6e4cd8e0d7 admin admin] PATH_INFO: `/v3/projects/3d9a0957f6b04c73a3dbff097de312b3` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:04.896176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0396e-a995-410f-a705-2c6e4cd8e0d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d9a0957f6b04c73a3dbff097de312b3)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:04.902148 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0396e-a995-410f-a705-2c6e4cd8e0d7 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:04.903736 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 963/1883] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:04 2022] GET /identity/v3/roles => generated 1427 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:24:04.904773 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13637fb-7608-49e7-92db-a59bcb060dc5 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:04.908842 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f13637fb-7608-49e7-92db-a59bcb060dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:04.992838 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13637fb-7608-49e7-92db-a59bcb060dc5 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:05.001244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1dd95-67cb-48d9-ba5a-c2cef4a6a719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:05.001882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1dd95-67cb-48d9-ba5a-c2cef4a6a719 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:05.002161 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1dd95-67cb-48d9-ba5a-c2cef4a6a719 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:05.002432 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1dd95-67cb-48d9-ba5a-c2cef4a6a719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:05.012178 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1dd95-67cb-48d9-ba5a-c2cef4a6a719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:05.013952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1dd95-67cb-48d9-ba5a-c2cef4a6a719 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:05.025596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 964/1884] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:05.026493 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1dd95-67cb-48d9-ba5a-c2cef4a6a719 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:05.051091 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1dd95-67cb-48d9-ba5a-c2cef4a6a719 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:05.051213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2db0396e-a995-410f-a705-2c6e4cd8e0d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d9a0957f6b04c73a3dbff097de312b3', 'request_id': 'req-2db0396e-a995-410f-a705-2c6e4cd8e0d7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:05.054284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2db0396e-a995-410f-a705-2c6e4cd8e0d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d9a0957f6b04c73a3dbff097de312b3', 'request_id': 'req-2db0396e-a995-410f-a705-2c6e4cd8e0d7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:05.060698 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2db0396e-a995-410f-a705-2c6e4cd8e0d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d9a0957f6b04c73a3dbff097de312b3', 'request_id': 'req-2db0396e-a995-410f-a705-2c6e4cd8e0d7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:05.119425 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01250364-bbe8-4343-a1af-69dd3bf83ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:05.120089 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01250364-bbe8-4343-a1af-69dd3bf83ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:05.120352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01250364-bbe8-4343-a1af-69dd3bf83ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:05.120627 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01250364-bbe8-4343-a1af-69dd3bf83ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:05.121426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01250364-bbe8-4343-a1af-69dd3bf83ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:05.123058 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01250364-bbe8-4343-a1af-69dd3bf83ef7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:05.135198 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 965/1885] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:05 2022] GET /identity/v3/roles => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:05.140507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01250364-bbe8-4343-a1af-69dd3bf83ef7 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:05.151925 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01250364-bbe8-4343-a1af-69dd3bf83ef7 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:05.158914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2acbd-9b82-45a3-acc0-a5e3fd1ab18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:05.159895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2acbd-9b82-45a3-acc0-a5e3fd1ab18e admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:05.160589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2acbd-9b82-45a3-acc0-a5e3fd1ab18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:05.160589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2acbd-9b82-45a3-acc0-a5e3fd1ab18e admin admin] PATH_INFO: `/v3/projects/30b4a9045fe04722ad6f0f5c3c774d9a/users/8a65c0b18786435b91c793971676833c/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:05.172872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2db0396e-a995-410f-a705-2c6e4cd8e0d7 admin admin] The token cache is being invalidate because project 3d9a0957f6b04c73a3dbff097de312b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:05.173393 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2db0396e-a995-410f-a705-2c6e4cd8e0d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:05.174450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2db0396e-a995-410f-a705-2c6e4cd8e0d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:05.176289 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 921/1886] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:04 2022] DELETE /identity/v3/projects/3d9a0957f6b04c73a3dbff097de312b3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:05.181771 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12039a-9364-4ac2-8c7c-174cd39fac75 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:05.182285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12039a-9364-4ac2-8c7c-174cd39fac75 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:05.182822 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12039a-9364-4ac2-8c7c-174cd39fac75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:05.191114 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2acbd-9b82-45a3-acc0-a5e3fd1ab18e admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b4a9045fe04722ad6f0f5c3c774d9a, user_id=8a65c0b18786435b91c793971676833c, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:05.195189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2acbd-9b82-45a3-acc0-a5e3fd1ab18e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:05.210300 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-fc12039a-9364-4ac2-8c7c-174cd39fac75 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:05.211877 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fc12039a-9364-4ac2-8c7c-174cd39fac75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:05.221261 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 922/1887] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:05.229612 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ad4e5-d3f6-4693-b325-0fe67eda2f5c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:05.229902 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ad4e5-d3f6-4693-b325-0fe67eda2f5c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:05.230181 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ad4e5-d3f6-4693-b325-0fe67eda2f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:05.251357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c41ad4e5-d3f6-4693-b325-0fe67eda2f5c None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:05.252565 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c41ad4e5-d3f6-4693-b325-0fe67eda2f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:05.261624 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 923/1888] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:05.266013 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ad4e5-d3f6-4693-b325-0fe67eda2f5c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:05.275627 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ad4e5-d3f6-4693-b325-0fe67eda2f5c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:05.281043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a689c2-bbe1-410e-a37a-823f380a1fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:05.281672 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a689c2-bbe1-410e-a37a-823f380a1fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:05.282290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a689c2-bbe1-410e-a37a-823f380a1fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:05.282400 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a689c2-bbe1-410e-a37a-823f380a1fd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:05.283174 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a689c2-bbe1-410e-a37a-823f380a1fd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:05.283517 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a689c2-bbe1-410e-a37a-823f380a1fd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:05.285174 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a689c2-bbe1-410e-a37a-823f380a1fd5 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:05.287315 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 966/1889] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:05 2022] PUT /identity/v3/projects/30b4a9045fe04722ad6f0f5c3c774d9a/users/8a65c0b18786435b91c793971676833c/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:05.301631 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed99d0c-883d-4fb6-807e-1819805b06b2 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:05.301869 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed99d0c-883d-4fb6-807e-1819805b06b2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:05.302634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed99d0c-883d-4fb6-807e-1819805b06b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:05.308699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 924/1890] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:24:05.312990 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a689c2-bbe1-410e-a37a-823f380a1fd5 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:05.327303 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a689c2-bbe1-410e-a37a-823f380a1fd5 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:05.375220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5ed99d0c-883d-4fb6-807e-1819805b06b2 None None] MFA Rules not processed for user `8a65c0b18786435b91c793971676833c`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:05.376544 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5ed99d0c-883d-4fb6-807e-1819805b06b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:05.415079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685e175-17fe-4097-9e68-2597d6cdeef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:05.415841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685e175-17fe-4097-9e68-2597d6cdeef7 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:05.416261 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685e175-17fe-4097-9e68-2597d6cdeef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:05.416811 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685e175-17fe-4097-9e68-2597d6cdeef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:05.417669 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685e175-17fe-4097-9e68-2597d6cdeef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:05.420490 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685e175-17fe-4097-9e68-2597d6cdeef7 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:05.451954 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 967/1891] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:05 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:05.456481 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed99d0c-883d-4fb6-807e-1819805b06b2 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:05.458101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5ed99d0c-883d-4fb6-807e-1819805b06b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:05.471620 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed99d0c-883d-4fb6-807e-1819805b06b2 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:05.476891 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50163147-6320-444a-b950-8ea4cf5c4e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:05.478267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50163147-6320-444a-b950-8ea4cf5c4e5f admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:05.478267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50163147-6320-444a-b950-8ea4cf5c4e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:05.478267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50163147-6320-444a-b950-8ea4cf5c4e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:05.478786 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50163147-6320-444a-b950-8ea4cf5c4e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:05.480718 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50163147-6320-444a-b950-8ea4cf5c4e5f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:05.550459 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 925/1892] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:05 2022] POST /identity/v3/projects => generated 376 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:05.551692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685e175-17fe-4097-9e68-2597d6cdeef7 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:05.581213 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 968/1893] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:05 2022] POST /identity/v3/projects => generated 402 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:24:05.582036 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50163147-6320-444a-b950-8ea4cf5c4e5f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:05.586105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-50163147-6320-444a-b950-8ea4cf5c4e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:05.631416 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685e175-17fe-4097-9e68-2597d6cdeef7 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:05.680592 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50163147-6320-444a-b950-8ea4cf5c4e5f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:05.687229 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1375d5-ac85-4e31-b804-0b12779f290b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:05.688747 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1375d5-ac85-4e31-b804-0b12779f290b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:05.689038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1375d5-ac85-4e31-b804-0b12779f290b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:05.689463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1375d5-ac85-4e31-b804-0b12779f290b admin admin] PATH_INFO: `/v3/projects/6b2069f7bd6d45418bdd54208531ef4c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:05.690671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1375d5-ac85-4e31-b804-0b12779f290b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b2069f7bd6d45418bdd54208531ef4c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:05.692708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1375d5-ac85-4e31-b804-0b12779f290b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:05.697718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa3690-9779-4582-ada4-77dcd1659130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:05.698350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa3690-9779-4582-ada4-77dcd1659130 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:05.698635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa3690-9779-4582-ada4-77dcd1659130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:05.699000 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa3690-9779-4582-ada4-77dcd1659130 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:05.699682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa3690-9779-4582-ada4-77dcd1659130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:05.702531 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa3690-9779-4582-ada4-77dcd1659130 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:05.823002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 926/1894] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:05 2022] POST /identity/v3/users => generated 289 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:24:05.823002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa3690-9779-4582-ada4-77dcd1659130 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:05.832555 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa3690-9779-4582-ada4-77dcd1659130 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:05.834137 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-db1375d5-ac85-4e31-b804-0b12779f290b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b2069f7bd6d45418bdd54208531ef4c', 'request_id': 'req-db1375d5-ac85-4e31-b804-0b12779f290b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:05.840612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-db1375d5-ac85-4e31-b804-0b12779f290b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b2069f7bd6d45418bdd54208531ef4c', 'request_id': 'req-db1375d5-ac85-4e31-b804-0b12779f290b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:05.846192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-db1375d5-ac85-4e31-b804-0b12779f290b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b2069f7bd6d45418bdd54208531ef4c', 'request_id': 'req-db1375d5-ac85-4e31-b804-0b12779f290b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:05.873663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:05.893145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e7cf5-1a4b-42be-a63e-0237ebf53bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:05.893770 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e7cf5-1a4b-42be-a63e-0237ebf53bae admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:05.894054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e7cf5-1a4b-42be-a63e-0237ebf53bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:05.894364 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e7cf5-1a4b-42be-a63e-0237ebf53bae admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:05.895021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e7cf5-1a4b-42be-a63e-0237ebf53bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:05.897233 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e7cf5-1a4b-42be-a63e-0237ebf53bae admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:05.924444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-db1375d5-ac85-4e31-b804-0b12779f290b admin admin] The token cache is being invalidate because project 6b2069f7bd6d45418bdd54208531ef4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:05.924811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-db1375d5-ac85-4e31-b804-0b12779f290b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:05.925486 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-db1375d5-ac85-4e31-b804-0b12779f290b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:05.927225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 969/1895] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:05 2022] DELETE /identity/v3/projects/6b2069f7bd6d45418bdd54208531ef4c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:05.928479 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1375d5-ac85-4e31-b804-0b12779f290b admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:05.929850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-db1375d5-ac85-4e31-b804-0b12779f290b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:05.942539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1375d5-ac85-4e31-b804-0b12779f290b admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:05.948222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c86d86-c252-4d66-83ee-6fbe91e2c41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:05.949092 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c86d86-c252-4d66-83ee-6fbe91e2c41c admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:05.949451 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c86d86-c252-4d66-83ee-6fbe91e2c41c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:05.949739 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c86d86-c252-4d66-83ee-6fbe91e2c41c admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:05.950485 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c86d86-c252-4d66-83ee-6fbe91e2c41c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:05.952335 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c86d86-c252-4d66-83ee-6fbe91e2c41c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:05.964049 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 970/1896] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:05 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:05.965205 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c86d86-c252-4d66-83ee-6fbe91e2c41c admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:05.967236 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-17c86d86-c252-4d66-83ee-6fbe91e2c41c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:05.981319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c86d86-c252-4d66-83ee-6fbe91e2c41c admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:05.986556 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80be44-4b49-49f6-9f19-4367e1fd9f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:05.987337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80be44-4b49-49f6-9f19-4367e1fd9f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:05.987625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80be44-4b49-49f6-9f19-4367e1fd9f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:05.987896 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80be44-4b49-49f6-9f19-4367e1fd9f85 admin admin] PATH_INFO: `/v3/users/d128d5b6cfc6415d9ebce9ef2538d10c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:05.989110 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80be44-4b49-49f6-9f19-4367e1fd9f85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d128d5b6cfc6415d9ebce9ef2538d10c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:05.991721 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80be44-4b49-49f6-9f19-4367e1fd9f85 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:06.017979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 927/1897] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:05 2022] POST /identity/v3/users => generated 308 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:06.018894 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e7cf5-1a4b-42be-a63e-0237ebf53bae admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:06.030435 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e7cf5-1a4b-42be-a63e-0237ebf53bae admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:06.036198 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c59d6d-21d7-4906-b81f-50672095469e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:06.037420 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c59d6d-21d7-4906-b81f-50672095469e admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:06.037752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c59d6d-21d7-4906-b81f-50672095469e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:06.038025 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c59d6d-21d7-4906-b81f-50672095469e admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:06.038724 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c59d6d-21d7-4906-b81f-50672095469e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:06.040334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c59d6d-21d7-4906-b81f-50672095469e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:06.051207 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 928/1898] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:06 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:06.052828 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c59d6d-21d7-4906-b81f-50672095469e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:06.054711 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-62c59d6d-21d7-4906-b81f-50672095469e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:06.068809 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c59d6d-21d7-4906-b81f-50672095469e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:06.072277 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba9f4e-fc90-4c14-a404-97d671f098ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:06.072931 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba9f4e-fc90-4c14-a404-97d671f098ea admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:06.073215 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba9f4e-fc90-4c14-a404-97d671f098ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:06.073491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba9f4e-fc90-4c14-a404-97d671f098ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:06.074241 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba9f4e-fc90-4c14-a404-97d671f098ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:06.075859 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba9f4e-fc90-4c14-a404-97d671f098ea admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:06.086475 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 929/1899] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:06 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:06.087394 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba9f4e-fc90-4c14-a404-97d671f098ea admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:06.103352 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba9f4e-fc90-4c14-a404-97d671f098ea admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:06.104440 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d64d2-785f-484d-b34a-83f5d67bc300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:06.105180 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d64d2-785f-484d-b34a-83f5d67bc300 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:06.105490 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d64d2-785f-484d-b34a-83f5d67bc300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:06.105767 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d64d2-785f-484d-b34a-83f5d67bc300 admin admin] PATH_INFO: `/v3/projects/79734d8fd9b94fa2b8f6770c9fd1214f/users/a518077e189d43fb94e65d8301ca258a/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:06.122358 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d64d2-785f-484d-b34a-83f5d67bc300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79734d8fd9b94fa2b8f6770c9fd1214f, user_id=a518077e189d43fb94e65d8301ca258a, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:06.127263 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d64d2-785f-484d-b34a-83f5d67bc300 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:06.319925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 930/1900] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:06 2022] PUT /identity/v3/projects/79734d8fd9b94fa2b8f6770c9fd1214f/users/a518077e189d43fb94e65d8301ca258a/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:06.321319 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d64d2-785f-484d-b34a-83f5d67bc300 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:06.329911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7f80be44-4b49-49f6-9f19-4367e1fd9f85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd128d5b6cfc6415d9ebce9ef2538d10c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:06.330577 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7f80be44-4b49-49f6-9f19-4367e1fd9f85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd128d5b6cfc6415d9ebce9ef2538d10c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:06.386804 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d64d2-785f-484d-b34a-83f5d67bc300 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:06.391443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b35039-d02c-4e51-9866-39da6ecc6aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:06.392112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b35039-d02c-4e51-9866-39da6ecc6aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:06.392393 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b35039-d02c-4e51-9866-39da6ecc6aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:06.392686 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b35039-d02c-4e51-9866-39da6ecc6aeb admin admin] PATH_INFO: `/v3/projects/6eb4e9a22e6c4357a64c87f672139251/users/b1bca912134e426987416fe5f57a0cce/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:06.407188 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b35039-d02c-4e51-9866-39da6ecc6aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb4e9a22e6c4357a64c87f672139251, user_id=b1bca912134e426987416fe5f57a0cce, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:06.409911 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b35039-d02c-4e51-9866-39da6ecc6aeb admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:06.461211 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7f80be44-4b49-49f6-9f19-4367e1fd9f85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd128d5b6cfc6415d9ebce9ef2538d10c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:06.473819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7f80be44-4b49-49f6-9f19-4367e1fd9f85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd128d5b6cfc6415d9ebce9ef2538d10c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:06.474510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7f80be44-4b49-49f6-9f19-4367e1fd9f85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd128d5b6cfc6415d9ebce9ef2538d10c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:06.486718 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 971/1901] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:05 2022] DELETE /identity/v3/users/d128d5b6cfc6415d9ebce9ef2538d10c => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:06.487931 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b5246-efd2-4594-b6f5-37e68bf9d910 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:06.488218 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b5246-efd2-4594-b6f5-37e68bf9d910 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:06.488629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b5246-efd2-4594-b6f5-37e68bf9d910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:06.520078 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-da4b5246-efd2-4594-b6f5-37e68bf9d910 None None] MFA Rules not processed for user `a518077e189d43fb94e65d8301ca258a`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:06.521933 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-da4b5246-efd2-4594-b6f5-37e68bf9d910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:06.531405 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 931/1902] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:06 2022] PUT /identity/v3/projects/6eb4e9a22e6c4357a64c87f672139251/users/b1bca912134e426987416fe5f57a0cce/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:06.535514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b35039-d02c-4e51-9866-39da6ecc6aeb admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:06.537283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d6b35039-d02c-4e51-9866-39da6ecc6aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:06.608770 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 972/1903] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:06.613186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b5246-efd2-4594-b6f5-37e68bf9d910 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:06.614780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-da4b5246-efd2-4594-b6f5-37e68bf9d910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:06.621721 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b35039-d02c-4e51-9866-39da6ecc6aeb admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:06.626432 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4bf19-25d1-483d-8653-6b748e73a500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:06.627246 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4bf19-25d1-483d-8653-6b748e73a500 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:06.627533 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4bf19-25d1-483d-8653-6b748e73a500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:06.627862 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4bf19-25d1-483d-8653-6b748e73a500 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:06.628568 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4bf19-25d1-483d-8653-6b748e73a500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:06.630821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4bf19-25d1-483d-8653-6b748e73a500 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:06.642575 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 932/1904] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:06 2022] GET /identity/v3/roles => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:06.647501 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4bf19-25d1-483d-8653-6b748e73a500 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:06.659358 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4bf19-25d1-483d-8653-6b748e73a500 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:06.664258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33254a99-5926-41b9-8674-06e691be272b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:06.665047 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33254a99-5926-41b9-8674-06e691be272b admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:06.665402 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33254a99-5926-41b9-8674-06e691be272b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:06.665849 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33254a99-5926-41b9-8674-06e691be272b admin admin] PATH_INFO: `/v3/projects/6eb4e9a22e6c4357a64c87f672139251/users/b1bca912134e426987416fe5f57a0cce/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:06.667870 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33254a99-5926-41b9-8674-06e691be272b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb4e9a22e6c4357a64c87f672139251, user_id=b1bca912134e426987416fe5f57a0cce, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:06.675918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33254a99-5926-41b9-8674-06e691be272b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:06.695290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 933/1905] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:06 2022] PUT /identity/v3/projects/6eb4e9a22e6c4357a64c87f672139251/users/b1bca912134e426987416fe5f57a0cce/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:06.699259 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42189bc8-ea89-4578-b852-79274160fd4c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:06.699625 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42189bc8-ea89-4578-b852-79274160fd4c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:06.700030 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42189bc8-ea89-4578-b852-79274160fd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:06.703116 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b5246-efd2-4594-b6f5-37e68bf9d910 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:06.731052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-42189bc8-ea89-4578-b852-79274160fd4c None None] MFA Rules not processed for user `b1bca912134e426987416fe5f57a0cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:06.732409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-42189bc8-ea89-4578-b852-79274160fd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:06.769469 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7799-e5b1-47b0-abc8-3b2864fa7091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:06.770491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7799-e5b1-47b0-abc8-3b2864fa7091 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:06.770631 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7799-e5b1-47b0-abc8-3b2864fa7091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:06.771469 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7799-e5b1-47b0-abc8-3b2864fa7091 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:06.772080 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb7799-e5b1-47b0-abc8-3b2864fa7091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:06.774080 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb7799-e5b1-47b0-abc8-3b2864fa7091 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:06.865045 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 934/1906] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:06 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:06.878381 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42189bc8-ea89-4578-b852-79274160fd4c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:06.879979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-42189bc8-ea89-4578-b852-79274160fd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:06.928827 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 973/1907] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:06 2022] POST /identity/v3/projects => generated 376 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:24:06.934734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7799-e5b1-47b0-abc8-3b2864fa7091 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:06.975315 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42189bc8-ea89-4578-b852-79274160fd4c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:07.017496 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7799-e5b1-47b0-abc8-3b2864fa7091 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:07.024363 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a91df-0cc0-46c3-9357-119e81c35e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:07.025246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a91df-0cc0-46c3-9357-119e81c35e76 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:07.025750 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a91df-0cc0-46c3-9357-119e81c35e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:07.026104 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a91df-0cc0-46c3-9357-119e81c35e76 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:07.026868 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a91df-0cc0-46c3-9357-119e81c35e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:07.028990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a91df-0cc0-46c3-9357-119e81c35e76 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:07.069240 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef1c91-4687-4dbf-827a-66a76a073b11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:07.070095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef1c91-4687-4dbf-827a-66a76a073b11 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:07.070240 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef1c91-4687-4dbf-827a-66a76a073b11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:07.070708 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef1c91-4687-4dbf-827a-66a76a073b11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:07.124718 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 974/1908] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:06 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:07.151119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef1c91-4687-4dbf-827a-66a76a073b11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:07.151119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef1c91-4687-4dbf-827a-66a76a073b11 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:07.155317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a91df-0cc0-46c3-9357-119e81c35e76 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:07.157018 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 935/1909] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:06 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:24:07.179800 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a91df-0cc0-46c3-9357-119e81c35e76 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:07.185201 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971b723-180e-4a73-9b72-dbdcf24c0290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:07.185914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971b723-180e-4a73-9b72-dbdcf24c0290 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:07.186268 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971b723-180e-4a73-9b72-dbdcf24c0290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:07.186746 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971b723-180e-4a73-9b72-dbdcf24c0290 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:07.187535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971b723-180e-4a73-9b72-dbdcf24c0290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:07.189255 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971b723-180e-4a73-9b72-dbdcf24c0290 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:07.201463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 975/1910] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:07 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:24:07.205676 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef1c91-4687-4dbf-827a-66a76a073b11 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:07.220597 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef1c91-4687-4dbf-827a-66a76a073b11 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:07.226817 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced0890-4746-4f4f-b913-9c85553df95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:07.228392 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced0890-4746-4f4f-b913-9c85553df95d admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:07.228852 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced0890-4746-4f4f-b913-9c85553df95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:07.229207 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced0890-4746-4f4f-b913-9c85553df95d admin admin] PATH_INFO: `/v3/projects/07fd0af42fc24fd396fe7d941f722806/users/cb9ab17dc4134b6682f9f416330e239f/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:07.238737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971b723-180e-4a73-9b72-dbdcf24c0290 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:07.241534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5971b723-180e-4a73-9b72-dbdcf24c0290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:07.247430 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced0890-4746-4f4f-b913-9c85553df95d admin admin] RBAC: Authorizing `identity:create_grant(project_id=07fd0af42fc24fd396fe7d941f722806, user_id=cb9ab17dc4134b6682f9f416330e239f, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:07.250578 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced0890-4746-4f4f-b913-9c85553df95d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:07.261930 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:07.308920 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971b723-180e-4a73-9b72-dbdcf24c0290 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:07.314625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab467fa-50cf-4f8c-a801-e022140e8796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:07.315111 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab467fa-50cf-4f8c-a801-e022140e8796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:07.315442 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab467fa-50cf-4f8c-a801-e022140e8796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:07.315689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab467fa-50cf-4f8c-a801-e022140e8796 admin admin] PATH_INFO: `/v3/projects/302589d0f4fc43fda6237ba460093225` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:07.316943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab467fa-50cf-4f8c-a801-e022140e8796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=302589d0f4fc43fda6237ba460093225)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:07.319125 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab467fa-50cf-4f8c-a801-e022140e8796 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:07.334385 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 936/1911] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:07 2022] PUT /identity/v3/projects/07fd0af42fc24fd396fe7d941f722806/users/cb9ab17dc4134b6682f9f416330e239f/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:07.338964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced0890-4746-4f4f-b913-9c85553df95d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:07.420341 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced0890-4746-4f4f-b913-9c85553df95d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:07.426256 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16db145-dfd2-4aeb-afd9-bf5a24af5f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:07.426971 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16db145-dfd2-4aeb-afd9-bf5a24af5f56 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:07.435285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16db145-dfd2-4aeb-afd9-bf5a24af5f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:07.435285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16db145-dfd2-4aeb-afd9-bf5a24af5f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:07.435285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16db145-dfd2-4aeb-afd9-bf5a24af5f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:07.435285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16db145-dfd2-4aeb-afd9-bf5a24af5f56 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:07.451072 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 937/1912] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:07 2022] GET /identity/v3/roles => generated 1427 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:24:07.452540 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16db145-dfd2-4aeb-afd9-bf5a24af5f56 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:07.469934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16db145-dfd2-4aeb-afd9-bf5a24af5f56 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:07.470700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fc150-d644-41fa-9052-afbe8dd16509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:07.471490 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fc150-d644-41fa-9052-afbe8dd16509 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:07.471874 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fc150-d644-41fa-9052-afbe8dd16509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:07.472239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fc150-d644-41fa-9052-afbe8dd16509 admin admin] PATH_INFO: `/v3/projects/07fd0af42fc24fd396fe7d941f722806/users/cb9ab17dc4134b6682f9f416330e239f/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:07.474853 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fc150-d644-41fa-9052-afbe8dd16509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07fd0af42fc24fd396fe7d941f722806, user_id=cb9ab17dc4134b6682f9f416330e239f, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:07.477583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fc150-d644-41fa-9052-afbe8dd16509 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:07.489031 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 938/1913] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:07 2022] PUT /identity/v3/projects/07fd0af42fc24fd396fe7d941f722806/users/cb9ab17dc4134b6682f9f416330e239f/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:07.500187 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc0c06-a340-4013-8fd0-a7d429887780 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:07.500187 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc0c06-a340-4013-8fd0-a7d429887780 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:07.509873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc0c06-a340-4013-8fd0-a7d429887780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:07.520797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1ab467fa-50cf-4f8c-a801-e022140e8796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '302589d0f4fc43fda6237ba460093225', 'request_id': 'req-1ab467fa-50cf-4f8c-a801-e022140e8796'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:07.528112 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1ab467fa-50cf-4f8c-a801-e022140e8796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '302589d0f4fc43fda6237ba460093225', 'request_id': 'req-1ab467fa-50cf-4f8c-a801-e022140e8796'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:07.532716 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-78cc0c06-a340-4013-8fd0-a7d429887780 None None] MFA Rules not processed for user `cb9ab17dc4134b6682f9f416330e239f`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:07.534012 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-78cc0c06-a340-4013-8fd0-a7d429887780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:07.534407 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1ab467fa-50cf-4f8c-a801-e022140e8796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '302589d0f4fc43fda6237ba460093225', 'request_id': 'req-1ab467fa-50cf-4f8c-a801-e022140e8796'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:07.614298 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 939/1914] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:07.650140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1ab467fa-50cf-4f8c-a801-e022140e8796 admin admin] The token cache is being invalidate because project 302589d0f4fc43fda6237ba460093225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:07.654618 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1ab467fa-50cf-4f8c-a801-e022140e8796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:07.654618 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1ab467fa-50cf-4f8c-a801-e022140e8796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:07.654618 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 976/1915] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:07 2022] DELETE /identity/v3/projects/302589d0f4fc43fda6237ba460093225 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:07.657398 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc0c06-a340-4013-8fd0-a7d429887780 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:07.728899 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc0c06-a340-4013-8fd0-a7d429887780 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:07.733559 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33351830-028a-4593-a6c2-5cedbfda148f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:07.734207 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33351830-028a-4593-a6c2-5cedbfda148f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:07.734591 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33351830-028a-4593-a6c2-5cedbfda148f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:07.735396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33351830-028a-4593-a6c2-5cedbfda148f admin admin] PATH_INFO: `/v3/users/74614c884d074ddd9d5b66126c203ee6` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:07.736134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33351830-028a-4593-a6c2-5cedbfda148f admin admin] RBAC: Authorizing `identity:delete_user(user_id=74614c884d074ddd9d5b66126c203ee6)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:07.738378 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33351830-028a-4593-a6c2-5cedbfda148f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:07.905351 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab467fa-50cf-4f8c-a801-e022140e8796 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:07.907154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1ab467fa-50cf-4f8c-a801-e022140e8796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:07.950081 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-33351830-028a-4593-a6c2-5cedbfda148f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74614c884d074ddd9d5b66126c203ee6'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:07.952184 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-33351830-028a-4593-a6c2-5cedbfda148f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74614c884d074ddd9d5b66126c203ee6'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:07.968133 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-33351830-028a-4593-a6c2-5cedbfda148f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74614c884d074ddd9d5b66126c203ee6'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:07.978850 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-33351830-028a-4593-a6c2-5cedbfda148f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74614c884d074ddd9d5b66126c203ee6'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:08.037863 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab467fa-50cf-4f8c-a801-e022140e8796 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:08.045418 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efd96a-73f2-4ece-8578-5c68dbc1f21f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:08.046073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efd96a-73f2-4ece-8578-5c68dbc1f21f service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:08.046867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efd96a-73f2-4ece-8578-5c68dbc1f21f service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:08.047357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efd96a-73f2-4ece-8578-5c68dbc1f21f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:08.052733 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-47efd96a-73f2-4ece-8578-5c68dbc1f21f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:08.080257 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-33351830-028a-4593-a6c2-5cedbfda148f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74614c884d074ddd9d5b66126c203ee6'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:08.092027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 940/1916] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:07 2022] DELETE /identity/v3/users/74614c884d074ddd9d5b66126c203ee6 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:08.102031 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33351830-028a-4593-a6c2-5cedbfda148f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:08.103682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-33351830-028a-4593-a6c2-5cedbfda148f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:08.173417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efd96a-73f2-4ece-8578-5c68dbc1f21f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:08.175687 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efd96a-73f2-4ece-8578-5c68dbc1f21f service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:08.188123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 977/1917] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:07 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:24:08.200549 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33351830-028a-4593-a6c2-5cedbfda148f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:08.204247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6621f-8079-48ec-9a2d-3c619bc4c5e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:08.205080 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6621f-8079-48ec-9a2d-3c619bc4c5e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:08.205469 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6621f-8079-48ec-9a2d-3c619bc4c5e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:08.205980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6621f-8079-48ec-9a2d-3c619bc4c5e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:08.208891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-39d6621f-8079-48ec-9a2d-3c619bc4c5e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:08.289182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6621f-8079-48ec-9a2d-3c619bc4c5e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:08.292532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6621f-8079-48ec-9a2d-3c619bc4c5e2 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:08.325039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 941/1918] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:24:08.391407 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:09.202251 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:09.417563 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efd96a-73f2-4ece-8578-5c68dbc1f21f service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:09.419883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-47efd96a-73f2-4ece-8578-5c68dbc1f21f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:09.457027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efd96a-73f2-4ece-8578-5c68dbc1f21f service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:09.603496 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93639275-232f-40a4-90e8-599d7b995b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:09.605792 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93639275-232f-40a4-90e8-599d7b995b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:09.608887 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93639275-232f-40a4-90e8-599d7b995b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:09.609352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93639275-232f-40a4-90e8-599d7b995b19 admin admin] PATH_INFO: `/v3/projects/60cb17ef2fbc456eb1481c8d6aa445a4` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:09.612276 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93639275-232f-40a4-90e8-599d7b995b19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60cb17ef2fbc456eb1481c8d6aa445a4)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:09.615985 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93639275-232f-40a4-90e8-599d7b995b19 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:09.905647 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-93639275-232f-40a4-90e8-599d7b995b19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60cb17ef2fbc456eb1481c8d6aa445a4', 'request_id': 'req-93639275-232f-40a4-90e8-599d7b995b19'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:09.915108 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-93639275-232f-40a4-90e8-599d7b995b19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60cb17ef2fbc456eb1481c8d6aa445a4', 'request_id': 'req-93639275-232f-40a4-90e8-599d7b995b19'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:09.923408 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-93639275-232f-40a4-90e8-599d7b995b19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60cb17ef2fbc456eb1481c8d6aa445a4', 'request_id': 'req-93639275-232f-40a4-90e8-599d7b995b19'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:10.119014 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-93639275-232f-40a4-90e8-599d7b995b19 admin admin] The token cache is being invalidate because project 60cb17ef2fbc456eb1481c8d6aa445a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:10.122523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-93639275-232f-40a4-90e8-599d7b995b19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:10.123182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-93639275-232f-40a4-90e8-599d7b995b19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:10.126813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 978/1919] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:09 2022] DELETE /identity/v3/projects/60cb17ef2fbc456eb1481c8d6aa445a4 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:10.133457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6f5ae-7fe2-49d2-84d1-2d72c110a03d None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:10.133779 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6f5ae-7fe2-49d2-84d1-2d72c110a03d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:10.134115 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6f5ae-7fe2-49d2-84d1-2d72c110a03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:10.156841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-83e6f5ae-7fe2-49d2-84d1-2d72c110a03d None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:10.157951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-83e6f5ae-7fe2-49d2-84d1-2d72c110a03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:10.354013 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 942/1920] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:10.354551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b56e0-4d0c-42ab-9f53-145b016db35a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:10.354551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b56e0-4d0c-42ab-9f53-145b016db35a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:10.354551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b56e0-4d0c-42ab-9f53-145b016db35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:10.386939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-480b56e0-4d0c-42ab-9f53-145b016db35a None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:10.388291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-480b56e0-4d0c-42ab-9f53-145b016db35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:10.425430 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 979/1921] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:10.434706 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6f5ae-7fe2-49d2-84d1-2d72c110a03d None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:10.449636 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6f5ae-7fe2-49d2-84d1-2d72c110a03d None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:10.469618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a567bd-1701-44e6-980c-2fda699b70c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:10.470263 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a567bd-1701-44e6-980c-2fda699b70c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:10.470549 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a567bd-1701-44e6-980c-2fda699b70c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:10.471068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a567bd-1701-44e6-980c-2fda699b70c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:10.471613 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a567bd-1701-44e6-980c-2fda699b70c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:10.471966 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a567bd-1701-44e6-980c-2fda699b70c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:10.473643 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a567bd-1701-44e6-980c-2fda699b70c3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:10.503542 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 943/1922] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:24:10.508211 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b56e0-4d0c-42ab-9f53-145b016db35a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:10.520757 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b56e0-4d0c-42ab-9f53-145b016db35a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:10.538172 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0b119-2633-4810-8d84-10fd928608be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:10.541634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0b119-2633-4810-8d84-10fd928608be admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:10.541634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0b119-2633-4810-8d84-10fd928608be admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:10.541634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0b119-2633-4810-8d84-10fd928608be admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:10.541634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0b119-2633-4810-8d84-10fd928608be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:10.542243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0b119-2633-4810-8d84-10fd928608be admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:10.730086 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 980/1923] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:10 2022] POST /identity/v3/projects => generated 368 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:24:10.734582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a567bd-1701-44e6-980c-2fda699b70c3 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:10.746443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a567bd-1701-44e6-980c-2fda699b70c3 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:10.862956 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24562b9e-f256-40be-97c0-a006e36fe0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:10.865794 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24562b9e-f256-40be-97c0-a006e36fe0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:10.865794 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24562b9e-f256-40be-97c0-a006e36fe0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:10.865794 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24562b9e-f256-40be-97c0-a006e36fe0f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:10.868773 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24562b9e-f256-40be-97c0-a006e36fe0f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:10.870947 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24562b9e-f256-40be-97c0-a006e36fe0f0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:11.039034 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:11.049406 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 944/1924] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:10 2022] POST /identity/v3/users => generated 285 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:11.050688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0b119-2633-4810-8d84-10fd928608be admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:11.066359 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0b119-2633-4810-8d84-10fd928608be admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:11.076857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173443e-3a3d-4d59-93e9-d40cf9f3b189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:11.076857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173443e-3a3d-4d59-93e9-d40cf9f3b189 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:11.076857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173443e-3a3d-4d59-93e9-d40cf9f3b189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:11.079186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173443e-3a3d-4d59-93e9-d40cf9f3b189 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:11.080193 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173443e-3a3d-4d59-93e9-d40cf9f3b189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:11.082318 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173443e-3a3d-4d59-93e9-d40cf9f3b189 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:11.115404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 981/1925] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:11 2022] GET /identity/v3/roles => generated 1427 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:11.128275 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24562b9e-f256-40be-97c0-a006e36fe0f0 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:11.143800 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24562b9e-f256-40be-97c0-a006e36fe0f0 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:11.158335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aeec82-a4ad-438d-acf2-711fa4ab2fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:11.162582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aeec82-a4ad-438d-acf2-711fa4ab2fee admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:11.162582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aeec82-a4ad-438d-acf2-711fa4ab2fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:11.162582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aeec82-a4ad-438d-acf2-711fa4ab2fee admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:11.162582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aeec82-a4ad-438d-acf2-711fa4ab2fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:11.162582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aeec82-a4ad-438d-acf2-711fa4ab2fee admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:11.183278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 945/1926] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:11 2022] GET /identity/v3/roles => generated 1427 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:11.187929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173443e-3a3d-4d59-93e9-d40cf9f3b189 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:11.202643 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173443e-3a3d-4d59-93e9-d40cf9f3b189 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:11.216375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a38f21-7396-4db5-9ebd-f106b8f7eb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:11.217130 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a38f21-7396-4db5-9ebd-f106b8f7eb4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:11.217417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a38f21-7396-4db5-9ebd-f106b8f7eb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:11.217698 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a38f21-7396-4db5-9ebd-f106b8f7eb4f admin admin] PATH_INFO: `/v3/projects/d776a2e94c8c4dc8a24e26a477388ca9/users/ccb8f6ed51e24fab820322136f929fe8/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:11.237906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a38f21-7396-4db5-9ebd-f106b8f7eb4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d776a2e94c8c4dc8a24e26a477388ca9, user_id=ccb8f6ed51e24fab820322136f929fe8, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:11.239814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a38f21-7396-4db5-9ebd-f106b8f7eb4f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:11.394584 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 982/1927] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:11 2022] PUT /identity/v3/projects/d776a2e94c8c4dc8a24e26a477388ca9/users/ccb8f6ed51e24fab820322136f929fe8/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:11.406174 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7d083-e738-43f5-82d9-be2aec48344d None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:11.406728 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7d083-e738-43f5-82d9-be2aec48344d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:11.406728 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7d083-e738-43f5-82d9-be2aec48344d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:11.436959 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-10c7d083-e738-43f5-82d9-be2aec48344d None None] MFA Rules not processed for user `ccb8f6ed51e24fab820322136f929fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:11.438471 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-10c7d083-e738-43f5-82d9-be2aec48344d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:11.509682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 946/1928] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:11.510905 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a38f21-7396-4db5-9ebd-f106b8f7eb4f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:11.578729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a38f21-7396-4db5-9ebd-f106b8f7eb4f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:11.583549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ff355-96bd-47a2-8d16-6671069a4d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:11.584177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ff355-96bd-47a2-8d16-6671069a4d14 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:11.584461 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ff355-96bd-47a2-8d16-6671069a4d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:11.584771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ff355-96bd-47a2-8d16-6671069a4d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:11.585455 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ff355-96bd-47a2-8d16-6671069a4d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:11.587366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ff355-96bd-47a2-8d16-6671069a4d14 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:11.686665 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 983/1929] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:11 2022] POST /identity/v3/projects => generated 366 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:11.690935 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7d083-e738-43f5-82d9-be2aec48344d None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:11.702706 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7d083-e738-43f5-82d9-be2aec48344d None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:11.771988 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ca153-a7be-4a1b-88d3-2b92f4956825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:11.772897 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ca153-a7be-4a1b-88d3-2b92f4956825 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:11.773439 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ca153-a7be-4a1b-88d3-2b92f4956825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:11.773696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ca153-a7be-4a1b-88d3-2b92f4956825 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:11.774515 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ca153-a7be-4a1b-88d3-2b92f4956825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:11.776814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ca153-a7be-4a1b-88d3-2b92f4956825 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:11.884707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 947/1930] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:11 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:11.888673 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ff355-96bd-47a2-8d16-6671069a4d14 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:11.899511 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ff355-96bd-47a2-8d16-6671069a4d14 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:11.905844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98261f-78cc-413e-8265-12f95519da36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:11.907067 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98261f-78cc-413e-8265-12f95519da36 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:11.907671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98261f-78cc-413e-8265-12f95519da36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:11.908085 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98261f-78cc-413e-8265-12f95519da36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:11.908816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98261f-78cc-413e-8265-12f95519da36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:11.910662 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98261f-78cc-413e-8265-12f95519da36 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:11.928278 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 984/1931] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:11 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:24:11.929919 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ca153-a7be-4a1b-88d3-2b92f4956825 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:11.940575 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ca153-a7be-4a1b-88d3-2b92f4956825 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:11.947239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd98cb-b1da-4289-a4cc-6a1576d9a959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:11.947950 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd98cb-b1da-4289-a4cc-6a1576d9a959 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:11.948222 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd98cb-b1da-4289-a4cc-6a1576d9a959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:11.948531 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd98cb-b1da-4289-a4cc-6a1576d9a959 admin admin] PATH_INFO: `/v3/projects/40ed5dfc461d41738debf5303cd2e08b/users/f94da18a065c4b75957be56120e70e15/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:11.964874 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd98cb-b1da-4289-a4cc-6a1576d9a959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ed5dfc461d41738debf5303cd2e08b, user_id=f94da18a065c4b75957be56120e70e15, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:11.967603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd98cb-b1da-4289-a4cc-6a1576d9a959 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:12.051080 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 948/1932] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:11 2022] PUT /identity/v3/projects/40ed5dfc461d41738debf5303cd2e08b/users/f94da18a065c4b75957be56120e70e15/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:12.055848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98261f-78cc-413e-8265-12f95519da36 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:12.066381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98261f-78cc-413e-8265-12f95519da36 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:12.097655 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd98cb-b1da-4289-a4cc-6a1576d9a959 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:12.100098 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-94bd98cb-b1da-4289-a4cc-6a1576d9a959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:12.125713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff15ad3-8746-49c9-b40b-0a21733f51e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:12.126386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff15ad3-8746-49c9-b40b-0a21733f51e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:12.126670 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff15ad3-8746-49c9-b40b-0a21733f51e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:12.126941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff15ad3-8746-49c9-b40b-0a21733f51e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:12.127634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff15ad3-8746-49c9-b40b-0a21733f51e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:12.143798 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff15ad3-8746-49c9-b40b-0a21733f51e6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:12.159237 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 985/1933] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:12 2022] GET /identity/v3/roles => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:12.159815 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:12.165280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff15ad3-8746-49c9-b40b-0a21733f51e6 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:12.173586 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd98cb-b1da-4289-a4cc-6a1576d9a959 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:12.176994 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff15ad3-8746-49c9-b40b-0a21733f51e6 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:12.179719 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3eaf7-17ca-43b3-b8eb-c3916078e900 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:12.180563 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3eaf7-17ca-43b3-b8eb-c3916078e900 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:12.181025 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3eaf7-17ca-43b3-b8eb-c3916078e900 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:12.181514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3eaf7-17ca-43b3-b8eb-c3916078e900 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:12.183705 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-57c3eaf7-17ca-43b3-b8eb-c3916078e900 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:12.188840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bb360-32ab-4545-bb98-9731c9bd8dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:12.189666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bb360-32ab-4545-bb98-9731c9bd8dbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:12.190070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bb360-32ab-4545-bb98-9731c9bd8dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:12.190647 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bb360-32ab-4545-bb98-9731c9bd8dbf admin admin] PATH_INFO: `/v3/projects/40ed5dfc461d41738debf5303cd2e08b/users/f94da18a065c4b75957be56120e70e15/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:12.193549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bb360-32ab-4545-bb98-9731c9bd8dbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ed5dfc461d41738debf5303cd2e08b, user_id=f94da18a065c4b75957be56120e70e15, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:12.197141 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bb360-32ab-4545-bb98-9731c9bd8dbf admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:12.224998 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 986/1934] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:12 2022] PUT /identity/v3/projects/40ed5dfc461d41738debf5303cd2e08b/users/f94da18a065c4b75957be56120e70e15/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:12.226819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4bbcc-b767-4d4b-aa37-66178ce3c4b7 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:12.227217 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4bbcc-b767-4d4b-aa37-66178ce3c4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:12.227735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4bbcc-b767-4d4b-aa37-66178ce3c4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:12.266522 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-88e4bbcc-b767-4d4b-aa37-66178ce3c4b7 None None] MFA Rules not processed for user `f94da18a065c4b75957be56120e70e15`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:12.267668 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3eaf7-17ca-43b3-b8eb-c3916078e900 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:12.268395 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-88e4bbcc-b767-4d4b-aa37-66178ce3c4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:12.269232 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3eaf7-17ca-43b3-b8eb-c3916078e900 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:12.294077 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 949/1935] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:24:12.408709 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 987/1936] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:12.452457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3eaf7-17ca-43b3-b8eb-c3916078e900 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:12.454076 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-57c3eaf7-17ca-43b3-b8eb-c3916078e900 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:12.464805 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3eaf7-17ca-43b3-b8eb-c3916078e900 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:12.514643 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a7ad2-52a0-46a7-ab01-16711b7b149b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:12.515265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a7ad2-52a0-46a7-ab01-16711b7b149b service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:12.515549 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a7ad2-52a0-46a7-ab01-16711b7b149b service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:12.515823 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a7ad2-52a0-46a7-ab01-16711b7b149b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:12.526282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a7ad2-52a0-46a7-ab01-16711b7b149b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:12.527727 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a7ad2-52a0-46a7-ab01-16711b7b149b service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:12.537653 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 950/1937] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:12.616230 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:12.901727 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4bbcc-b767-4d4b-aa37-66178ce3c4b7 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:12.912357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4bbcc-b767-4d4b-aa37-66178ce3c4b7 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:12.916363 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1273e-1133-4f98-ad31-c9a87984f9ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:12.917026 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1273e-1133-4f98-ad31-c9a87984f9ee service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:12.917318 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1273e-1133-4f98-ad31-c9a87984f9ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:12.917592 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1273e-1133-4f98-ad31-c9a87984f9ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:12.991161 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1273e-1133-4f98-ad31-c9a87984f9ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:12.992613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1273e-1133-4f98-ad31-c9a87984f9ee service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:13.002514 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 988/1938] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:13.674231 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:14.294994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a7ad2-52a0-46a7-ab01-16711b7b149b service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:14.296785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-902a7ad2-52a0-46a7-ab01-16711b7b149b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:14.377018 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a7ad2-52a0-46a7-ab01-16711b7b149b service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:14.382217 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b81302-559b-4a95-9e75-14d19eeb67db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:14.385629 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b81302-559b-4a95-9e75-14d19eeb67db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:14.385629 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b81302-559b-4a95-9e75-14d19eeb67db admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:14.385629 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b81302-559b-4a95-9e75-14d19eeb67db admin admin] PATH_INFO: `/v3/users/8a65c0b18786435b91c793971676833c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:14.385629 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b81302-559b-4a95-9e75-14d19eeb67db admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a65c0b18786435b91c793971676833c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:14.387731 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b81302-559b-4a95-9e75-14d19eeb67db admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:14.629200 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f1b81302-559b-4a95-9e75-14d19eeb67db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a65c0b18786435b91c793971676833c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:14.630499 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f1b81302-559b-4a95-9e75-14d19eeb67db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a65c0b18786435b91c793971676833c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:14.642780 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f1b81302-559b-4a95-9e75-14d19eeb67db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a65c0b18786435b91c793971676833c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:14.653652 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f1b81302-559b-4a95-9e75-14d19eeb67db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a65c0b18786435b91c793971676833c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:14.758650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f1b81302-559b-4a95-9e75-14d19eeb67db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a65c0b18786435b91c793971676833c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:14.765707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 951/1939] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:14 2022] DELETE /identity/v3/users/8a65c0b18786435b91c793971676833c => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:14.770494 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99022d-772b-4a3a-9719-f316e14297ad None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:14.770977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99022d-772b-4a3a-9719-f316e14297ad None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:14.771066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99022d-772b-4a3a-9719-f316e14297ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:14.791311 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-ca99022d-772b-4a3a-9719-f316e14297ad None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:14.793098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ca99022d-772b-4a3a-9719-f316e14297ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:14.867995 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 989/1940] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:14.877616 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b81302-559b-4a95-9e75-14d19eeb67db admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:14.882360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f1b81302-559b-4a95-9e75-14d19eeb67db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:14.943213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b81302-559b-4a95-9e75-14d19eeb67db admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:14.947228 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fc764-6e2d-4f2d-96e9-26bdca5751df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:14.947926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fc764-6e2d-4f2d-96e9-26bdca5751df service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:14.948216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fc764-6e2d-4f2d-96e9-26bdca5751df service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:14.948493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fc764-6e2d-4f2d-96e9-26bdca5751df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:14.959471 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fc764-6e2d-4f2d-96e9-26bdca5751df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:14.961088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fc764-6e2d-4f2d-96e9-26bdca5751df service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:14.971112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 952/1941] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:15.076059 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:15.455150 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99022d-772b-4a3a-9719-f316e14297ad None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:15.459326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ca99022d-772b-4a3a-9719-f316e14297ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:15.485732 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99022d-772b-4a3a-9719-f316e14297ad None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:15.493577 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e6e38-7ac2-475e-bc24-662f042314f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:15.494502 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e6e38-7ac2-475e-bc24-662f042314f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:15.494830 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e6e38-7ac2-475e-bc24-662f042314f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:15.495151 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e6e38-7ac2-475e-bc24-662f042314f0 admin admin] PATH_INFO: `/v3/projects/30b4a9045fe04722ad6f0f5c3c774d9a` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:15.496648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e6e38-7ac2-475e-bc24-662f042314f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b4a9045fe04722ad6f0f5c3c774d9a)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:15.498662 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e6e38-7ac2-475e-bc24-662f042314f0 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:15.663458 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f54e6e38-7ac2-475e-bc24-662f042314f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b4a9045fe04722ad6f0f5c3c774d9a', 'request_id': 'req-f54e6e38-7ac2-475e-bc24-662f042314f0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:15.670321 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f54e6e38-7ac2-475e-bc24-662f042314f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b4a9045fe04722ad6f0f5c3c774d9a', 'request_id': 'req-f54e6e38-7ac2-475e-bc24-662f042314f0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:15.677295 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f54e6e38-7ac2-475e-bc24-662f042314f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b4a9045fe04722ad6f0f5c3c774d9a', 'request_id': 'req-f54e6e38-7ac2-475e-bc24-662f042314f0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:15.803258 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f54e6e38-7ac2-475e-bc24-662f042314f0 admin admin] The token cache is being invalidate because project 30b4a9045fe04722ad6f0f5c3c774d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:15.804269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f54e6e38-7ac2-475e-bc24-662f042314f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:15.804269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f54e6e38-7ac2-475e-bc24-662f042314f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:15.806062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 990/1942] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:15 2022] DELETE /identity/v3/projects/30b4a9045fe04722ad6f0f5c3c774d9a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:15.810552 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fc764-6e2d-4f2d-96e9-26bdca5751df service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:15.820897 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fc764-6e2d-4f2d-96e9-26bdca5751df service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:15.887524 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a51295-bffa-43f5-ba4f-d9218d717f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:15.888201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a51295-bffa-43f5-ba4f-d9218d717f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:15.888488 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a51295-bffa-43f5-ba4f-d9218d717f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:15.888974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a51295-bffa-43f5-ba4f-d9218d717f9c admin admin] PATH_INFO: `/v3/users/b1bca912134e426987416fe5f57a0cce` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:15.890035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a51295-bffa-43f5-ba4f-d9218d717f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1bca912134e426987416fe5f57a0cce)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:15.892192 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a51295-bffa-43f5-ba4f-d9218d717f9c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:16.134344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:16.138629 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c5a51295-bffa-43f5-ba4f-d9218d717f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1bca912134e426987416fe5f57a0cce'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:16.139294 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c5a51295-bffa-43f5-ba4f-d9218d717f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1bca912134e426987416fe5f57a0cce'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:16.152382 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c5a51295-bffa-43f5-ba4f-d9218d717f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1bca912134e426987416fe5f57a0cce'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:16.158783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c5a51295-bffa-43f5-ba4f-d9218d717f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1bca912134e426987416fe5f57a0cce'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:16.224348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c5a51295-bffa-43f5-ba4f-d9218d717f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1bca912134e426987416fe5f57a0cce'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:16.234097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 953/1943] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:15 2022] DELETE /identity/v3/users/b1bca912134e426987416fe5f57a0cce => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:16.684567 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e6e38-7ac2-475e-bc24-662f042314f0 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:16.691183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f54e6e38-7ac2-475e-bc24-662f042314f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:16.704117 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e6e38-7ac2-475e-bc24-662f042314f0 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:16.719571 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a51295-bffa-43f5-ba4f-d9218d717f9c admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:16.724289 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c5a51295-bffa-43f5-ba4f-d9218d717f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:16.775579 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:16.782708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d42f80-730b-4bee-8666-c3385dd9f5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:16.783243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d42f80-730b-4bee-8666-c3385dd9f5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:16.783525 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d42f80-730b-4bee-8666-c3385dd9f5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:16.783798 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d42f80-730b-4bee-8666-c3385dd9f5a6 admin admin] PATH_INFO: `/v3/projects/6eb4e9a22e6c4357a64c87f672139251` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:16.785381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d42f80-730b-4bee-8666-c3385dd9f5a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eb4e9a22e6c4357a64c87f672139251)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:16.787393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d42f80-730b-4bee-8666-c3385dd9f5a6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:16.791829 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a51295-bffa-43f5-ba4f-d9218d717f9c admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:16.797812 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854ea96-10fc-425f-acaf-15a72b1e07aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:16.798470 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854ea96-10fc-425f-acaf-15a72b1e07aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:16.798757 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854ea96-10fc-425f-acaf-15a72b1e07aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:16.799032 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854ea96-10fc-425f-acaf-15a72b1e07aa admin admin] PATH_INFO: `/v3/users/00110f2898d64ccd8ff0b6090637b013` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:16.800242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854ea96-10fc-425f-acaf-15a72b1e07aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=00110f2898d64ccd8ff0b6090637b013)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:16.802860 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854ea96-10fc-425f-acaf-15a72b1e07aa admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:16.907309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-66d42f80-730b-4bee-8666-c3385dd9f5a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eb4e9a22e6c4357a64c87f672139251', 'request_id': 'req-66d42f80-730b-4bee-8666-c3385dd9f5a6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:16.918009 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-66d42f80-730b-4bee-8666-c3385dd9f5a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eb4e9a22e6c4357a64c87f672139251', 'request_id': 'req-66d42f80-730b-4bee-8666-c3385dd9f5a6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:16.922956 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-66d42f80-730b-4bee-8666-c3385dd9f5a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eb4e9a22e6c4357a64c87f672139251', 'request_id': 'req-66d42f80-730b-4bee-8666-c3385dd9f5a6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:17.002487 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-66d42f80-730b-4bee-8666-c3385dd9f5a6 admin admin] The token cache is being invalidate because project 6eb4e9a22e6c4357a64c87f672139251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:17.002487 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-66d42f80-730b-4bee-8666-c3385dd9f5a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:17.002893 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-66d42f80-730b-4bee-8666-c3385dd9f5a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:17.004550 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 991/1944] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:16 2022] DELETE /identity/v3/projects/6eb4e9a22e6c4357a64c87f672139251 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:17.009283 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efc8cc-663e-4187-8b12-d2afc06a4996 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:17.009567 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efc8cc-663e-4187-8b12-d2afc06a4996 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:17.009849 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efc8cc-663e-4187-8b12-d2afc06a4996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:17.015549 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d854ea96-10fc-425f-acaf-15a72b1e07aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00110f2898d64ccd8ff0b6090637b013'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:17.015968 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d854ea96-10fc-425f-acaf-15a72b1e07aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00110f2898d64ccd8ff0b6090637b013'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:17.032740 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d854ea96-10fc-425f-acaf-15a72b1e07aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00110f2898d64ccd8ff0b6090637b013'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:17.034919 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a8efc8cc-663e-4187-8b12-d2afc06a4996 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:17.037172 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a8efc8cc-663e-4187-8b12-d2afc06a4996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:17.041821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d854ea96-10fc-425f-acaf-15a72b1e07aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00110f2898d64ccd8ff0b6090637b013'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:17.101459 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 992/1945] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:17.110627 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac1f75-3bb9-42a3-a910-8f982ec63cfb None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:17.110913 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac1f75-3bb9-42a3-a910-8f982ec63cfb None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:17.111187 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac1f75-3bb9-42a3-a910-8f982ec63cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:17.134010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-8eac1f75-3bb9-42a3-a910-8f982ec63cfb None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:17.135466 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8eac1f75-3bb9-42a3-a910-8f982ec63cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:17.144804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 993/1946] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:17.147251 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d854ea96-10fc-425f-acaf-15a72b1e07aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00110f2898d64ccd8ff0b6090637b013'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:17.148971 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac1f75-3bb9-42a3-a910-8f982ec63cfb None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:17.159934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 954/1947] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:16 2022] DELETE /identity/v3/users/00110f2898d64ccd8ff0b6090637b013 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:17.160033 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac1f75-3bb9-42a3-a910-8f982ec63cfb None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:17.162568 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055630a-c883-40e4-b248-0d01fdc411a9 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:17.162859 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055630a-c883-40e4-b248-0d01fdc411a9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:17.163599 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055630a-c883-40e4-b248-0d01fdc411a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:17.191651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-4055630a-c883-40e4-b248-0d01fdc411a9 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:17.193205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4055630a-c883-40e4-b248-0d01fdc411a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:17.241135 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcf969-45bb-4fcc-9a46-0ea83329e8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:17.241844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcf969-45bb-4fcc-9a46-0ea83329e8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:17.242186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcf969-45bb-4fcc-9a46-0ea83329e8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:17.242522 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcf969-45bb-4fcc-9a46-0ea83329e8c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:17.243332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcf969-45bb-4fcc-9a46-0ea83329e8c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:17.243724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcf969-45bb-4fcc-9a46-0ea83329e8c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:17.245431 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcf969-45bb-4fcc-9a46-0ea83329e8c5 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:17.254231 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 955/1948] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:17.260446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 994/1949] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:24:17.265549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcf969-45bb-4fcc-9a46-0ea83329e8c5 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:17.265701 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055630a-c883-40e4-b248-0d01fdc411a9 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:17.266994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4055630a-c883-40e4-b248-0d01fdc411a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:17.267252 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-00fcf969-45bb-4fcc-9a46-0ea83329e8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:17.279378 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcf969-45bb-4fcc-9a46-0ea83329e8c5 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:17.283965 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229f7af-6732-4a37-bdae-572cd7cd2880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:17.284570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229f7af-6732-4a37-bdae-572cd7cd2880 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:17.284882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229f7af-6732-4a37-bdae-572cd7cd2880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:17.285158 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229f7af-6732-4a37-bdae-572cd7cd2880 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:17.285818 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229f7af-6732-4a37-bdae-572cd7cd2880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:17.288785 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229f7af-6732-4a37-bdae-572cd7cd2880 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:17.326601 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055630a-c883-40e4-b248-0d01fdc411a9 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:17.330229 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66289de-0522-4711-915c-60cb049ed4d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:17.330848 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66289de-0522-4711-915c-60cb049ed4d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:17.331178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66289de-0522-4711-915c-60cb049ed4d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:17.331470 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66289de-0522-4711-915c-60cb049ed4d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:17.341169 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66289de-0522-4711-915c-60cb049ed4d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:17.342607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66289de-0522-4711-915c-60cb049ed4d6 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:17.352886 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 956/1950] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:17.426392 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 995/1951] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:17 2022] POST /identity/v3/projects => generated 382 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:17.430854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66289de-0522-4711-915c-60cb049ed4d6 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:17.441123 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66289de-0522-4711-915c-60cb049ed4d6 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:17.505368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7beba5-4bbc-4068-a397-52426eeabf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:17.505996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7beba5-4bbc-4068-a397-52426eeabf0d admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:17.506281 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7beba5-4bbc-4068-a397-52426eeabf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:17.506567 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7beba5-4bbc-4068-a397-52426eeabf0d admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:17.507232 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7beba5-4bbc-4068-a397-52426eeabf0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:17.509608 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7beba5-4bbc-4068-a397-52426eeabf0d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:17.609575 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:17.616488 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 957/1952] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:17 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:17.621426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229f7af-6732-4a37-bdae-572cd7cd2880 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:17.633315 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229f7af-6732-4a37-bdae-572cd7cd2880 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:17.639185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8096391-e4d5-4106-b64d-506c5a65a38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:17.639893 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8096391-e4d5-4106-b64d-506c5a65a38a admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:17.640326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8096391-e4d5-4106-b64d-506c5a65a38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:17.640982 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8096391-e4d5-4106-b64d-506c5a65a38a admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:17.645906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8096391-e4d5-4106-b64d-506c5a65a38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:17.645906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8096391-e4d5-4106-b64d-506c5a65a38a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:17.658025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 996/1953] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:17 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:17.662329 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7beba5-4bbc-4068-a397-52426eeabf0d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:17.673276 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7beba5-4bbc-4068-a397-52426eeabf0d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:17.679987 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b27f17-9283-4f8a-a6ed-d2689695bb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:17.680759 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b27f17-9283-4f8a-a6ed-d2689695bb8f admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:17.681113 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b27f17-9283-4f8a-a6ed-d2689695bb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:17.681570 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b27f17-9283-4f8a-a6ed-d2689695bb8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:17.682364 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b27f17-9283-4f8a-a6ed-d2689695bb8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:17.684042 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b27f17-9283-4f8a-a6ed-d2689695bb8f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:17.695485 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 958/1954] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:17 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:17.705146 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8096391-e4d5-4106-b64d-506c5a65a38a admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:17.739317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8096391-e4d5-4106-b64d-506c5a65a38a admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:17.750657 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55260de-e379-46f9-a22e-f1dff3269c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:17.751526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55260de-e379-46f9-a22e-f1dff3269c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:17.751798 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55260de-e379-46f9-a22e-f1dff3269c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:17.752138 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55260de-e379-46f9-a22e-f1dff3269c86 admin admin] PATH_INFO: `/v3/projects/73e7c00389564946b847adf2eca850a9/users/ecc18dd2ef254723ba8d406dbd702e4a/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:17.768949 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55260de-e379-46f9-a22e-f1dff3269c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73e7c00389564946b847adf2eca850a9, user_id=ecc18dd2ef254723ba8d406dbd702e4a, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:17.772350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55260de-e379-46f9-a22e-f1dff3269c86 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:17.822216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b27f17-9283-4f8a-a6ed-d2689695bb8f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:17.824103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c1b27f17-9283-4f8a-a6ed-d2689695bb8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:17.839194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b27f17-9283-4f8a-a6ed-d2689695bb8f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:17.845031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 997/1955] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:17 2022] PUT /identity/v3/projects/73e7c00389564946b847adf2eca850a9/users/ecc18dd2ef254723ba8d406dbd702e4a/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:17.858816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bb1f2-74b4-41fd-b205-c7ee323f4124 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:17.859286 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bb1f2-74b4-41fd-b205-c7ee323f4124 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:17.859694 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bb1f2-74b4-41fd-b205-c7ee323f4124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:17.893825 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f50bb1f2-74b4-41fd-b205-c7ee323f4124 None None] MFA Rules not processed for user `ecc18dd2ef254723ba8d406dbd702e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:17.896102 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f50bb1f2-74b4-41fd-b205-c7ee323f4124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:17.919127 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762efa3-23db-44c5-911f-1fd2bb2c1ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:17.920576 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762efa3-23db-44c5-911f-1fd2bb2c1ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:17.921070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762efa3-23db-44c5-911f-1fd2bb2c1ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:17.921529 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762efa3-23db-44c5-911f-1fd2bb2c1ea2 admin admin] PATH_INFO: `/v3/projects/e3ed6df036c24225be9bb00dc1ed9bbf` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:17.922996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762efa3-23db-44c5-911f-1fd2bb2c1ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ed6df036c24225be9bb00dc1ed9bbf)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:17.925809 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762efa3-23db-44c5-911f-1fd2bb2c1ea2 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:18.011929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 998/1956] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:18.016559 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bb1f2-74b4-41fd-b205-c7ee323f4124 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:18.028811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bb1f2-74b4-41fd-b205-c7ee323f4124 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:18.033576 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ceb0f-30dc-4963-9d8d-af813b622dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:18.045843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ceb0f-30dc-4963-9d8d-af813b622dea admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:18.045843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ceb0f-30dc-4963-9d8d-af813b622dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:18.045843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ceb0f-30dc-4963-9d8d-af813b622dea admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:18.045843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ceb0f-30dc-4963-9d8d-af813b622dea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:18.045843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ceb0f-30dc-4963-9d8d-af813b622dea admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:18.112759 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c762efa3-23db-44c5-911f-1fd2bb2c1ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ed6df036c24225be9bb00dc1ed9bbf', 'request_id': 'req-c762efa3-23db-44c5-911f-1fd2bb2c1ea2'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:18.120053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c762efa3-23db-44c5-911f-1fd2bb2c1ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ed6df036c24225be9bb00dc1ed9bbf', 'request_id': 'req-c762efa3-23db-44c5-911f-1fd2bb2c1ea2'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:18.125622 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c762efa3-23db-44c5-911f-1fd2bb2c1ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ed6df036c24225be9bb00dc1ed9bbf', 'request_id': 'req-c762efa3-23db-44c5-911f-1fd2bb2c1ea2'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:18.147493 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 999/1957] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:18 2022] POST /identity/v3/projects => generated 384 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:24:18.152168 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ceb0f-30dc-4963-9d8d-af813b622dea admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:18.202924 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c762efa3-23db-44c5-911f-1fd2bb2c1ea2 admin admin] The token cache is being invalidate because project e3ed6df036c24225be9bb00dc1ed9bbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:18.202924 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c762efa3-23db-44c5-911f-1fd2bb2c1ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:18.203451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c762efa3-23db-44c5-911f-1fd2bb2c1ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:18.205161 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 959/1958] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:17 2022] DELETE /identity/v3/projects/e3ed6df036c24225be9bb00dc1ed9bbf => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:18.209964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084247db-7294-4244-8238-30e088239a70 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:18.210696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084247db-7294-4244-8238-30e088239a70 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:18.211091 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084247db-7294-4244-8238-30e088239a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:18.260391 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-084247db-7294-4244-8238-30e088239a70 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:18.261850 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-084247db-7294-4244-8238-30e088239a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:18.289557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ceb0f-30dc-4963-9d8d-af813b622dea admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:18.297588 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecdf1a-3884-476b-bb5b-9c9287c0e4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:18.298253 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecdf1a-3884-476b-bb5b-9c9287c0e4c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:18.298705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecdf1a-3884-476b-bb5b-9c9287c0e4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:18.299035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecdf1a-3884-476b-bb5b-9c9287c0e4c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:18.300046 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ecdf1a-3884-476b-bb5b-9c9287c0e4c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:18.303354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ecdf1a-3884-476b-bb5b-9c9287c0e4c9 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:18.343569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 960/1959] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:18.351314 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb631dc-3e1b-497a-a757-6751bb481e50 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:18.351608 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb631dc-3e1b-497a-a757-6751bb481e50 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:18.351889 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb631dc-3e1b-497a-a757-6751bb481e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:18.373676 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-cdb631dc-3e1b-497a-a757-6751bb481e50 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:18.374970 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-cdb631dc-3e1b-497a-a757-6751bb481e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:18.384067 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 961/1960] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:18.388202 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb631dc-3e1b-497a-a757-6751bb481e50 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:18.398576 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb631dc-3e1b-497a-a757-6751bb481e50 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:18.404288 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863648d6-666f-4a01-b0c8-d0c8b0521f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:18.406694 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863648d6-666f-4a01-b0c8-d0c8b0521f66 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:18.407116 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863648d6-666f-4a01-b0c8-d0c8b0521f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:18.407465 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863648d6-666f-4a01-b0c8-d0c8b0521f66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:18.408834 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863648d6-666f-4a01-b0c8-d0c8b0521f66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:18.409245 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863648d6-666f-4a01-b0c8-d0c8b0521f66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:18.411006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863648d6-666f-4a01-b0c8-d0c8b0521f66 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:18.439005 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 962/1961] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:24:18.439927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863648d6-666f-4a01-b0c8-d0c8b0521f66 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:18.464034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863648d6-666f-4a01-b0c8-d0c8b0521f66 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:18.464034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fb8b0-496a-4c34-84e6-e8148be6fe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:18.464034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fb8b0-496a-4c34-84e6-e8148be6fe86 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:18.464034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fb8b0-496a-4c34-84e6-e8148be6fe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:18.464584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fb8b0-496a-4c34-84e6-e8148be6fe86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:18.464584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fb8b0-496a-4c34-84e6-e8148be6fe86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:18.466685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fb8b0-496a-4c34-84e6-e8148be6fe86 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:18.478236 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1000/1962] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:18 2022] POST /identity/v3/users => generated 299 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:18.483527 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecdf1a-3884-476b-bb5b-9c9287c0e4c9 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:18.486101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b5ecdf1a-3884-476b-bb5b-9c9287c0e4c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:18.505682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecdf1a-3884-476b-bb5b-9c9287c0e4c9 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:18.511721 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589c6e0-6b31-4410-b3ab-953fef3bad58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:18.512444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589c6e0-6b31-4410-b3ab-953fef3bad58 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:18.513112 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589c6e0-6b31-4410-b3ab-953fef3bad58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:18.513822 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589c6e0-6b31-4410-b3ab-953fef3bad58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:18.514549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589c6e0-6b31-4410-b3ab-953fef3bad58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:18.516375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589c6e0-6b31-4410-b3ab-953fef3bad58 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:18.530771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1001/1963] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:18 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:24:18.532589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589c6e0-6b31-4410-b3ab-953fef3bad58 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:18.546263 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589c6e0-6b31-4410-b3ab-953fef3bad58 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:18.551075 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7df356-b6f9-4ed2-8022-bbf57081ec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:18.551840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7df356-b6f9-4ed2-8022-bbf57081ec93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:18.552184 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7df356-b6f9-4ed2-8022-bbf57081ec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:18.552548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7df356-b6f9-4ed2-8022-bbf57081ec93 admin admin] PATH_INFO: `/v3/projects/65842f6f65904b7582781dc0e0898969/users/e9a9d3861139460aa1c1b358c98ab615/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:18.563244 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 963/1964] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:18 2022] POST /identity/v3/projects => generated 376 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:18.568866 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fb8b0-496a-4c34-84e6-e8148be6fe86 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:18.569625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7df356-b6f9-4ed2-8022-bbf57081ec93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65842f6f65904b7582781dc0e0898969, user_id=e9a9d3861139460aa1c1b358c98ab615, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:18.573192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7df356-b6f9-4ed2-8022-bbf57081ec93 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:18.639517 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fb8b0-496a-4c34-84e6-e8148be6fe86 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:18.647025 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74a7f0-10e5-42ca-a774-799a61681c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:18.647678 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a7f0-10e5-42ca-a774-799a61681c0e admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:18.647962 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a7f0-10e5-42ca-a774-799a61681c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:18.648240 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a7f0-10e5-42ca-a774-799a61681c0e admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:18.648961 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74a7f0-10e5-42ca-a774-799a61681c0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:18.651161 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74a7f0-10e5-42ca-a774-799a61681c0e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:18.654960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1002/1965] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:18 2022] PUT /identity/v3/projects/65842f6f65904b7582781dc0e0898969/users/e9a9d3861139460aa1c1b358c98ab615/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:18.658950 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7df356-b6f9-4ed2-8022-bbf57081ec93 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:18.704577 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:18.726338 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7df356-b6f9-4ed2-8022-bbf57081ec93 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:18.731207 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f7a40-8b42-4976-8e30-4963febfb0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:18.731830 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f7a40-8b42-4976-8e30-4963febfb0db admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:18.732116 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f7a40-8b42-4976-8e30-4963febfb0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:18.732381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f7a40-8b42-4976-8e30-4963febfb0db admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:18.733113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f7a40-8b42-4976-8e30-4963febfb0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:18.734718 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f7a40-8b42-4976-8e30-4963febfb0db admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:18.736695 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 964/1966] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:18 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:24:18.744577 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74a7f0-10e5-42ca-a774-799a61681c0e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:18.749052 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1003/1967] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:18 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:18.750336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f7a40-8b42-4976-8e30-4963febfb0db admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:18.750980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74a7f0-10e5-42ca-a774-799a61681c0e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:18.756502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b556c-547e-40aa-9cc6-8b871f1e76d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:18.757725 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b556c-547e-40aa-9cc6-8b871f1e76d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:18.757725 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b556c-547e-40aa-9cc6-8b871f1e76d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:18.758027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b556c-547e-40aa-9cc6-8b871f1e76d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:18.758460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b556c-547e-40aa-9cc6-8b871f1e76d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:18.760546 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b556c-547e-40aa-9cc6-8b871f1e76d7 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:18.761556 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f7a40-8b42-4976-8e30-4963febfb0db admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:18.773029 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d6e27-0ea1-43fb-ac6f-a4def9cd5ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:18.774183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d6e27-0ea1-43fb-ac6f-a4def9cd5ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:18.774183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d6e27-0ea1-43fb-ac6f-a4def9cd5ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:18.774532 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d6e27-0ea1-43fb-ac6f-a4def9cd5ccd admin admin] PATH_INFO: `/v3/projects/65842f6f65904b7582781dc0e0898969/users/e9a9d3861139460aa1c1b358c98ab615/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:18.776439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d6e27-0ea1-43fb-ac6f-a4def9cd5ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=65842f6f65904b7582781dc0e0898969, user_id=e9a9d3861139460aa1c1b358c98ab615, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:18.780155 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d6e27-0ea1-43fb-ac6f-a4def9cd5ccd admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:18.784548 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 965/1968] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:18 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:24:18.789489 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b556c-547e-40aa-9cc6-8b871f1e76d7 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:18.799210 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1004/1969] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:18 2022] PUT /identity/v3/projects/65842f6f65904b7582781dc0e0898969/users/e9a9d3861139460aa1c1b358c98ab615/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:18.804882 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b556c-547e-40aa-9cc6-8b871f1e76d7 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:18.812000 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86327eff-2d30-4858-98c2-a87ebf9a5289 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:18.812283 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86327eff-2d30-4858-98c2-a87ebf9a5289 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:18.812563 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86327eff-2d30-4858-98c2-a87ebf9a5289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:18.849583 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-86327eff-2d30-4858-98c2-a87ebf9a5289 None None] MFA Rules not processed for user `e9a9d3861139460aa1c1b358c98ab615`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:18.850858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-86327eff-2d30-4858-98c2-a87ebf9a5289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:18.852846 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:18.885256 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f97531-042a-4132-acc1-8dccb803557e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:18.885801 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f97531-042a-4132-acc1-8dccb803557e admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:18.886085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f97531-042a-4132-acc1-8dccb803557e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:18.886358 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f97531-042a-4132-acc1-8dccb803557e admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:18.887086 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f97531-042a-4132-acc1-8dccb803557e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:18.888707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f97531-042a-4132-acc1-8dccb803557e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:18.901627 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 966/1970] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:18 2022] GET /identity/v3/roles => generated 1427 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:18.902967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f97531-042a-4132-acc1-8dccb803557e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:18.912496 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f97531-042a-4132-acc1-8dccb803557e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:18.922073 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af69f91-0e81-4a33-bec7-8d15498ac4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:18.924822 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af69f91-0e81-4a33-bec7-8d15498ac4a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:18.924822 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af69f91-0e81-4a33-bec7-8d15498ac4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:18.924822 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af69f91-0e81-4a33-bec7-8d15498ac4a8 admin admin] PATH_INFO: `/v3/projects/5b8415eff3434e4cadb2351020c9bd16/users/666b04f1f4584795bd14f2d84be5b291/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:18.929662 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1005/1971] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:18.939318 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af69f91-0e81-4a33-bec7-8d15498ac4a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8415eff3434e4cadb2351020c9bd16, user_id=666b04f1f4584795bd14f2d84be5b291, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:18.941316 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86327eff-2d30-4858-98c2-a87ebf9a5289 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:18.943298 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af69f91-0e81-4a33-bec7-8d15498ac4a8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:18.943414 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-86327eff-2d30-4858-98c2-a87ebf9a5289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:19.008694 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86327eff-2d30-4858-98c2-a87ebf9a5289 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:19.012760 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab2f48-9f47-4eba-a06d-d004cdb6f563 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:19.013387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab2f48-9f47-4eba-a06d-d004cdb6f563 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:19.013672 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab2f48-9f47-4eba-a06d-d004cdb6f563 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:19.013948 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab2f48-9f47-4eba-a06d-d004cdb6f563 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:19.024335 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab2f48-9f47-4eba-a06d-d004cdb6f563 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:19.026086 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab2f48-9f47-4eba-a06d-d004cdb6f563 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:19.039060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1006/1972] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:24:19.055356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 967/1973] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:18 2022] PUT /identity/v3/projects/5b8415eff3434e4cadb2351020c9bd16/users/666b04f1f4584795bd14f2d84be5b291/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:19.057513 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af250ab3-feae-4220-9dc1-87757c4c3bc1 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:19.057787 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af250ab3-feae-4220-9dc1-87757c4c3bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:19.060943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af250ab3-feae-4220-9dc1-87757c4c3bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:19.110724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-af250ab3-feae-4220-9dc1-87757c4c3bc1 None None] MFA Rules not processed for user `666b04f1f4584795bd14f2d84be5b291`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:19.112080 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-af250ab3-feae-4220-9dc1-87757c4c3bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:19.225524 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1007/1974] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:19.256297 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af69f91-0e81-4a33-bec7-8d15498ac4a8 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:19.258046 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3af69f91-0e81-4a33-bec7-8d15498ac4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:19.317370 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af69f91-0e81-4a33-bec7-8d15498ac4a8 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:19.321336 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fae814-31d8-4b4b-9014-c43e87070947 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:19.321775 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fae814-31d8-4b4b-9014-c43e87070947 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:19.322061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fae814-31d8-4b4b-9014-c43e87070947 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:19.322336 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fae814-31d8-4b4b-9014-c43e87070947 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:19.331284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fae814-31d8-4b4b-9014-c43e87070947 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:19.332770 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fae814-31d8-4b4b-9014-c43e87070947 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:19.341970 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 968/1975] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:19.513883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af250ab3-feae-4220-9dc1-87757c4c3bc1 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:19.526849 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af250ab3-feae-4220-9dc1-87757c4c3bc1 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:19.531037 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33a1d1-1df5-4789-a425-7e8a87b32e62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:19.531893 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33a1d1-1df5-4789-a425-7e8a87b32e62 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:19.532366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33a1d1-1df5-4789-a425-7e8a87b32e62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:19.532861 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33a1d1-1df5-4789-a425-7e8a87b32e62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:19.535045 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5e33a1d1-1df5-4789-a425-7e8a87b32e62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:19.607231 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33a1d1-1df5-4789-a425-7e8a87b32e62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:19.608910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33a1d1-1df5-4789-a425-7e8a87b32e62 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:19.622752 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1008/1976] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:19.719780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:20.621016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fae814-31d8-4b4b-9014-c43e87070947 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:20.701067 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fae814-31d8-4b4b-9014-c43e87070947 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:20.709637 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6d27b-5cf9-47df-a6a7-d02b19eea2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:20.710404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6d27b-5cf9-47df-a6a7-d02b19eea2f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:20.710877 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6d27b-5cf9-47df-a6a7-d02b19eea2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:20.711159 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6d27b-5cf9-47df-a6a7-d02b19eea2f3 admin admin] PATH_INFO: `/v3/users/ecc18dd2ef254723ba8d406dbd702e4a` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:20.712383 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6d27b-5cf9-47df-a6a7-d02b19eea2f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecc18dd2ef254723ba8d406dbd702e4a)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:20.714576 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6d27b-5cf9-47df-a6a7-d02b19eea2f3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:20.751720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33a1d1-1df5-4789-a425-7e8a87b32e62 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:20.753262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5e33a1d1-1df5-4789-a425-7e8a87b32e62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:20.766730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33a1d1-1df5-4789-a425-7e8a87b32e62 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:20.773065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b9c59-2682-4f29-93a1-cf800185dee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:20.773721 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b9c59-2682-4f29-93a1-cf800185dee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:20.774554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b9c59-2682-4f29-93a1-cf800185dee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:20.774554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b9c59-2682-4f29-93a1-cf800185dee6 admin admin] PATH_INFO: `/v3/users/ccb8f6ed51e24fab820322136f929fe8` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:20.775561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b9c59-2682-4f29-93a1-cf800185dee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccb8f6ed51e24fab820322136f929fe8)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:20.777629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b9c59-2682-4f29-93a1-cf800185dee6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:20.805241 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:20.902725 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-33b6d27b-5cf9-47df-a6a7-d02b19eea2f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecc18dd2ef254723ba8d406dbd702e4a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:20.903453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-33b6d27b-5cf9-47df-a6a7-d02b19eea2f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecc18dd2ef254723ba8d406dbd702e4a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:20.916630 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-33b6d27b-5cf9-47df-a6a7-d02b19eea2f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecc18dd2ef254723ba8d406dbd702e4a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:20.925710 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-33b6d27b-5cf9-47df-a6a7-d02b19eea2f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecc18dd2ef254723ba8d406dbd702e4a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:20.999198 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-33b6d27b-5cf9-47df-a6a7-d02b19eea2f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecc18dd2ef254723ba8d406dbd702e4a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:21.007633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 969/1977] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:20 2022] DELETE /identity/v3/users/ecc18dd2ef254723ba8d406dbd702e4a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:21.012823 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df666f2-d033-4da6-b33c-4c781ab7630c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:21.013119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df666f2-d033-4da6-b33c-4c781ab7630c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:21.013400 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df666f2-d033-4da6-b33c-4c781ab7630c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:21.033469 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-2df666f2-d033-4da6-b33c-4c781ab7630c None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:21.039883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-812b9c59-2682-4f29-93a1-cf800185dee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccb8f6ed51e24fab820322136f929fe8'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:21.040325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2df666f2-d033-4da6-b33c-4c781ab7630c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:21.040465 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-812b9c59-2682-4f29-93a1-cf800185dee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccb8f6ed51e24fab820322136f929fe8'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:21.109590 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 970/1978] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:21.110449 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-812b9c59-2682-4f29-93a1-cf800185dee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccb8f6ed51e24fab820322136f929fe8'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:21.119767 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df666f2-d033-4da6-b33c-4c781ab7630c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:21.121653 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2df666f2-d033-4da6-b33c-4c781ab7630c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:21.125473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-812b9c59-2682-4f29-93a1-cf800185dee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccb8f6ed51e24fab820322136f929fe8'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:21.126177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-812b9c59-2682-4f29-93a1-cf800185dee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccb8f6ed51e24fab820322136f929fe8'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:21.139484 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1009/1979] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:20 2022] DELETE /identity/v3/users/ccb8f6ed51e24fab820322136f929fe8 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:21.143856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96cfd0-d699-4b41-8698-cf69eba96075 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:21.144148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96cfd0-d699-4b41-8698-cf69eba96075 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:21.144427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96cfd0-d699-4b41-8698-cf69eba96075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:21.164251 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-fb96cfd0-d699-4b41-8698-cf69eba96075 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:21.165506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fb96cfd0-d699-4b41-8698-cf69eba96075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:21.186287 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df666f2-d033-4da6-b33c-4c781ab7630c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:21.249491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1010/1980] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:21.256124 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:21.257694 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96cfd0-d699-4b41-8698-cf69eba96075 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:21.260425 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fb96cfd0-d699-4b41-8698-cf69eba96075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:21.280267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1e5b1-0f4d-4164-8c3e-7b3937cab14d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:21.282919 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1e5b1-0f4d-4164-8c3e-7b3937cab14d service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:21.283284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1e5b1-0f4d-4164-8c3e-7b3937cab14d service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:21.283635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1e5b1-0f4d-4164-8c3e-7b3937cab14d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:21.303504 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-84a1e5b1-0f4d-4164-8c3e-7b3937cab14d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:21.314313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1e5b1-0f4d-4164-8c3e-7b3937cab14d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:21.318353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1e5b1-0f4d-4164-8c3e-7b3937cab14d service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:21.333632 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 971/1981] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:24:21.347771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96cfd0-d699-4b41-8698-cf69eba96075 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:21.352379 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410cf08-d148-4c3b-b262-d52ba3afda75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:21.353112 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410cf08-d148-4c3b-b262-d52ba3afda75 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:21.353365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410cf08-d148-4c3b-b262-d52ba3afda75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:21.353652 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410cf08-d148-4c3b-b262-d52ba3afda75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:21.364968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410cf08-d148-4c3b-b262-d52ba3afda75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:21.366625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410cf08-d148-4c3b-b262-d52ba3afda75 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:21.381465 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1011/1982] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:21.985946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1e5b1-0f4d-4164-8c3e-7b3937cab14d service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:21.994014 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-84a1e5b1-0f4d-4164-8c3e-7b3937cab14d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:22.032773 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1e5b1-0f4d-4164-8c3e-7b3937cab14d service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:22.040772 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030e43d-eb72-4433-8285-ad1d86ef3144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:22.042781 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030e43d-eb72-4433-8285-ad1d86ef3144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:22.043569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030e43d-eb72-4433-8285-ad1d86ef3144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:22.043943 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030e43d-eb72-4433-8285-ad1d86ef3144 admin admin] PATH_INFO: `/v3/projects/d776a2e94c8c4dc8a24e26a477388ca9` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:22.045464 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030e43d-eb72-4433-8285-ad1d86ef3144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d776a2e94c8c4dc8a24e26a477388ca9)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:22.047888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030e43d-eb72-4433-8285-ad1d86ef3144 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:22.091565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410cf08-d148-4c3b-b262-d52ba3afda75 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:22.094171 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4410cf08-d148-4c3b-b262-d52ba3afda75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:22.109839 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410cf08-d148-4c3b-b262-d52ba3afda75 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:22.115352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3443fa2-372f-4fdd-98b6-0f4d309dc96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:22.116022 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3443fa2-372f-4fdd-98b6-0f4d309dc96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:22.116305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3443fa2-372f-4fdd-98b6-0f4d309dc96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:22.116587 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3443fa2-372f-4fdd-98b6-0f4d309dc96c admin admin] PATH_INFO: `/v3/projects/73e7c00389564946b847adf2eca850a9` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:22.117863 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3443fa2-372f-4fdd-98b6-0f4d309dc96c admin admin] RBAC: Authorizing `identity:delete_project(project_id=73e7c00389564946b847adf2eca850a9)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:22.119885 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3443fa2-372f-4fdd-98b6-0f4d309dc96c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:22.193802 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3030e43d-eb72-4433-8285-ad1d86ef3144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd776a2e94c8c4dc8a24e26a477388ca9', 'request_id': 'req-3030e43d-eb72-4433-8285-ad1d86ef3144'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:22.200201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3030e43d-eb72-4433-8285-ad1d86ef3144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd776a2e94c8c4dc8a24e26a477388ca9', 'request_id': 'req-3030e43d-eb72-4433-8285-ad1d86ef3144'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:22.205716 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3030e43d-eb72-4433-8285-ad1d86ef3144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd776a2e94c8c4dc8a24e26a477388ca9', 'request_id': 'req-3030e43d-eb72-4433-8285-ad1d86ef3144'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:22.270261 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d3443fa2-372f-4fdd-98b6-0f4d309dc96c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73e7c00389564946b847adf2eca850a9', 'request_id': 'req-d3443fa2-372f-4fdd-98b6-0f4d309dc96c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:22.276792 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d3443fa2-372f-4fdd-98b6-0f4d309dc96c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73e7c00389564946b847adf2eca850a9', 'request_id': 'req-d3443fa2-372f-4fdd-98b6-0f4d309dc96c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:22.282418 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d3443fa2-372f-4fdd-98b6-0f4d309dc96c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73e7c00389564946b847adf2eca850a9', 'request_id': 'req-d3443fa2-372f-4fdd-98b6-0f4d309dc96c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:22.315119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3030e43d-eb72-4433-8285-ad1d86ef3144 admin admin] The token cache is being invalidate because project d776a2e94c8c4dc8a24e26a477388ca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:22.316064 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3030e43d-eb72-4433-8285-ad1d86ef3144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:22.319337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3030e43d-eb72-4433-8285-ad1d86ef3144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:22.321331 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 972/1983] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:21 2022] DELETE /identity/v3/projects/d776a2e94c8c4dc8a24e26a477388ca9 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:22.327355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68323347-c653-4968-abcf-76f6cc436c45 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:22.327721 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68323347-c653-4968-abcf-76f6cc436c45 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:22.328128 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68323347-c653-4968-abcf-76f6cc436c45 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:22.329662 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 973/1984] 10.222.0.141 () {54 vars in 926 bytes} [Tue Jul 26 16:24:22 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:24:22.330729 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68323347-c653-4968-abcf-76f6cc436c45 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:22.332771 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-68323347-c653-4968-abcf-76f6cc436c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:22.415663 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68323347-c653-4968-abcf-76f6cc436c45 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:22.420431 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e54f67-4e88-4b7b-9f21-daddc06e1795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:22.421130 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e54f67-4e88-4b7b-9f21-daddc06e1795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:22.421420 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e54f67-4e88-4b7b-9f21-daddc06e1795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:22.421722 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e54f67-4e88-4b7b-9f21-daddc06e1795 admin admin] PATH_INFO: `/v3/users/f94da18a065c4b75957be56120e70e15` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:22.422894 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e54f67-4e88-4b7b-9f21-daddc06e1795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f94da18a065c4b75957be56120e70e15)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:22.424867 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e54f67-4e88-4b7b-9f21-daddc06e1795 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:22.432801 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:22.481438 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d3443fa2-372f-4fdd-98b6-0f4d309dc96c admin admin] The token cache is being invalidate because project 73e7c00389564946b847adf2eca850a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:22.481740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d3443fa2-372f-4fdd-98b6-0f4d309dc96c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:22.482557 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d3443fa2-372f-4fdd-98b6-0f4d309dc96c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:22.487042 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1012/1985] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:22 2022] DELETE /identity/v3/projects/73e7c00389564946b847adf2eca850a9 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:22.487042 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ae8ed-e6cc-4387-a643-a2664bac796f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:22.487042 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ae8ed-e6cc-4387-a643-a2664bac796f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:22.487042 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ae8ed-e6cc-4387-a643-a2664bac796f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:22.508723 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-4a6ae8ed-e6cc-4387-a643-a2664bac796f None None] MFA Rules not processed for user `fda05b7b9675423e992470819d1c150a`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:22.510003 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4a6ae8ed-e6cc-4387-a643-a2664bac796f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:22.579669 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1013/1986] 10.222.0.141 () {58 vars in 1023 bytes} [Tue Jul 26 16:24:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:22.580623 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ae8ed-e6cc-4387-a643-a2664bac796f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:22.581941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4a6ae8ed-e6cc-4387-a643-a2664bac796f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:22.599688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ae8ed-e6cc-4387-a643-a2664bac796f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:22.604811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbe153-8e90-45a1-a8f2-bd3f2a408d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:22.605453 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbe153-8e90-45a1-a8f2-bd3f2a408d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:22.605733 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbe153-8e90-45a1-a8f2-bd3f2a408d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:22.606028 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbe153-8e90-45a1-a8f2-bd3f2a408d52 admin admin] PATH_INFO: `/v3/users/e9a9d3861139460aa1c1b358c98ab615` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:22.607185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbe153-8e90-45a1-a8f2-bd3f2a408d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9a9d3861139460aa1c1b358c98ab615)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:22.609249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbe153-8e90-45a1-a8f2-bd3f2a408d52 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:22.714895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-12e54f67-4e88-4b7b-9f21-daddc06e1795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f94da18a065c4b75957be56120e70e15'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:22.715574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-12e54f67-4e88-4b7b-9f21-daddc06e1795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f94da18a065c4b75957be56120e70e15'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:22.727797 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-12e54f67-4e88-4b7b-9f21-daddc06e1795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f94da18a065c4b75957be56120e70e15'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:22.734482 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-12e54f67-4e88-4b7b-9f21-daddc06e1795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f94da18a065c4b75957be56120e70e15'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:22.783579 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-56fbe153-8e90-45a1-a8f2-bd3f2a408d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9a9d3861139460aa1c1b358c98ab615'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:22.784254 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-56fbe153-8e90-45a1-a8f2-bd3f2a408d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9a9d3861139460aa1c1b358c98ab615'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:22.795467 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-12e54f67-4e88-4b7b-9f21-daddc06e1795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f94da18a065c4b75957be56120e70e15'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:22.802126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 974/1987] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:22 2022] DELETE /identity/v3/users/f94da18a065c4b75957be56120e70e15 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:22.802932 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e54f67-4e88-4b7b-9f21-daddc06e1795 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:22.804291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-12e54f67-4e88-4b7b-9f21-daddc06e1795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:22.869229 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e54f67-4e88-4b7b-9f21-daddc06e1795 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:22.873795 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:22.874404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-56fbe153-8e90-45a1-a8f2-bd3f2a408d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9a9d3861139460aa1c1b358c98ab615'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:22.875977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f376813-bd67-46af-aa3b-f221b1ec1a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:22.876633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f376813-bd67-46af-aa3b-f221b1ec1a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:22.876951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f376813-bd67-46af-aa3b-f221b1ec1a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:22.877237 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f376813-bd67-46af-aa3b-f221b1ec1a28 admin admin] PATH_INFO: `/v3/users/6a56919ded5645c290058d80ddc97f76` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:22.878628 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f376813-bd67-46af-aa3b-f221b1ec1a28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a56919ded5645c290058d80ddc97f76)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:22.880904 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f376813-bd67-46af-aa3b-f221b1ec1a28 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:22.888883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-56fbe153-8e90-45a1-a8f2-bd3f2a408d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9a9d3861139460aa1c1b358c98ab615'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:22.889872 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-56fbe153-8e90-45a1-a8f2-bd3f2a408d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9a9d3861139460aa1c1b358c98ab615'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:22.903927 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1014/1988] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:22 2022] DELETE /identity/v3/users/e9a9d3861139460aa1c1b358c98ab615 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:22.905136 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbe153-8e90-45a1-a8f2-bd3f2a408d52 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:22.906710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-56fbe153-8e90-45a1-a8f2-bd3f2a408d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:22.985774 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbe153-8e90-45a1-a8f2-bd3f2a408d52 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:22.991668 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d22eeb-84ff-44f4-91e7-febd1347696d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda05b7b9675423e992470819d1c150a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:22.995654 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d22eeb-84ff-44f4-91e7-febd1347696d service placement] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:22.995654 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d22eeb-84ff-44f4-91e7-febd1347696d service placement] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:22.995654 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d22eeb-84ff-44f4-91e7-febd1347696d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:22.995654 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d8d22eeb-84ff-44f4-91e7-febd1347696d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:23.007064 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d22eeb-84ff-44f4-91e7-febd1347696d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:23.008923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d22eeb-84ff-44f4-91e7-febd1347696d service placement] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:23.019094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1015/1989] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:23.101086 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5f376813-bd67-46af-aa3b-f221b1ec1a28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a56919ded5645c290058d80ddc97f76'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:23.102051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5f376813-bd67-46af-aa3b-f221b1ec1a28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a56919ded5645c290058d80ddc97f76'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:23.115930 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5f376813-bd67-46af-aa3b-f221b1ec1a28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a56919ded5645c290058d80ddc97f76'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:23.124007 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5f376813-bd67-46af-aa3b-f221b1ec1a28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a56919ded5645c290058d80ddc97f76'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:23.238919 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5f376813-bd67-46af-aa3b-f221b1ec1a28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a56919ded5645c290058d80ddc97f76'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:23.249265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 975/1990] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:22 2022] DELETE /identity/v3/users/6a56919ded5645c290058d80ddc97f76 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:23.252720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d22eeb-84ff-44f4-91e7-febd1347696d service placement] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:23.255455 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d8d22eeb-84ff-44f4-91e7-febd1347696d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:23.349173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d22eeb-84ff-44f4-91e7-febd1347696d service placement] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:23.410378 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19356e-d895-4648-95a7-37eac2d4d817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:23.411240 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19356e-d895-4648-95a7-37eac2d4d817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:23.411665 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19356e-d895-4648-95a7-37eac2d4d817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:23.412219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19356e-d895-4648-95a7-37eac2d4d817 admin admin] PATH_INFO: `/v3/projects/40ed5dfc461d41738debf5303cd2e08b` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:23.413579 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19356e-d895-4648-95a7-37eac2d4d817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40ed5dfc461d41738debf5303cd2e08b)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:23.415807 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19356e-d895-4648-95a7-37eac2d4d817 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:23.479789 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f376813-bd67-46af-aa3b-f221b1ec1a28 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:23.481473 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5f376813-bd67-46af-aa3b-f221b1ec1a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:23.495944 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f376813-bd67-46af-aa3b-f221b1ec1a28 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:23.500193 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06a683-5fbc-4d35-8f00-46d33509fea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:23.500931 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06a683-5fbc-4d35-8f00-46d33509fea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:23.501219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06a683-5fbc-4d35-8f00-46d33509fea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:23.501499 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06a683-5fbc-4d35-8f00-46d33509fea8 admin admin] PATH_INFO: `/v3/projects/65842f6f65904b7582781dc0e0898969` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:23.503019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06a683-5fbc-4d35-8f00-46d33509fea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65842f6f65904b7582781dc0e0898969)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:23.505751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06a683-5fbc-4d35-8f00-46d33509fea8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:23.560969 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ae19356e-d895-4648-95a7-37eac2d4d817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40ed5dfc461d41738debf5303cd2e08b', 'request_id': 'req-ae19356e-d895-4648-95a7-37eac2d4d817'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:23.568208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ae19356e-d895-4648-95a7-37eac2d4d817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40ed5dfc461d41738debf5303cd2e08b', 'request_id': 'req-ae19356e-d895-4648-95a7-37eac2d4d817'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:23.573855 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ae19356e-d895-4648-95a7-37eac2d4d817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40ed5dfc461d41738debf5303cd2e08b', 'request_id': 'req-ae19356e-d895-4648-95a7-37eac2d4d817'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:23.635521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2b06a683-5fbc-4d35-8f00-46d33509fea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65842f6f65904b7582781dc0e0898969', 'request_id': 'req-2b06a683-5fbc-4d35-8f00-46d33509fea8'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:23.642157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2b06a683-5fbc-4d35-8f00-46d33509fea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65842f6f65904b7582781dc0e0898969', 'request_id': 'req-2b06a683-5fbc-4d35-8f00-46d33509fea8'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:23.647921 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2b06a683-5fbc-4d35-8f00-46d33509fea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65842f6f65904b7582781dc0e0898969', 'request_id': 'req-2b06a683-5fbc-4d35-8f00-46d33509fea8'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:23.678367 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ae19356e-d895-4648-95a7-37eac2d4d817 admin admin] The token cache is being invalidate because project 40ed5dfc461d41738debf5303cd2e08b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:23.678656 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ae19356e-d895-4648-95a7-37eac2d4d817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:23.679303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ae19356e-d895-4648-95a7-37eac2d4d817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:23.684248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1016/1991] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:23 2022] DELETE /identity/v3/projects/40ed5dfc461d41738debf5303cd2e08b => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:23.684248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19356e-d895-4648-95a7-37eac2d4d817 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:23.684248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ae19356e-d895-4648-95a7-37eac2d4d817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:23.764046 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19356e-d895-4648-95a7-37eac2d4d817 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:23.769317 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2b06a683-5fbc-4d35-8f00-46d33509fea8 admin admin] The token cache is being invalidate because project 65842f6f65904b7582781dc0e0898969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:23.769615 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2b06a683-5fbc-4d35-8f00-46d33509fea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:23.770401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2b06a683-5fbc-4d35-8f00-46d33509fea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:23.773188 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 976/1992] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:23 2022] DELETE /identity/v3/projects/65842f6f65904b7582781dc0e0898969 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:23.773408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279f577-df7e-439d-ae8c-b1a2b0135d7b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:23.773699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279f577-df7e-439d-ae8c-b1a2b0135d7b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:23.773978 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279f577-df7e-439d-ae8c-b1a2b0135d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:23.794158 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-4279f577-df7e-439d-ae8c-b1a2b0135d7b None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:23.795528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4279f577-df7e-439d-ae8c-b1a2b0135d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:23.826098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1ddda-23d3-47a3-9ddc-4bfc025eed56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:23.826747 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1ddda-23d3-47a3-9ddc-4bfc025eed56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:23.827029 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1ddda-23d3-47a3-9ddc-4bfc025eed56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:23.827300 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1ddda-23d3-47a3-9ddc-4bfc025eed56 admin admin] PATH_INFO: `/v3/projects/0ed9eba09a214f8dab70ed53a07d798b` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:23.828495 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1ddda-23d3-47a3-9ddc-4bfc025eed56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ed9eba09a214f8dab70ed53a07d798b)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:23.830532 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1ddda-23d3-47a3-9ddc-4bfc025eed56 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:23.858268 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 977/1993] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:23.859655 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d2bdf-88bc-4305-98c4-05727c34facb None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:23.859945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d2bdf-88bc-4305-98c4-05727c34facb None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:23.860221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d2bdf-88bc-4305-98c4-05727c34facb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:23.880370 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e13d2bdf-88bc-4305-98c4-05727c34facb None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:23.881873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e13d2bdf-88bc-4305-98c4-05727c34facb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:23.889883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 978/1994] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:23.891155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc625060-43f4-46fd-bcb2-6b97ff29b816 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:23.891491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc625060-43f4-46fd-bcb2-6b97ff29b816 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:23.891764 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc625060-43f4-46fd-bcb2-6b97ff29b816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:23.911741 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-fc625060-43f4-46fd-bcb2-6b97ff29b816 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:23.913055 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fc625060-43f4-46fd-bcb2-6b97ff29b816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:23.921451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 979/1995] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:23.922690 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc8321-456a-4979-a926-ac3f18744927 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:23.922976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc8321-456a-4979-a926-ac3f18744927 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:23.923249 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc8321-456a-4979-a926-ac3f18744927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:23.942989 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b3dc8321-456a-4979-a926-ac3f18744927 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:23.944983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b3dc8321-456a-4979-a926-ac3f18744927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:23.956052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 980/1996] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:23.956052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc8321-456a-4979-a926-ac3f18744927 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:23.962062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-38b1ddda-23d3-47a3-9ddc-4bfc025eed56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ed9eba09a214f8dab70ed53a07d798b', 'request_id': 'req-38b1ddda-23d3-47a3-9ddc-4bfc025eed56'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:23.963390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc8321-456a-4979-a926-ac3f18744927 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:23.968397 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-38b1ddda-23d3-47a3-9ddc-4bfc025eed56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ed9eba09a214f8dab70ed53a07d798b', 'request_id': 'req-38b1ddda-23d3-47a3-9ddc-4bfc025eed56'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:23.974737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-38b1ddda-23d3-47a3-9ddc-4bfc025eed56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ed9eba09a214f8dab70ed53a07d798b', 'request_id': 'req-38b1ddda-23d3-47a3-9ddc-4bfc025eed56'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:24.020544 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f253d-09b8-44b4-9c61-b2c78002069f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:24.021229 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f253d-09b8-44b4-9c61-b2c78002069f admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:24.024040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f253d-09b8-44b4-9c61-b2c78002069f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:24.024040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f253d-09b8-44b4-9c61-b2c78002069f admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:24.024040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f253d-09b8-44b4-9c61-b2c78002069f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:24.024040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f253d-09b8-44b4-9c61-b2c78002069f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:24.024433 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f253d-09b8-44b4-9c61-b2c78002069f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:24.036103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 981/1997] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:24:24.036919 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f253d-09b8-44b4-9c61-b2c78002069f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:24.046297 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f253d-09b8-44b4-9c61-b2c78002069f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:24.049171 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-38b1ddda-23d3-47a3-9ddc-4bfc025eed56 admin admin] The token cache is being invalidate because project 0ed9eba09a214f8dab70ed53a07d798b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:24.049468 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-38b1ddda-23d3-47a3-9ddc-4bfc025eed56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:24.050102 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-38b1ddda-23d3-47a3-9ddc-4bfc025eed56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:24.052104 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25862371-46ea-43dd-98bd-eacffe3aef62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:24.055625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1017/1998] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:23 2022] DELETE /identity/v3/projects/0ed9eba09a214f8dab70ed53a07d798b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:24.055757 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25862371-46ea-43dd-98bd-eacffe3aef62 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:24.055757 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25862371-46ea-43dd-98bd-eacffe3aef62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:24.055757 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25862371-46ea-43dd-98bd-eacffe3aef62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:24.055982 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1ddda-23d3-47a3-9ddc-4bfc025eed56 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:24.065529 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25862371-46ea-43dd-98bd-eacffe3aef62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:24.065529 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25862371-46ea-43dd-98bd-eacffe3aef62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:24.066257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-38b1ddda-23d3-47a3-9ddc-4bfc025eed56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:24.066362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25862371-46ea-43dd-98bd-eacffe3aef62 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:24.067779 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1ddda-23d3-47a3-9ddc-4bfc025eed56 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:24.068709 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 982/1999] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:24:24.069526 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25862371-46ea-43dd-98bd-eacffe3aef62 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:24.071114 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-25862371-46ea-43dd-98bd-eacffe3aef62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:24.073171 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daad3e-c089-44c3-8f03-c97a7c83f186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:24.074001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daad3e-c089-44c3-8f03-c97a7c83f186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:24.074289 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daad3e-c089-44c3-8f03-c97a7c83f186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:24.074616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daad3e-c089-44c3-8f03-c97a7c83f186 admin admin] PATH_INFO: `/v3/users/666b04f1f4584795bd14f2d84be5b291` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:24.075820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7daad3e-c089-44c3-8f03-c97a7c83f186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=666b04f1f4584795bd14f2d84be5b291)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:24.077795 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7daad3e-c089-44c3-8f03-c97a7c83f186 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:24.084285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25862371-46ea-43dd-98bd-eacffe3aef62 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:24.088998 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374507ac-1e95-4722-9fa8-156115c62840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:24.089614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374507ac-1e95-4722-9fa8-156115c62840 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:24.089901 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374507ac-1e95-4722-9fa8-156115c62840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:24.090179 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374507ac-1e95-4722-9fa8-156115c62840 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:24.095354 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374507ac-1e95-4722-9fa8-156115c62840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:24.095354 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374507ac-1e95-4722-9fa8-156115c62840 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:24.166359 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 983/2000] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:24 2022] POST /identity/v3/projects => generated 386 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:24.167604 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e945f2-5597-4ae2-923d-5fd3235b729e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:24.167899 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e945f2-5597-4ae2-923d-5fd3235b729e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:24.168454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e945f2-5597-4ae2-923d-5fd3235b729e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:24.187437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-83e945f2-5597-4ae2-923d-5fd3235b729e None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:24.188647 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-83e945f2-5597-4ae2-923d-5fd3235b729e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:24.246831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 984/2001] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:24.247721 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e945f2-5597-4ae2-923d-5fd3235b729e None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:24.248971 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-83e945f2-5597-4ae2-923d-5fd3235b729e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:24.260724 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e945f2-5597-4ae2-923d-5fd3235b729e None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:24.265347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd79c64-08ce-42af-93c2-3f8e10c7fa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:24.265979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd79c64-08ce-42af-93c2-3f8e10c7fa08 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:24.266266 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd79c64-08ce-42af-93c2-3f8e10c7fa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:24.266552 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd79c64-08ce-42af-93c2-3f8e10c7fa08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:24.267319 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd79c64-08ce-42af-93c2-3f8e10c7fa08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:24.269163 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd79c64-08ce-42af-93c2-3f8e10c7fa08 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:24.269507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f7daad3e-c089-44c3-8f03-c97a7c83f186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '666b04f1f4584795bd14f2d84be5b291'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:24.270716 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f7daad3e-c089-44c3-8f03-c97a7c83f186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '666b04f1f4584795bd14f2d84be5b291'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:24.398222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f7daad3e-c089-44c3-8f03-c97a7c83f186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '666b04f1f4584795bd14f2d84be5b291'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:24.408893 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 985/2002] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:24 2022] POST /identity/v3/projects => generated 376 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:24.408893 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd79c64-08ce-42af-93c2-3f8e10c7fa08 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:24.412127 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f7daad3e-c089-44c3-8f03-c97a7c83f186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '666b04f1f4584795bd14f2d84be5b291'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:24.412884 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f7daad3e-c089-44c3-8f03-c97a7c83f186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '666b04f1f4584795bd14f2d84be5b291'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:24.426472 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1018/2003] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:24 2022] DELETE /identity/v3/users/666b04f1f4584795bd14f2d84be5b291 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:24.427832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10afff-2d14-455e-b7e1-f91c8109fb29 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:24.428211 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10afff-2d14-455e-b7e1-f91c8109fb29 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:24.428591 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10afff-2d14-455e-b7e1-f91c8109fb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:24.448467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-ed10afff-2d14-455e-b7e1-f91c8109fb29 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:24.451329 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ed10afff-2d14-455e-b7e1-f91c8109fb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:24.468285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd79c64-08ce-42af-93c2-3f8e10c7fa08 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:24.510195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1019/2004] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:24.511096 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10afff-2d14-455e-b7e1-f91c8109fb29 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:24.512434 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ed10afff-2d14-455e-b7e1-f91c8109fb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:24.524277 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b11cb-b029-4494-819c-6a25fc649fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:24.524785 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10afff-2d14-455e-b7e1-f91c8109fb29 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:24.524925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b11cb-b029-4494-819c-6a25fc649fdd admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:24.525204 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b11cb-b029-4494-819c-6a25fc649fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:24.525543 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b11cb-b029-4494-819c-6a25fc649fdd admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:24.526196 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b11cb-b029-4494-819c-6a25fc649fdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:24.528105 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b11cb-b029-4494-819c-6a25fc649fdd admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:24.529488 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb98d9-8629-4024-8109-ea382d89b101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:24.530107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb98d9-8629-4024-8109-ea382d89b101 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:24.530392 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb98d9-8629-4024-8109-ea382d89b101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:24.530670 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb98d9-8629-4024-8109-ea382d89b101 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:24.531331 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb98d9-8629-4024-8109-ea382d89b101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:24.533266 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb98d9-8629-4024-8109-ea382d89b101 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:24.646513 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 986/2005] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:24 2022] POST /identity/v3/users => generated 294 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:24.646513 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1939b84-b5e3-49aa-a979-5e2e8f9ba8b2 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:24.646513 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1939b84-b5e3-49aa-a979-5e2e8f9ba8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:24.646513 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1939b84-b5e3-49aa-a979-5e2e8f9ba8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:24.665158 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a1939b84-b5e3-49aa-a979-5e2e8f9ba8b2 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:24.670419 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a1939b84-b5e3-49aa-a979-5e2e8f9ba8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:24.670419 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:24.673306 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1020/2006] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:24 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:24.674745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb98d9-8629-4024-8109-ea382d89b101 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:24.683359 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 987/2007] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:24.684485 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1939b84-b5e3-49aa-a979-5e2e8f9ba8b2 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:24.686006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a1939b84-b5e3-49aa-a979-5e2e8f9ba8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:24.695338 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb98d9-8629-4024-8109-ea382d89b101 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:24.699231 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1939b84-b5e3-49aa-a979-5e2e8f9ba8b2 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:24.700457 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcca8f-8f83-4a75-a012-42d9348422f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:24.701280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcca8f-8f83-4a75-a012-42d9348422f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:24.701672 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcca8f-8f83-4a75-a012-42d9348422f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:24.702052 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcca8f-8f83-4a75-a012-42d9348422f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:24.702982 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a4776-3a8a-4221-88a4-5f93705f547e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:24.703119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcca8f-8f83-4a75-a012-42d9348422f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:24.703324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcca8f-8f83-4a75-a012-42d9348422f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:24.703537 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a4776-3a8a-4221-88a4-5f93705f547e admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:24.703815 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a4776-3a8a-4221-88a4-5f93705f547e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:24.704087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a4776-3a8a-4221-88a4-5f93705f547e admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:24.704821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a4776-3a8a-4221-88a4-5f93705f547e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:24.704983 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcca8f-8f83-4a75-a012-42d9348422f0 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:24.706513 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a4776-3a8a-4221-88a4-5f93705f547e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:24.721275 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 988/2008] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:24 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:24.721489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1021/2009] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:24:24.721489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcca8f-8f83-4a75-a012-42d9348422f0 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:24.721631 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a4776-3a8a-4221-88a4-5f93705f547e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:24.723795 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f3fcca8f-8f83-4a75-a012-42d9348422f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:24.733872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a4776-3a8a-4221-88a4-5f93705f547e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:24.737311 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1697ff-c6fa-4dd5-b870-437d5546b4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:24.737959 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1697ff-c6fa-4dd5-b870-437d5546b4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:24.738260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1697ff-c6fa-4dd5-b870-437d5546b4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:24.738536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1697ff-c6fa-4dd5-b870-437d5546b4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:24.739967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1697ff-c6fa-4dd5-b870-437d5546b4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:24.741593 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1697ff-c6fa-4dd5-b870-437d5546b4c8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:24.753087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 989/2010] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:24 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:24.754163 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1697ff-c6fa-4dd5-b870-437d5546b4c8 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:24.765242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1697ff-c6fa-4dd5-b870-437d5546b4c8 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:24.770829 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4b68b-6570-43c9-bbfb-cf6c13d04533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:24.771518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4b68b-6570-43c9-bbfb-cf6c13d04533 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:24.771885 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4b68b-6570-43c9-bbfb-cf6c13d04533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:24.772228 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4b68b-6570-43c9-bbfb-cf6c13d04533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:24.773026 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4b68b-6570-43c9-bbfb-cf6c13d04533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:24.774806 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4b68b-6570-43c9-bbfb-cf6c13d04533 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:24.787734 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 990/2011] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:24 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:24.788480 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4b68b-6570-43c9-bbfb-cf6c13d04533 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:24.794227 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcca8f-8f83-4a75-a012-42d9348422f0 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:24.798148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810c9ef-2ee9-477c-9f02-080329d8a50f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:24.798946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810c9ef-2ee9-477c-9f02-080329d8a50f service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:24.799050 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4b68b-6570-43c9-bbfb-cf6c13d04533 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:24.799234 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810c9ef-2ee9-477c-9f02-080329d8a50f service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:24.799513 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810c9ef-2ee9-477c-9f02-080329d8a50f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:24.805269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e182c73-1736-43b4-9708-dbbcfb8a3a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:24.805959 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e182c73-1736-43b4-9708-dbbcfb8a3a6a admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:24.806312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e182c73-1736-43b4-9708-dbbcfb8a3a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:24.807491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e182c73-1736-43b4-9708-dbbcfb8a3a6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:24.807491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e182c73-1736-43b4-9708-dbbcfb8a3a6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:24.809525 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e182c73-1736-43b4-9708-dbbcfb8a3a6a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:24.810266 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810c9ef-2ee9-477c-9f02-080329d8a50f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:24.811726 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810c9ef-2ee9-477c-9f02-080329d8a50f service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:24.823716 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1022/2012] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:24.824766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810c9ef-2ee9-477c-9f02-080329d8a50f service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:24.834883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810c9ef-2ee9-477c-9f02-080329d8a50f service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:24.840739 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ecee2-753c-4655-a449-9e598d89277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:24.845225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ecee2-753c-4655-a449-9e598d89277b admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:24.845225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ecee2-753c-4655-a449-9e598d89277b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:24.845225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ecee2-753c-4655-a449-9e598d89277b admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:24.845225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ecee2-753c-4655-a449-9e598d89277b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:24.847115 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ecee2-753c-4655-a449-9e598d89277b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:24.859911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1023/2013] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:24 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:24.861570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ecee2-753c-4655-a449-9e598d89277b admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:24.871167 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ecee2-753c-4655-a449-9e598d89277b admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:24.875955 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9ee05-52ad-4ef3-87be-0fce4023e6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:24.876614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9ee05-52ad-4ef3-87be-0fce4023e6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:24.876921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9ee05-52ad-4ef3-87be-0fce4023e6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:24.877197 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9ee05-52ad-4ef3-87be-0fce4023e6e2 admin admin] PATH_INFO: `/v3/projects/1c01859164e246429b9eed524cb74712/users/28f38ab3ba7a45558ad2fdc8ca22402d/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:24.892843 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9ee05-52ad-4ef3-87be-0fce4023e6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c01859164e246429b9eed524cb74712, user_id=28f38ab3ba7a45558ad2fdc8ca22402d, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:24.896462 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9ee05-52ad-4ef3-87be-0fce4023e6e2 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:24.901152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 991/2014] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:24 2022] POST /identity/v3/projects => generated 404 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:24.901769 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e182c73-1736-43b4-9708-dbbcfb8a3a6a admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:24.965473 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e182c73-1736-43b4-9708-dbbcfb8a3a6a admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:24.968877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1024/2015] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:24 2022] PUT /identity/v3/projects/1c01859164e246429b9eed524cb74712/users/28f38ab3ba7a45558ad2fdc8ca22402d/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:24.969837 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9ee05-52ad-4ef3-87be-0fce4023e6e2 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:25.037863 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:25.063373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9ee05-52ad-4ef3-87be-0fce4023e6e2 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:25.068253 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3950eb-644c-441c-b988-a9283edb9ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:25.069537 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3950eb-644c-441c-b988-a9283edb9ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:25.075772 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3950eb-644c-441c-b988-a9283edb9ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:25.075772 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3950eb-644c-441c-b988-a9283edb9ac3 admin admin] PATH_INFO: `/v3/projects/bd43e91a4470464281189e2e68fd2ecd/users/05c2de23718347f2a2895f144998831c/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:25.076203 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29386a-e4cc-4484-8352-a4deb27e6696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:25.076203 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29386a-e4cc-4484-8352-a4deb27e6696 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:25.076203 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29386a-e4cc-4484-8352-a4deb27e6696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:25.076203 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29386a-e4cc-4484-8352-a4deb27e6696 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:25.076746 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29386a-e4cc-4484-8352-a4deb27e6696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:25.076746 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29386a-e4cc-4484-8352-a4deb27e6696 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:25.088193 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3950eb-644c-441c-b988-a9283edb9ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd43e91a4470464281189e2e68fd2ecd, user_id=05c2de23718347f2a2895f144998831c, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:25.090966 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3950eb-644c-441c-b988-a9283edb9ac3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:25.172696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1025/2016] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:24 2022] POST /identity/v3/users => generated 303 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:25.181560 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78931152-9420-4417-b3a3-d74d2be7f2f6 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:25.181724 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 992/2017] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:24 2022] PUT /identity/v3/projects/bd43e91a4470464281189e2e68fd2ecd/users/05c2de23718347f2a2895f144998831c/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:25.182174 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78931152-9420-4417-b3a3-d74d2be7f2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:25.182174 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78931152-9420-4417-b3a3-d74d2be7f2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:25.182330 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3950eb-644c-441c-b988-a9283edb9ac3 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:25.208296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-78931152-9420-4417-b3a3-d74d2be7f2f6 None None] MFA Rules not processed for user `28f38ab3ba7a45558ad2fdc8ca22402d`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:25.209488 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-78931152-9420-4417-b3a3-d74d2be7f2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:25.238039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3950eb-644c-441c-b988-a9283edb9ac3 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:25.243131 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a1cf6-3181-41e1-9fc6-827d5331641e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:25.243762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a1cf6-3181-41e1-9fc6-827d5331641e admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:25.244043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a1cf6-3181-41e1-9fc6-827d5331641e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:25.244318 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a1cf6-3181-41e1-9fc6-827d5331641e admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:25.245112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a1cf6-3181-41e1-9fc6-827d5331641e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:25.246815 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a1cf6-3181-41e1-9fc6-827d5331641e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:25.261436 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 993/2018] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:25 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:24:25.261436 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4052dd-a2fa-45bd-ba58-bd4caffe2e49 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:25.261436 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4052dd-a2fa-45bd-ba58-bd4caffe2e49 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:25.261436 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4052dd-a2fa-45bd-ba58-bd4caffe2e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:25.278791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1026/2019] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:25.278791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78931152-9420-4417-b3a3-d74d2be7f2f6 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:25.289907 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78931152-9420-4417-b3a3-d74d2be7f2f6 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:25.294518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-4d4052dd-a2fa-45bd-ba58-bd4caffe2e49 None None] MFA Rules not processed for user `05c2de23718347f2a2895f144998831c`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:25.302002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4d4052dd-a2fa-45bd-ba58-bd4caffe2e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:25.302257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af28ab4-8e69-4007-8c63-27a2f605dc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:25.302257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af28ab4-8e69-4007-8c63-27a2f605dc73 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:25.302257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af28ab4-8e69-4007-8c63-27a2f605dc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:25.302257 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af28ab4-8e69-4007-8c63-27a2f605dc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:25.302590 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af28ab4-8e69-4007-8c63-27a2f605dc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:25.302590 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af28ab4-8e69-4007-8c63-27a2f605dc73 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:25.312825 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1027/2020] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:25 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:25.314076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af28ab4-8e69-4007-8c63-27a2f605dc73 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:25.326116 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af28ab4-8e69-4007-8c63-27a2f605dc73 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:25.331202 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d7377-6d19-46f8-aa0d-edc4955963a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:25.331870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d7377-6d19-46f8-aa0d-edc4955963a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:25.332154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d7377-6d19-46f8-aa0d-edc4955963a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:25.332444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d7377-6d19-46f8-aa0d-edc4955963a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:25.333775 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d7377-6d19-46f8-aa0d-edc4955963a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:25.335722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d7377-6d19-46f8-aa0d-edc4955963a2 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:25.366285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 994/2021] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:25.367273 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4052dd-a2fa-45bd-ba58-bd4caffe2e49 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:25.368574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4d4052dd-a2fa-45bd-ba58-bd4caffe2e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:25.382011 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4052dd-a2fa-45bd-ba58-bd4caffe2e49 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:25.386652 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750ddc6-22e3-4fac-9360-8bfb2ea1df9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:25.387280 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750ddc6-22e3-4fac-9360-8bfb2ea1df9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:25.387563 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750ddc6-22e3-4fac-9360-8bfb2ea1df9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:25.387839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750ddc6-22e3-4fac-9360-8bfb2ea1df9e admin admin] PATH_INFO: `/v3/projects/5b8415eff3434e4cadb2351020c9bd16` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:25.389022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750ddc6-22e3-4fac-9360-8bfb2ea1df9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b8415eff3434e4cadb2351020c9bd16)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:25.390933 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750ddc6-22e3-4fac-9360-8bfb2ea1df9e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:25.439602 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1028/2022] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:25 2022] POST /identity/v3/projects => generated 386 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:25.440408 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d7377-6d19-46f8-aa0d-edc4955963a2 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:25.502060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d7377-6d19-46f8-aa0d-edc4955963a2 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:25.507443 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b17409-1b0c-42d6-ae37-7137cb907ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:25.508110 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b17409-1b0c-42d6-ae37-7137cb907ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:25.513155 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b17409-1b0c-42d6-ae37-7137cb907ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:25.513155 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b17409-1b0c-42d6-ae37-7137cb907ccc admin admin] PATH_INFO: `/v3/projects/2f56ae703e9d4e4aad4937a0c7189d29/users/ce1eeb9ceae34604944cc00704c6df83/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:25.519023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e750ddc6-22e3-4fac-9360-8bfb2ea1df9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b8415eff3434e4cadb2351020c9bd16', 'request_id': 'req-e750ddc6-22e3-4fac-9360-8bfb2ea1df9e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:25.523847 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b17409-1b0c-42d6-ae37-7137cb907ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f56ae703e9d4e4aad4937a0c7189d29, user_id=ce1eeb9ceae34604944cc00704c6df83, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:25.526022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e750ddc6-22e3-4fac-9360-8bfb2ea1df9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b8415eff3434e4cadb2351020c9bd16', 'request_id': 'req-e750ddc6-22e3-4fac-9360-8bfb2ea1df9e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:25.526590 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b17409-1b0c-42d6-ae37-7137cb907ccc admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:25.531696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e750ddc6-22e3-4fac-9360-8bfb2ea1df9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b8415eff3434e4cadb2351020c9bd16', 'request_id': 'req-e750ddc6-22e3-4fac-9360-8bfb2ea1df9e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:25.601496 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1029/2023] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:25 2022] PUT /identity/v3/projects/2f56ae703e9d4e4aad4937a0c7189d29/users/ce1eeb9ceae34604944cc00704c6df83/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:25.602440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b17409-1b0c-42d6-ae37-7137cb907ccc admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:25.656348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e750ddc6-22e3-4fac-9360-8bfb2ea1df9e admin admin] The token cache is being invalidate because project 5b8415eff3434e4cadb2351020c9bd16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:25.662380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e750ddc6-22e3-4fac-9360-8bfb2ea1df9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:25.662380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e750ddc6-22e3-4fac-9360-8bfb2ea1df9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:25.662380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 995/2024] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:25 2022] DELETE /identity/v3/projects/5b8415eff3434e4cadb2351020c9bd16 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:25.662380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750ddc6-22e3-4fac-9360-8bfb2ea1df9e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:25.662380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e750ddc6-22e3-4fac-9360-8bfb2ea1df9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:25.663583 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b17409-1b0c-42d6-ae37-7137cb907ccc admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:25.668533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd00ddb-9117-4b10-8b45-098afffde364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:25.669177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd00ddb-9117-4b10-8b45-098afffde364 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:25.669452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd00ddb-9117-4b10-8b45-098afffde364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:25.669719 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd00ddb-9117-4b10-8b45-098afffde364 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:25.670372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd00ddb-9117-4b10-8b45-098afffde364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:25.672431 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd00ddb-9117-4b10-8b45-098afffde364 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:25.709934 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:25.725779 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750ddc6-22e3-4fac-9360-8bfb2ea1df9e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:25.730537 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b922d7-fced-4d2b-ac77-71c0c8ac147f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:25.731207 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b922d7-fced-4d2b-ac77-71c0c8ac147f admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:25.731441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b922d7-fced-4d2b-ac77-71c0c8ac147f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:25.731716 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b922d7-fced-4d2b-ac77-71c0c8ac147f admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:25.732382 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b922d7-fced-4d2b-ac77-71c0c8ac147f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:25.734338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b922d7-fced-4d2b-ac77-71c0c8ac147f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:25.780073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1030/2025] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:25 2022] POST /identity/v3/projects => generated 376 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:25.780073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958524c-9c12-4b45-b428-08b2b122c7ba None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:25.780073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958524c-9c12-4b45-b428-08b2b122c7ba None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:25.780073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958524c-9c12-4b45-b428-08b2b122c7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:25.808085 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f958524c-9c12-4b45-b428-08b2b122c7ba None None] MFA Rules not processed for user `ce1eeb9ceae34604944cc00704c6df83`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:25.809372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f958524c-9c12-4b45-b428-08b2b122c7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:25.853401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 996/2026] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:25 2022] POST /identity/v3/users => generated 300 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:25.854583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a17a4-132a-441b-bdcc-60617ee47055 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:25.854868 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a17a4-132a-441b-bdcc-60617ee47055 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:25.855145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a17a4-132a-441b-bdcc-60617ee47055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:25.876873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-073a17a4-132a-441b-bdcc-60617ee47055 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:25.878108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-073a17a4-132a-441b-bdcc-60617ee47055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:25.879552 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1031/2027] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:25 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:25.885227 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958524c-9c12-4b45-b428-08b2b122c7ba None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:25.889791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f958524c-9c12-4b45-b428-08b2b122c7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:25.955600 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 997/2028] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:25.956767 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a17a4-132a-441b-bdcc-60617ee47055 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:25.961770 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958524c-9c12-4b45-b428-08b2b122c7ba None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:25.969838 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a17a4-132a-441b-bdcc-60617ee47055 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:25.969965 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df1160-22fe-48df-b822-40277509c8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:25.969965 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df1160-22fe-48df-b822-40277509c8ea admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:25.969965 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df1160-22fe-48df-b822-40277509c8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:25.969965 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df1160-22fe-48df-b822-40277509c8ea admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:25.970319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df1160-22fe-48df-b822-40277509c8ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:25.970319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df1160-22fe-48df-b822-40277509c8ea admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:25.971712 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224d895-daf3-4f75-a79b-614561b1a51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:25.972322 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224d895-daf3-4f75-a79b-614561b1a51f admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:25.972606 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224d895-daf3-4f75-a79b-614561b1a51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:25.972915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224d895-daf3-4f75-a79b-614561b1a51f admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:25.973607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224d895-daf3-4f75-a79b-614561b1a51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:25.975763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224d895-daf3-4f75-a79b-614561b1a51f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:25.985808 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 998/2029] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:25 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:25.986603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224d895-daf3-4f75-a79b-614561b1a51f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:25.988224 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f224d895-daf3-4f75-a79b-614561b1a51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:26.001775 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224d895-daf3-4f75-a79b-614561b1a51f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:26.006549 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4098042-be27-4dd0-9cee-3f41d155184e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:26.007142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4098042-be27-4dd0-9cee-3f41d155184e admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:26.007425 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4098042-be27-4dd0-9cee-3f41d155184e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:26.007734 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4098042-be27-4dd0-9cee-3f41d155184e admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:26.008391 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4098042-be27-4dd0-9cee-3f41d155184e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:26.010302 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4098042-be27-4dd0-9cee-3f41d155184e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:26.044499 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1032/2030] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:25 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:26.045782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67207be-9935-4c23-8778-49f6b0e771b3 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:26.046073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67207be-9935-4c23-8778-49f6b0e771b3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:26.046352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67207be-9935-4c23-8778-49f6b0e771b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:26.066712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-e67207be-9935-4c23-8778-49f6b0e771b3 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:26.067914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e67207be-9935-4c23-8778-49f6b0e771b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:26.075755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1033/2031] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:26.077295 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67207be-9935-4c23-8778-49f6b0e771b3 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:26.086629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67207be-9935-4c23-8778-49f6b0e771b3 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:26.091310 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c51ddf-6b3e-42eb-b082-1fcb467779e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:26.091938 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c51ddf-6b3e-42eb-b082-1fcb467779e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:26.092220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c51ddf-6b3e-42eb-b082-1fcb467779e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:26.092495 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c51ddf-6b3e-42eb-b082-1fcb467779e8 admin admin] PATH_INFO: `/v3/projects/9557ff9563514d02bb83b968baed10f6/users/4336f75c6e4044a180c83641882e10d6/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:26.107188 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c51ddf-6b3e-42eb-b082-1fcb467779e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9557ff9563514d02bb83b968baed10f6, user_id=4336f75c6e4044a180c83641882e10d6, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:26.109925 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c51ddf-6b3e-42eb-b082-1fcb467779e8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:26.147946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 999/2032] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:25 2022] POST /identity/v3/projects => generated 404 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:26.148811 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4098042-be27-4dd0-9cee-3f41d155184e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:26.209990 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4098042-be27-4dd0-9cee-3f41d155184e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:26.215258 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1034/2033] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:26 2022] PUT /identity/v3/projects/9557ff9563514d02bb83b968baed10f6/users/4336f75c6e4044a180c83641882e10d6/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:26.216002 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c51ddf-6b3e-42eb-b082-1fcb467779e8 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:26.269175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50811f1f-5226-42e7-9ce9-426204579248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:26.269831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50811f1f-5226-42e7-9ce9-426204579248 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:26.270181 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50811f1f-5226-42e7-9ce9-426204579248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:26.270528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50811f1f-5226-42e7-9ce9-426204579248 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:26.271825 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50811f1f-5226-42e7-9ce9-426204579248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:26.273487 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50811f1f-5226-42e7-9ce9-426204579248 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:26.280037 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c51ddf-6b3e-42eb-b082-1fcb467779e8 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:26.283733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1000/2034] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:26 2022] GET /identity/v3/roles => generated 1427 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:26.284503 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50811f1f-5226-42e7-9ce9-426204579248 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:26.284768 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b46d71-96aa-41c3-8bc6-a02189d69ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:26.285386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b46d71-96aa-41c3-8bc6-a02189d69ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:26.285675 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b46d71-96aa-41c3-8bc6-a02189d69ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:26.285939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b46d71-96aa-41c3-8bc6-a02189d69ed9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:26.286664 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b46d71-96aa-41c3-8bc6-a02189d69ed9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:26.287554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b46d71-96aa-41c3-8bc6-a02189d69ed9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:26.289261 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b46d71-96aa-41c3-8bc6-a02189d69ed9 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:26.295216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50811f1f-5226-42e7-9ce9-426204579248 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:26.300319 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22f023-b338-44d7-b0c3-74b1f988ef30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:26.302687 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22f023-b338-44d7-b0c3-74b1f988ef30 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:26.302687 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22f023-b338-44d7-b0c3-74b1f988ef30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:26.302687 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22f023-b338-44d7-b0c3-74b1f988ef30 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:26.302936 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1035/2035] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:24:26.303040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22f023-b338-44d7-b0c3-74b1f988ef30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:26.303133 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b46d71-96aa-41c3-8bc6-a02189d69ed9 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:26.304075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22f023-b338-44d7-b0c3-74b1f988ef30 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:26.313097 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b46d71-96aa-41c3-8bc6-a02189d69ed9 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:26.318602 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aab6eb-eef0-4ca3-ae1c-66f14ead0d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:26.319254 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aab6eb-eef0-4ca3-ae1c-66f14ead0d03 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:26.319535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aab6eb-eef0-4ca3-ae1c-66f14ead0d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:26.319806 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aab6eb-eef0-4ca3-ae1c-66f14ead0d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:26.320493 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aab6eb-eef0-4ca3-ae1c-66f14ead0d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:26.322107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aab6eb-eef0-4ca3-ae1c-66f14ead0d03 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:26.336211 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1036/2036] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:26 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:26.336211 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aab6eb-eef0-4ca3-ae1c-66f14ead0d03 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:26.343582 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aab6eb-eef0-4ca3-ae1c-66f14ead0d03 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:26.348511 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d605a-39f4-4b2c-8a8e-c1477fcb0dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:26.349234 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d605a-39f4-4b2c-8a8e-c1477fcb0dff admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:26.350144 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d605a-39f4-4b2c-8a8e-c1477fcb0dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:26.365045 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d605a-39f4-4b2c-8a8e-c1477fcb0dff admin admin] PATH_INFO: `/v3/projects/95a4bd08bdb043e5be4593524bfd9419/users/a090286bdfa94e76a2f69213d375c91b/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:26.365198 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d605a-39f4-4b2c-8a8e-c1477fcb0dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a4bd08bdb043e5be4593524bfd9419, user_id=a090286bdfa94e76a2f69213d375c91b, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:26.367834 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d605a-39f4-4b2c-8a8e-c1477fcb0dff admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:26.384478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:26.398691 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1001/2037] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:26 2022] POST /identity/v3/users => generated 309 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:26.399591 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22f023-b338-44d7-b0c3-74b1f988ef30 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:26.409174 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22f023-b338-44d7-b0c3-74b1f988ef30 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:26.414683 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bedfaa-eb5a-4d41-8a25-a2e636625cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:26.421854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bedfaa-eb5a-4d41-8a25-a2e636625cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:26.421854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bedfaa-eb5a-4d41-8a25-a2e636625cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:26.421854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bedfaa-eb5a-4d41-8a25-a2e636625cf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:26.421854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bedfaa-eb5a-4d41-8a25-a2e636625cf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:26.421854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bedfaa-eb5a-4d41-8a25-a2e636625cf3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:26.482467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1037/2038] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:26 2022] PUT /identity/v3/projects/95a4bd08bdb043e5be4593524bfd9419/users/a090286bdfa94e76a2f69213d375c91b/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:26.483411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d605a-39f4-4b2c-8a8e-c1477fcb0dff admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:26.508717 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1002/2039] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:26 2022] POST /identity/v3/projects => generated 376 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:26.509638 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bedfaa-eb5a-4d41-8a25-a2e636625cf3 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:26.557507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d605a-39f4-4b2c-8a8e-c1477fcb0dff admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:26.578067 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bedfaa-eb5a-4d41-8a25-a2e636625cf3 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:26.582994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ca14b-2ba7-47f8-b7a0-af46f3414863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:26.583647 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ca14b-2ba7-47f8-b7a0-af46f3414863 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:26.584416 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ca14b-2ba7-47f8-b7a0-af46f3414863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:26.584727 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ca14b-2ba7-47f8-b7a0-af46f3414863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:26.585430 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ca14b-2ba7-47f8-b7a0-af46f3414863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:26.587082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ca14b-2ba7-47f8-b7a0-af46f3414863 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:26.597216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1003/2040] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:26 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:26.598101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ca14b-2ba7-47f8-b7a0-af46f3414863 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:26.608795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ca14b-2ba7-47f8-b7a0-af46f3414863 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:26.613643 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad16df-da4a-47dd-a645-01044cbd8209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:26.614260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad16df-da4a-47dd-a645-01044cbd8209 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:26.614543 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad16df-da4a-47dd-a645-01044cbd8209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:26.614820 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad16df-da4a-47dd-a645-01044cbd8209 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:26.615538 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad16df-da4a-47dd-a645-01044cbd8209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:26.617166 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad16df-da4a-47dd-a645-01044cbd8209 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:26.619036 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458b710-97a0-46b7-b384-b3be0de9d782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:26.619712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458b710-97a0-46b7-b384-b3be0de9d782 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:26.619994 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458b710-97a0-46b7-b384-b3be0de9d782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:26.620272 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458b710-97a0-46b7-b384-b3be0de9d782 admin admin] PATH_INFO: `/v3/projects/9557ff9563514d02bb83b968baed10f6/users/4336f75c6e4044a180c83641882e10d6/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:26.622290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458b710-97a0-46b7-b384-b3be0de9d782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9557ff9563514d02bb83b968baed10f6, user_id=4336f75c6e4044a180c83641882e10d6, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:26.625007 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458b710-97a0-46b7-b384-b3be0de9d782 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:26.627628 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1004/2041] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:26 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:26.628437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad16df-da4a-47dd-a645-01044cbd8209 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:26.635639 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1038/2042] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:26 2022] PUT /identity/v3/projects/9557ff9563514d02bb83b968baed10f6/users/4336f75c6e4044a180c83641882e10d6/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:26.636454 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458b710-97a0-46b7-b384-b3be0de9d782 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:26.638948 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad16df-da4a-47dd-a645-01044cbd8209 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:26.704055 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec0711-aa59-4de6-a5f1-c9a52a0f225a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:26.704714 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec0711-aa59-4de6-a5f1-c9a52a0f225a admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:26.705050 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec0711-aa59-4de6-a5f1-c9a52a0f225a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:26.706107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec0711-aa59-4de6-a5f1-c9a52a0f225a admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:26.706107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec0711-aa59-4de6-a5f1-c9a52a0f225a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:26.708018 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec0711-aa59-4de6-a5f1-c9a52a0f225a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:26.715560 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458b710-97a0-46b7-b384-b3be0de9d782 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:26.720383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4351f9a-9f60-4a2f-8944-158cff7b9581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:26.721081 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4351f9a-9f60-4a2f-8944-158cff7b9581 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:26.721359 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4351f9a-9f60-4a2f-8944-158cff7b9581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:26.721644 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4351f9a-9f60-4a2f-8944-158cff7b9581 admin admin] PATH_INFO: `/v3/projects/70afed7a881543b0a17412174024562b/users/4ab49d2e3ced42f4a9bfb954fc5939e6/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:26.736122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4351f9a-9f60-4a2f-8944-158cff7b9581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70afed7a881543b0a17412174024562b, user_id=4ab49d2e3ced42f4a9bfb954fc5939e6, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:26.738854 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4351f9a-9f60-4a2f-8944-158cff7b9581 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:26.858181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1039/2043] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:26 2022] PUT /identity/v3/projects/70afed7a881543b0a17412174024562b/users/4ab49d2e3ced42f4a9bfb954fc5939e6/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:26.858316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1005/2044] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:26 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:26.862441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4351f9a-9f60-4a2f-8944-158cff7b9581 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:26.862843 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996e10f-63f4-4f47-9f63-0a308011c679 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:26.862843 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996e10f-63f4-4f47-9f63-0a308011c679 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:26.862843 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996e10f-63f4-4f47-9f63-0a308011c679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:26.892733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8996e10f-63f4-4f47-9f63-0a308011c679 None None] MFA Rules not processed for user `4336f75c6e4044a180c83641882e10d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:26.894114 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8996e10f-63f4-4f47-9f63-0a308011c679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:26.945116 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4351f9a-9f60-4a2f-8944-158cff7b9581 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:26.964096 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f1af3-c794-4d52-8c88-8cc0435cc0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:26.964987 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f1af3-c794-4d52-8c88-8cc0435cc0f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:26.965123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f1af3-c794-4d52-8c88-8cc0435cc0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:26.965315 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f1af3-c794-4d52-8c88-8cc0435cc0f5 admin admin] PATH_INFO: `/v3/projects/95a4bd08bdb043e5be4593524bfd9419/users/a090286bdfa94e76a2f69213d375c91b/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:26.967455 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f1af3-c794-4d52-8c88-8cc0435cc0f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a4bd08bdb043e5be4593524bfd9419, user_id=a090286bdfa94e76a2f69213d375c91b, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:26.977119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f1af3-c794-4d52-8c88-8cc0435cc0f5 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:26.977229 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1006/2045] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:26.977229 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996e10f-63f4-4f47-9f63-0a308011c679 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:26.989237 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996e10f-63f4-4f47-9f63-0a308011c679 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:26.992546 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1040/2046] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:26 2022] PUT /identity/v3/projects/95a4bd08bdb043e5be4593524bfd9419/users/a090286bdfa94e76a2f69213d375c91b/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:26.993372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f1af3-c794-4d52-8c88-8cc0435cc0f5 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:27.059035 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6e1c0-8f47-437e-a53e-05cfccfc4623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:27.059597 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6e1c0-8f47-437e-a53e-05cfccfc4623 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:27.059881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6e1c0-8f47-437e-a53e-05cfccfc4623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:27.060160 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6e1c0-8f47-437e-a53e-05cfccfc4623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:27.060892 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6e1c0-8f47-437e-a53e-05cfccfc4623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:27.062850 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6e1c0-8f47-437e-a53e-05cfccfc4623 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:27.066166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:27.072107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f1af3-c794-4d52-8c88-8cc0435cc0f5 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:27.078314 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c1d9d-0a51-4b7c-b55c-f6206a7f2613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:27.078996 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c1d9d-0a51-4b7c-b55c-f6206a7f2613 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:27.079280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c1d9d-0a51-4b7c-b55c-f6206a7f2613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:27.079559 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c1d9d-0a51-4b7c-b55c-f6206a7f2613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:27.080522 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c1d9d-0a51-4b7c-b55c-f6206a7f2613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:27.080737 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1007/2047] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:26 2022] GET /identity/v3/roles => generated 1427 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:27.081611 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6e1c0-8f47-437e-a53e-05cfccfc4623 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:27.082552 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c1d9d-0a51-4b7c-b55c-f6206a7f2613 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:27.083327 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0cd6e1c0-8f47-437e-a53e-05cfccfc4623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:27.095434 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1041/2048] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:26 2022] GET /identity/v3/roles => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:27.100379 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2669a3-8813-49fa-971d-3999a0ee62ad None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:27.100379 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2669a3-8813-49fa-971d-3999a0ee62ad None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:27.100379 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2669a3-8813-49fa-971d-3999a0ee62ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:27.128060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5d2669a3-8813-49fa-971d-3999a0ee62ad None None] MFA Rules not processed for user `a090286bdfa94e76a2f69213d375c91b`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:27.129695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5d2669a3-8813-49fa-971d-3999a0ee62ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:27.157323 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6e1c0-8f47-437e-a53e-05cfccfc4623 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:27.160995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5ed47-f56d-4957-810f-3e6088165ba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:27.161664 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5ed47-f56d-4957-810f-3e6088165ba7 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:27.161977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5ed47-f56d-4957-810f-3e6088165ba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:27.162256 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5ed47-f56d-4957-810f-3e6088165ba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:27.199982 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1042/2049] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:27.200633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2669a3-8813-49fa-971d-3999a0ee62ad None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:27.212600 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2669a3-8813-49fa-971d-3999a0ee62ad None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:27.217443 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f63b5-8552-4f19-aa8c-a6917f083efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:27.218107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f63b5-8552-4f19-aa8c-a6917f083efe admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:27.218393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f63b5-8552-4f19-aa8c-a6917f083efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:27.218671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f63b5-8552-4f19-aa8c-a6917f083efe admin admin] PATH_INFO: `/v3/projects/70afed7a881543b0a17412174024562b/users/4ab49d2e3ced42f4a9bfb954fc5939e6/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:27.220744 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f63b5-8552-4f19-aa8c-a6917f083efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=70afed7a881543b0a17412174024562b, user_id=4ab49d2e3ced42f4a9bfb954fc5939e6, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:27.223391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f63b5-8552-4f19-aa8c-a6917f083efe admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:27.224046 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5ed47-f56d-4957-810f-3e6088165ba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:27.225547 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5ed47-f56d-4957-810f-3e6088165ba7 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:27.233786 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1043/2050] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:27 2022] PUT /identity/v3/projects/70afed7a881543b0a17412174024562b/users/4ab49d2e3ced42f4a9bfb954fc5939e6/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:27.234608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f63b5-8552-4f19-aa8c-a6917f083efe admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:27.235346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1008/2051] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:27.236511 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5ed47-f56d-4957-810f-3e6088165ba7 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:27.242618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-92d5ed47-f56d-4957-810f-3e6088165ba7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:27.254603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5ed47-f56d-4957-810f-3e6088165ba7 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:27.305705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f63b5-8552-4f19-aa8c-a6917f083efe admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:27.306267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6fbf0-3a92-482a-aa70-456eeafca8a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:27.306625 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6fbf0-3a92-482a-aa70-456eeafca8a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:27.306907 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6fbf0-3a92-482a-aa70-456eeafca8a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:27.307187 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6fbf0-3a92-482a-aa70-456eeafca8a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:27.309110 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1bf6fbf0-3a92-482a-aa70-456eeafca8a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:27.310966 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858b9ee-6e71-4fd8-9e82-6695b9610d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:27.311575 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858b9ee-6e71-4fd8-9e82-6695b9610d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:27.311851 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858b9ee-6e71-4fd8-9e82-6695b9610d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:27.312122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858b9ee-6e71-4fd8-9e82-6695b9610d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:27.312852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858b9ee-6e71-4fd8-9e82-6695b9610d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:27.314435 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858b9ee-6e71-4fd8-9e82-6695b9610d1c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:27.329000 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1044/2052] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:27 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:27.330465 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b0570-fa5f-4f81-88da-52f9350e87ab None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:27.330756 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b0570-fa5f-4f81-88da-52f9350e87ab None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:27.331062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b0570-fa5f-4f81-88da-52f9350e87ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:27.360994 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f65b0570-fa5f-4f81-88da-52f9350e87ab None None] MFA Rules not processed for user `4ab49d2e3ced42f4a9bfb954fc5939e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:27.362213 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f65b0570-fa5f-4f81-88da-52f9350e87ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:27.372435 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6fbf0-3a92-482a-aa70-456eeafca8a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:27.374121 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6fbf0-3a92-482a-aa70-456eeafca8a0 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:27.393193 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1009/2053] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:27.395932 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6fbf0-3a92-482a-aa70-456eeafca8a0 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:27.415408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6fbf0-3a92-482a-aa70-456eeafca8a0 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:27.422635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e78d0-9d9f-41a9-b952-c3f35e5d7a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:27.423373 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e78d0-9d9f-41a9-b952-c3f35e5d7a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:27.423685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e78d0-9d9f-41a9-b952-c3f35e5d7a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:27.423963 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e78d0-9d9f-41a9-b952-c3f35e5d7a11 admin admin] PATH_INFO: `/v3/projects/db53a5690051406fa2775b602223d92c/users/5a342556241e4ab69387ac45d1b7a966/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:27.441073 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e78d0-9d9f-41a9-b952-c3f35e5d7a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db53a5690051406fa2775b602223d92c, user_id=5a342556241e4ab69387ac45d1b7a966, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:27.442062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1045/2054] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:27 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:27.444342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e78d0-9d9f-41a9-b952-c3f35e5d7a11 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:27.518952 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:27.528731 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1010/2055] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:27 2022] PUT /identity/v3/projects/db53a5690051406fa2775b602223d92c/users/5a342556241e4ab69387ac45d1b7a966/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:27.532426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b0570-fa5f-4f81-88da-52f9350e87ab None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:27.539995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeef945-f110-444b-9e04-f9033c9c7edf None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:27.540281 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeef945-f110-444b-9e04-f9033c9c7edf None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:27.540553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeef945-f110-444b-9e04-f9033c9c7edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:27.542129 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b0570-fa5f-4f81-88da-52f9350e87ab None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:27.568745 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-abeef945-f110-444b-9e04-f9033c9c7edf None None] MFA Rules not processed for user `5a342556241e4ab69387ac45d1b7a966`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:27.569947 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-abeef945-f110-444b-9e04-f9033c9c7edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:27.593610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be30980-09f4-4894-98d3-2a1aa6d52ee7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:27.596514 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be30980-09f4-4894-98d3-2a1aa6d52ee7 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:27.596514 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be30980-09f4-4894-98d3-2a1aa6d52ee7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:27.596514 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be30980-09f4-4894-98d3-2a1aa6d52ee7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:27.637256 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1011/2056] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:27.641721 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeef945-f110-444b-9e04-f9033c9c7edf None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:27.657000 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be30980-09f4-4894-98d3-2a1aa6d52ee7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:27.658459 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be30980-09f4-4894-98d3-2a1aa6d52ee7 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:27.667919 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1046/2057] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:27 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:27.718187 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeef945-f110-444b-9e04-f9033c9c7edf None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:27.725785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872095b-9e2f-4932-94ad-1df01ab826cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:27.726421 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872095b-9e2f-4932-94ad-1df01ab826cc admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:27.726701 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872095b-9e2f-4932-94ad-1df01ab826cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:27.726971 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872095b-9e2f-4932-94ad-1df01ab826cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:27.727768 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872095b-9e2f-4932-94ad-1df01ab826cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:27.729783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872095b-9e2f-4932-94ad-1df01ab826cc admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:27.769902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:27.851435 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1012/2058] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:27 2022] POST /identity/v3/projects => generated 378 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:27.855211 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be30980-09f4-4894-98d3-2a1aa6d52ee7 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:27.866360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be30980-09f4-4894-98d3-2a1aa6d52ee7 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:27.937008 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc848e6b-4e90-42a3-84e4-791b6369936f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:27.937008 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc848e6b-4e90-42a3-84e4-791b6369936f admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:27.937008 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc848e6b-4e90-42a3-84e4-791b6369936f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:27.937008 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc848e6b-4e90-42a3-84e4-791b6369936f admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:27.937351 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc848e6b-4e90-42a3-84e4-791b6369936f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:27.939326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc848e6b-4e90-42a3-84e4-791b6369936f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:27.962079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872095b-9e2f-4932-94ad-1df01ab826cc admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:27.973351 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872095b-9e2f-4932-94ad-1df01ab826cc admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:27.978119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b4db3-49db-4c43-aa78-ddd6889d1955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:27.978761 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b4db3-49db-4c43-aa78-ddd6889d1955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:27.979046 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b4db3-49db-4c43-aa78-ddd6889d1955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:27.979472 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b4db3-49db-4c43-aa78-ddd6889d1955 admin admin] PATH_INFO: `/v3/users/ce1eeb9ceae34604944cc00704c6df83` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:27.980491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b4db3-49db-4c43-aa78-ddd6889d1955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce1eeb9ceae34604944cc00704c6df83)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:27.982462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b4db3-49db-4c43-aa78-ddd6889d1955 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:28.042205 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1047/2059] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:27 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:24:28.050051 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc848e6b-4e90-42a3-84e4-791b6369936f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:28.060578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc848e6b-4e90-42a3-84e4-791b6369936f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:28.065395 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6285fc-0032-4dcd-bf14-7cd495a4ce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:28.066004 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6285fc-0032-4dcd-bf14-7cd495a4ce65 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:28.066291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6285fc-0032-4dcd-bf14-7cd495a4ce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:28.066572 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6285fc-0032-4dcd-bf14-7cd495a4ce65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:28.067264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6285fc-0032-4dcd-bf14-7cd495a4ce65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:28.069454 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6285fc-0032-4dcd-bf14-7cd495a4ce65 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:28.079850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1048/2060] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:28 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:24:28.084074 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6285fc-0032-4dcd-bf14-7cd495a4ce65 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:28.094088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6285fc-0032-4dcd-bf14-7cd495a4ce65 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:28.099006 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290d3fa-ae6c-4743-807b-0a5b57b3d05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:28.104152 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290d3fa-ae6c-4743-807b-0a5b57b3d05c admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:28.104152 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290d3fa-ae6c-4743-807b-0a5b57b3d05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:28.104152 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290d3fa-ae6c-4743-807b-0a5b57b3d05c admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:28.104152 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290d3fa-ae6c-4743-807b-0a5b57b3d05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:28.104152 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290d3fa-ae6c-4743-807b-0a5b57b3d05c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:28.117729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1049/2061] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:28 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:28.121649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290d3fa-ae6c-4743-807b-0a5b57b3d05c admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:28.142471 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290d3fa-ae6c-4743-807b-0a5b57b3d05c admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:28.147468 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd796a-af11-43a2-81d5-6679a1b4630c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:28.148148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd796a-af11-43a2-81d5-6679a1b4630c admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:28.148519 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd796a-af11-43a2-81d5-6679a1b4630c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:28.150510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd796a-af11-43a2-81d5-6679a1b4630c admin admin] PATH_INFO: `/v3/projects/743e9047dbd94533b3f8043aa84c3779/users/65ed3170ef8f4405b4c7926a803b816b/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:28.167859 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd796a-af11-43a2-81d5-6679a1b4630c admin admin] RBAC: Authorizing `identity:create_grant(project_id=743e9047dbd94533b3f8043aa84c3779, user_id=65ed3170ef8f4405b4c7926a803b816b, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:28.171019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd796a-af11-43a2-81d5-6679a1b4630c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:28.189137 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-689b4db3-49db-4c43-aa78-ddd6889d1955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce1eeb9ceae34604944cc00704c6df83'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:28.189990 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-689b4db3-49db-4c43-aa78-ddd6889d1955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce1eeb9ceae34604944cc00704c6df83'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:28.207254 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-689b4db3-49db-4c43-aa78-ddd6889d1955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce1eeb9ceae34604944cc00704c6df83'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:28.215012 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-689b4db3-49db-4c43-aa78-ddd6889d1955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce1eeb9ceae34604944cc00704c6df83'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:28.280163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1050/2062] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:28 2022] PUT /identity/v3/projects/743e9047dbd94533b3f8043aa84c3779/users/65ed3170ef8f4405b4c7926a803b816b/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:28.295150 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf0164-6287-43aa-915a-f9c815083a1e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:28.295447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf0164-6287-43aa-915a-f9c815083a1e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:28.295729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf0164-6287-43aa-915a-f9c815083a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:28.302521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-689b4db3-49db-4c43-aa78-ddd6889d1955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce1eeb9ceae34604944cc00704c6df83'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:28.321562 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1013/2063] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:27 2022] DELETE /identity/v3/users/ce1eeb9ceae34604944cc00704c6df83 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:28.326877 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b98dd8-9e96-4e01-940e-11ab4e6e8e75 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:28.326877 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b98dd8-9e96-4e01-940e-11ab4e6e8e75 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:28.327860 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b98dd8-9e96-4e01-940e-11ab4e6e8e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:28.353608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-eaaf0164-6287-43aa-915a-f9c815083a1e None None] MFA Rules not processed for user `65ed3170ef8f4405b4c7926a803b816b`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:28.354217 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-27b98dd8-9e96-4e01-940e-11ab4e6e8e75 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:28.355368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-27b98dd8-9e96-4e01-940e-11ab4e6e8e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:28.355489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-eaaf0164-6287-43aa-915a-f9c815083a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:28.417676 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1014/2064] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:28.427087 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1051/2065] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:28.429129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b98dd8-9e96-4e01-940e-11ab4e6e8e75 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:28.430490 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-27b98dd8-9e96-4e01-940e-11ab4e6e8e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:28.433940 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf0164-6287-43aa-915a-f9c815083a1e None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:28.435504 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-eaaf0164-6287-43aa-915a-f9c815083a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:28.450096 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf0164-6287-43aa-915a-f9c815083a1e None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:28.459714 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914b6fe-8faf-426f-8f6b-e2de2c4ad56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:28.460247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914b6fe-8faf-426f-8f6b-e2de2c4ad56c admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:28.460635 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914b6fe-8faf-426f-8f6b-e2de2c4ad56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:28.461290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914b6fe-8faf-426f-8f6b-e2de2c4ad56c admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:28.461913 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914b6fe-8faf-426f-8f6b-e2de2c4ad56c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:28.464014 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914b6fe-8faf-426f-8f6b-e2de2c4ad56c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:28.492565 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b98dd8-9e96-4e01-940e-11ab4e6e8e75 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:28.496563 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571d899-4c70-4f72-9e48-46c096ef40d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:28.497234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571d899-4c70-4f72-9e48-46c096ef40d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:28.497516 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571d899-4c70-4f72-9e48-46c096ef40d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:28.497790 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571d899-4c70-4f72-9e48-46c096ef40d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:28.507007 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571d899-4c70-4f72-9e48-46c096ef40d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:28.508465 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571d899-4c70-4f72-9e48-46c096ef40d5 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:28.517750 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1015/2066] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:28.552057 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1052/2067] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:28 2022] POST /identity/v3/projects => generated 376 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:28.553556 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571d899-4c70-4f72-9e48-46c096ef40d5 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:28.563679 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571d899-4c70-4f72-9e48-46c096ef40d5 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:28.633999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e95d9-4cff-4785-9e5b-0f7d1ebc8555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:28.634630 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e95d9-4cff-4785-9e5b-0f7d1ebc8555 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:28.634913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e95d9-4cff-4785-9e5b-0f7d1ebc8555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:28.635219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e95d9-4cff-4785-9e5b-0f7d1ebc8555 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:28.635904 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e95d9-4cff-4785-9e5b-0f7d1ebc8555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:28.637880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e95d9-4cff-4785-9e5b-0f7d1ebc8555 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:28.763295 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1016/2068] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:28 2022] POST /identity/v3/users => generated 295 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:28.764464 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914b6fe-8faf-426f-8f6b-e2de2c4ad56c admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:28.775451 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914b6fe-8faf-426f-8f6b-e2de2c4ad56c admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:28.780307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab0742-e834-4c79-8704-f9c4acd02ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:28.781156 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab0742-e834-4c79-8704-f9c4acd02ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:28.781484 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab0742-e834-4c79-8704-f9c4acd02ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:28.781785 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab0742-e834-4c79-8704-f9c4acd02ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:28.782522 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab0742-e834-4c79-8704-f9c4acd02ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:28.784171 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab0742-e834-4c79-8704-f9c4acd02ea3 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:28.799732 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1053/2069] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:28 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:28.803853 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e95d9-4cff-4785-9e5b-0f7d1ebc8555 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:28.813748 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab0742-e834-4c79-8704-f9c4acd02ea3 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:28.815144 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e95d9-4cff-4785-9e5b-0f7d1ebc8555 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:28.815957 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-97ab0742-e834-4c79-8704-f9c4acd02ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:28.821474 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77688cb6-9baa-4608-88f8-f0159e44b357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:28.822380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77688cb6-9baa-4608-88f8-f0159e44b357 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:28.822669 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77688cb6-9baa-4608-88f8-f0159e44b357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:28.825355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77688cb6-9baa-4608-88f8-f0159e44b357 admin admin] PATH_INFO: `/v3/projects/9d4939a0a728424ba1d89f38f3a64698/users/55487b88cf44425b88e4aa86222a4b19/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:28.831290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab0742-e834-4c79-8704-f9c4acd02ea3 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:28.838938 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd5ea8-6c2a-4ef8-ab46-66b97bcae5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:28.839652 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd5ea8-6c2a-4ef8-ab46-66b97bcae5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:28.839936 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd5ea8-6c2a-4ef8-ab46-66b97bcae5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:28.840217 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd5ea8-6c2a-4ef8-ab46-66b97bcae5bd admin admin] PATH_INFO: `/v3/users/28f38ab3ba7a45558ad2fdc8ca22402d` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:28.841458 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd5ea8-6c2a-4ef8-ab46-66b97bcae5bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=28f38ab3ba7a45558ad2fdc8ca22402d)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:28.843435 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77688cb6-9baa-4608-88f8-f0159e44b357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d4939a0a728424ba1d89f38f3a64698, user_id=55487b88cf44425b88e4aa86222a4b19, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:28.843563 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd5ea8-6c2a-4ef8-ab46-66b97bcae5bd admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:28.848640 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77688cb6-9baa-4608-88f8-f0159e44b357 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:28.869351 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:28.917217 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1017/2070] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:28 2022] PUT /identity/v3/projects/9d4939a0a728424ba1d89f38f3a64698/users/55487b88cf44425b88e4aa86222a4b19/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:28.921425 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77688cb6-9baa-4608-88f8-f0159e44b357 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:28.986757 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77688cb6-9baa-4608-88f8-f0159e44b357 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:28.989868 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:28.994907 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f7af6-ef6d-4cf3-91f1-c6ac7198d4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:28.995579 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f7af6-ef6d-4cf3-91f1-c6ac7198d4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:28.995908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f7af6-ef6d-4cf3-91f1-c6ac7198d4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:28.996169 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f7af6-ef6d-4cf3-91f1-c6ac7198d4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:28.996940 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f7af6-ef6d-4cf3-91f1-c6ac7198d4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:28.998537 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f7af6-ef6d-4cf3-91f1-c6ac7198d4d0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:29.009453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1018/2071] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:28 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:24:29.010315 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f7af6-ef6d-4cf3-91f1-c6ac7198d4d0 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:29.011961 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b26f7af6-ef6d-4cf3-91f1-c6ac7198d4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:29.025225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f7af6-ef6d-4cf3-91f1-c6ac7198d4d0 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:29.029806 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9760166-49b7-4787-9519-b820de83a65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:29.030426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9760166-49b7-4787-9519-b820de83a65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:29.030743 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9760166-49b7-4787-9519-b820de83a65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:29.031058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9760166-49b7-4787-9519-b820de83a65e admin admin] PATH_INFO: `/v3/projects/2f56ae703e9d4e4aad4937a0c7189d29` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:29.032208 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9760166-49b7-4787-9519-b820de83a65e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f56ae703e9d4e4aad4937a0c7189d29)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:29.034241 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9760166-49b7-4787-9519-b820de83a65e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:29.086527 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-fffd5ea8-6c2a-4ef8-ab46-66b97bcae5bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28f38ab3ba7a45558ad2fdc8ca22402d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:29.087202 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-fffd5ea8-6c2a-4ef8-ab46-66b97bcae5bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28f38ab3ba7a45558ad2fdc8ca22402d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:29.150844 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f9760166-49b7-4787-9519-b820de83a65e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f56ae703e9d4e4aad4937a0c7189d29', 'request_id': 'req-f9760166-49b7-4787-9519-b820de83a65e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:29.157818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f9760166-49b7-4787-9519-b820de83a65e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f56ae703e9d4e4aad4937a0c7189d29', 'request_id': 'req-f9760166-49b7-4787-9519-b820de83a65e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:29.163462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f9760166-49b7-4787-9519-b820de83a65e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f56ae703e9d4e4aad4937a0c7189d29', 'request_id': 'req-f9760166-49b7-4787-9519-b820de83a65e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:29.190273 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-fffd5ea8-6c2a-4ef8-ab46-66b97bcae5bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28f38ab3ba7a45558ad2fdc8ca22402d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:29.203842 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-fffd5ea8-6c2a-4ef8-ab46-66b97bcae5bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28f38ab3ba7a45558ad2fdc8ca22402d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:29.204534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-fffd5ea8-6c2a-4ef8-ab46-66b97bcae5bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28f38ab3ba7a45558ad2fdc8ca22402d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:29.217575 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1054/2072] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:28 2022] DELETE /identity/v3/users/28f38ab3ba7a45558ad2fdc8ca22402d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:29.218203 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd5ea8-6c2a-4ef8-ab46-66b97bcae5bd admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:29.221738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fffd5ea8-6c2a-4ef8-ab46-66b97bcae5bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:29.269735 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f9760166-49b7-4787-9519-b820de83a65e admin admin] The token cache is being invalidate because project 2f56ae703e9d4e4aad4937a0c7189d29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:29.270021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f9760166-49b7-4787-9519-b820de83a65e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:29.270664 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f9760166-49b7-4787-9519-b820de83a65e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:29.272906 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1019/2073] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:29 2022] DELETE /identity/v3/projects/2f56ae703e9d4e4aad4937a0c7189d29 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:29.277151 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520bdf6-8f84-4e77-bad6-1b484bb8cbbd None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:29.277438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520bdf6-8f84-4e77-bad6-1b484bb8cbbd None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:29.277714 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520bdf6-8f84-4e77-bad6-1b484bb8cbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:29.285485 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd5ea8-6c2a-4ef8-ab46-66b97bcae5bd admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:29.291243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6bfe1-f965-4280-becf-c986eefe2a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:29.291920 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6bfe1-f965-4280-becf-c986eefe2a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:29.292208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6bfe1-f965-4280-becf-c986eefe2a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:29.292481 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6bfe1-f965-4280-becf-c986eefe2a83 admin admin] PATH_INFO: `/v3/projects/9d4939a0a728424ba1d89f38f3a64698/users/55487b88cf44425b88e4aa86222a4b19/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:29.295279 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6bfe1-f965-4280-becf-c986eefe2a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d4939a0a728424ba1d89f38f3a64698, user_id=55487b88cf44425b88e4aa86222a4b19, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:29.297978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6bfe1-f965-4280-becf-c986eefe2a83 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:29.300036 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-4520bdf6-8f84-4e77-bad6-1b484bb8cbbd None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:29.301269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4520bdf6-8f84-4e77-bad6-1b484bb8cbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:29.309332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1055/2074] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:29 2022] PUT /identity/v3/projects/9d4939a0a728424ba1d89f38f3a64698/users/55487b88cf44425b88e4aa86222a4b19/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:29.310292 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6bfe1-f965-4280-becf-c986eefe2a83 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:29.311755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-06c6bfe1-f965-4280-becf-c986eefe2a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:29.363456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1020/2075] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:29.364827 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb8a0c-b878-4ed1-87e6-be41f7046512 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:29.365734 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb8a0c-b878-4ed1-87e6-be41f7046512 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:29.365957 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb8a0c-b878-4ed1-87e6-be41f7046512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:29.376191 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6bfe1-f965-4280-becf-c986eefe2a83 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:29.383642 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b417d-e6ac-4be5-b400-666276c1a2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:29.384184 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b417d-e6ac-4be5-b400-666276c1a2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:29.384467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b417d-e6ac-4be5-b400-666276c1a2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:29.384871 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b417d-e6ac-4be5-b400-666276c1a2c6 admin admin] PATH_INFO: `/v3/users/4ab49d2e3ced42f4a9bfb954fc5939e6` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:29.386071 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b417d-e6ac-4be5-b400-666276c1a2c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ab49d2e3ced42f4a9bfb954fc5939e6)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:29.388077 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b417d-e6ac-4be5-b400-666276c1a2c6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:29.414645 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-6ddb8a0c-b878-4ed1-87e6-be41f7046512 None None] MFA Rules not processed for user `55487b88cf44425b88e4aa86222a4b19`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:29.414645 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6ddb8a0c-b878-4ed1-87e6-be41f7046512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:29.492306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1021/2076] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:29.493069 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb8a0c-b878-4ed1-87e6-be41f7046512 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:29.494396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6ddb8a0c-b878-4ed1-87e6-be41f7046512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:29.557279 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb8a0c-b878-4ed1-87e6-be41f7046512 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:29.561019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ddde1-3050-4af2-9a6c-b93ffaa837ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:29.561646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ddde1-3050-4af2-9a6c-b93ffaa837ea service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:29.561932 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ddde1-3050-4af2-9a6c-b93ffaa837ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:29.562208 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ddde1-3050-4af2-9a6c-b93ffaa837ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:29.572417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ddde1-3050-4af2-9a6c-b93ffaa837ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:29.573905 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ddde1-3050-4af2-9a6c-b93ffaa837ea service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:29.584033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1022/2077] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:29.585394 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ddde1-3050-4af2-9a6c-b93ffaa837ea service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:29.586562 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-553ddde1-3050-4af2-9a6c-b93ffaa837ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:29.591608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-dc0b417d-e6ac-4be5-b400-666276c1a2c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ab49d2e3ced42f4a9bfb954fc5939e6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:29.592407 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-dc0b417d-e6ac-4be5-b400-666276c1a2c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ab49d2e3ced42f4a9bfb954fc5939e6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:29.599985 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ddde1-3050-4af2-9a6c-b93ffaa837ea service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:29.606771 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72e49c-f537-4e77-9ec1-8e560de00fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:29.607430 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72e49c-f537-4e77-9ec1-8e560de00fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:29.607727 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72e49c-f537-4e77-9ec1-8e560de00fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:29.608009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72e49c-f537-4e77-9ec1-8e560de00fd0 admin admin] PATH_INFO: `/v3/users/a518077e189d43fb94e65d8301ca258a` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:29.609714 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72e49c-f537-4e77-9ec1-8e560de00fd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a518077e189d43fb94e65d8301ca258a)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:29.612437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72e49c-f537-4e77-9ec1-8e560de00fd0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:29.683878 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-dc0b417d-e6ac-4be5-b400-666276c1a2c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ab49d2e3ced42f4a9bfb954fc5939e6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:29.696233 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-dc0b417d-e6ac-4be5-b400-666276c1a2c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ab49d2e3ced42f4a9bfb954fc5939e6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:29.696888 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-dc0b417d-e6ac-4be5-b400-666276c1a2c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ab49d2e3ced42f4a9bfb954fc5939e6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:29.709075 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1056/2078] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:29 2022] DELETE /identity/v3/users/4ab49d2e3ced42f4a9bfb954fc5939e6 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:29.709862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b417d-e6ac-4be5-b400-666276c1a2c6 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:29.711279 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dc0b417d-e6ac-4be5-b400-666276c1a2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:29.769615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b417d-e6ac-4be5-b400-666276c1a2c6 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:29.773480 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e21f55-551d-42eb-a19d-e9f817e9307d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:29.774104 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e21f55-551d-42eb-a19d-e9f817e9307d service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:29.774389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e21f55-551d-42eb-a19d-e9f817e9307d service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:29.774655 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e21f55-551d-42eb-a19d-e9f817e9307d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:29.777226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-75e21f55-551d-42eb-a19d-e9f817e9307d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:29.845326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e21f55-551d-42eb-a19d-e9f817e9307d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:29.847028 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e21f55-551d-42eb-a19d-e9f817e9307d service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:29.858348 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1057/2079] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:29.878880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0c72e49c-f537-4e77-9ec1-8e560de00fd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a518077e189d43fb94e65d8301ca258a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:29.879534 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0c72e49c-f537-4e77-9ec1-8e560de00fd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a518077e189d43fb94e65d8301ca258a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:29.895557 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0c72e49c-f537-4e77-9ec1-8e560de00fd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a518077e189d43fb94e65d8301ca258a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:29.903404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0c72e49c-f537-4e77-9ec1-8e560de00fd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a518077e189d43fb94e65d8301ca258a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.041460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0c72e49c-f537-4e77-9ec1-8e560de00fd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a518077e189d43fb94e65d8301ca258a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.048182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1023/2080] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:29 2022] DELETE /identity/v3/users/a518077e189d43fb94e65d8301ca258a => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:30.052770 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a06502-8e0b-4674-95a4-202647b5d433 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:30.053061 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a06502-8e0b-4674-95a4-202647b5d433 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:30.053362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a06502-8e0b-4674-95a4-202647b5d433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:30.073348 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-88a06502-8e0b-4674-95a4-202647b5d433 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:30.074577 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-88a06502-8e0b-4674-95a4-202647b5d433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:30.098789 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72e49c-f537-4e77-9ec1-8e560de00fd0 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:30.100897 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0c72e49c-f537-4e77-9ec1-8e560de00fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:30.164945 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1058/2081] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:30.175061 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a06502-8e0b-4674-95a4-202647b5d433 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:30.176199 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72e49c-f537-4e77-9ec1-8e560de00fd0 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:30.177625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-88a06502-8e0b-4674-95a4-202647b5d433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:30.187550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2622ec-ac7c-4461-b60e-4f644ab83d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:30.187550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2622ec-ac7c-4461-b60e-4f644ab83d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:30.187550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2622ec-ac7c-4461-b60e-4f644ab83d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:30.187550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2622ec-ac7c-4461-b60e-4f644ab83d6d admin admin] PATH_INFO: `/v3/projects/1c01859164e246429b9eed524cb74712` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:30.188711 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2622ec-ac7c-4461-b60e-4f644ab83d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c01859164e246429b9eed524cb74712)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:30.191320 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2622ec-ac7c-4461-b60e-4f644ab83d6d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:30.245395 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a06502-8e0b-4674-95a4-202647b5d433 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:30.249070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96939be2-721b-4bd9-8c9e-de1bf09389f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:30.249696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96939be2-721b-4bd9-8c9e-de1bf09389f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:30.249978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96939be2-721b-4bd9-8c9e-de1bf09389f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:30.250255 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96939be2-721b-4bd9-8c9e-de1bf09389f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:30.260653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96939be2-721b-4bd9-8c9e-de1bf09389f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:30.262118 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96939be2-721b-4bd9-8c9e-de1bf09389f9 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:30.272113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1059/2082] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:30.272990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96939be2-721b-4bd9-8c9e-de1bf09389f9 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:30.274262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-96939be2-721b-4bd9-8c9e-de1bf09389f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:30.286605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96939be2-721b-4bd9-8c9e-de1bf09389f9 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:30.291995 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fc2e7-e056-4a83-a9ba-664516314ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:30.294579 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fc2e7-e056-4a83-a9ba-664516314ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:30.294579 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fc2e7-e056-4a83-a9ba-664516314ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:30.294579 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fc2e7-e056-4a83-a9ba-664516314ec7 admin admin] PATH_INFO: `/v3/projects/70afed7a881543b0a17412174024562b` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:30.294579 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fc2e7-e056-4a83-a9ba-664516314ec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70afed7a881543b0a17412174024562b)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:30.296490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fc2e7-e056-4a83-a9ba-664516314ec7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:30.359018 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2c2622ec-ac7c-4461-b60e-4f644ab83d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c01859164e246429b9eed524cb74712', 'request_id': 'req-2c2622ec-ac7c-4461-b60e-4f644ab83d6d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.365627 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2c2622ec-ac7c-4461-b60e-4f644ab83d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c01859164e246429b9eed524cb74712', 'request_id': 'req-2c2622ec-ac7c-4461-b60e-4f644ab83d6d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.372288 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2c2622ec-ac7c-4461-b60e-4f644ab83d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c01859164e246429b9eed524cb74712', 'request_id': 'req-2c2622ec-ac7c-4461-b60e-4f644ab83d6d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.450344 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4a0fc2e7-e056-4a83-a9ba-664516314ec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70afed7a881543b0a17412174024562b', 'request_id': 'req-4a0fc2e7-e056-4a83-a9ba-664516314ec7'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.456416 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4a0fc2e7-e056-4a83-a9ba-664516314ec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70afed7a881543b0a17412174024562b', 'request_id': 'req-4a0fc2e7-e056-4a83-a9ba-664516314ec7'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.462576 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4a0fc2e7-e056-4a83-a9ba-664516314ec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70afed7a881543b0a17412174024562b', 'request_id': 'req-4a0fc2e7-e056-4a83-a9ba-664516314ec7'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.492056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2c2622ec-ac7c-4461-b60e-4f644ab83d6d admin admin] The token cache is being invalidate because project 1c01859164e246429b9eed524cb74712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:30.492638 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2c2622ec-ac7c-4461-b60e-4f644ab83d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.493533 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2c2622ec-ac7c-4461-b60e-4f644ab83d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.499189 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1024/2083] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:30 2022] DELETE /identity/v3/projects/1c01859164e246429b9eed524cb74712 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:30.500445 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2622ec-ac7c-4461-b60e-4f644ab83d6d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:30.502178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2c2622ec-ac7c-4461-b60e-4f644ab83d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:30.572278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2622ec-ac7c-4461-b60e-4f644ab83d6d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:30.625761 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4a0fc2e7-e056-4a83-a9ba-664516314ec7 admin admin] The token cache is being invalidate because project 70afed7a881543b0a17412174024562b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:30.626599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4a0fc2e7-e056-4a83-a9ba-664516314ec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.627503 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4a0fc2e7-e056-4a83-a9ba-664516314ec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.629575 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1060/2084] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:30 2022] DELETE /identity/v3/projects/70afed7a881543b0a17412174024562b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:30.631764 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fc2e7-e056-4a83-a9ba-664516314ec7 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:30.636998 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad656f41-e055-48bc-8fcf-ae49ef7b4614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:30.637725 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad656f41-e055-48bc-8fcf-ae49ef7b4614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:30.638014 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad656f41-e055-48bc-8fcf-ae49ef7b4614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:30.638292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad656f41-e055-48bc-8fcf-ae49ef7b4614 admin admin] PATH_INFO: `/v3/users/05c2de23718347f2a2895f144998831c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:30.639608 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad656f41-e055-48bc-8fcf-ae49ef7b4614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c2de23718347f2a2895f144998831c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:30.641751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad656f41-e055-48bc-8fcf-ae49ef7b4614 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:30.644708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4a0fc2e7-e056-4a83-a9ba-664516314ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:30.664615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fc2e7-e056-4a83-a9ba-664516314ec7 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:30.670621 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf0fc4-f9ef-44e3-b09e-07e49866b595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:30.671276 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf0fc4-f9ef-44e3-b09e-07e49866b595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:30.671649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf0fc4-f9ef-44e3-b09e-07e49866b595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:30.671927 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf0fc4-f9ef-44e3-b09e-07e49866b595 admin admin] PATH_INFO: `/v3/users/4336f75c6e4044a180c83641882e10d6` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:30.673331 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf0fc4-f9ef-44e3-b09e-07e49866b595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4336f75c6e4044a180c83641882e10d6)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:30.675301 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf0fc4-f9ef-44e3-b09e-07e49866b595 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:30.774274 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:30.871471 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-32bf0fc4-f9ef-44e3-b09e-07e49866b595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4336f75c6e4044a180c83641882e10d6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.872194 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-32bf0fc4-f9ef-44e3-b09e-07e49866b595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4336f75c6e4044a180c83641882e10d6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.874532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ad656f41-e055-48bc-8fcf-ae49ef7b4614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c2de23718347f2a2895f144998831c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.875298 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ad656f41-e055-48bc-8fcf-ae49ef7b4614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c2de23718347f2a2895f144998831c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.889357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ad656f41-e055-48bc-8fcf-ae49ef7b4614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c2de23718347f2a2895f144998831c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.896432 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ad656f41-e055-48bc-8fcf-ae49ef7b4614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c2de23718347f2a2895f144998831c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.923859 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-32bf0fc4-f9ef-44e3-b09e-07e49866b595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4336f75c6e4044a180c83641882e10d6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.937197 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-32bf0fc4-f9ef-44e3-b09e-07e49866b595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4336f75c6e4044a180c83641882e10d6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.937896 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-32bf0fc4-f9ef-44e3-b09e-07e49866b595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4336f75c6e4044a180c83641882e10d6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.950649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1061/2085] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:30 2022] DELETE /identity/v3/users/4336f75c6e4044a180c83641882e10d6 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:30.951873 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d38fae-b1cb-41bd-a3b2-70c7c00b0197 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:30.952171 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d38fae-b1cb-41bd-a3b2-70c7c00b0197 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:30.952438 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d38fae-b1cb-41bd-a3b2-70c7c00b0197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:30.973538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-64d38fae-b1cb-41bd-a3b2-70c7c00b0197 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:30.974432 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ad656f41-e055-48bc-8fcf-ae49ef7b4614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c2de23718347f2a2895f144998831c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:30.974790 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-64d38fae-b1cb-41bd-a3b2-70c7c00b0197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:30.986682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1025/2086] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:30 2022] DELETE /identity/v3/users/05c2de23718347f2a2895f144998831c => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:30.987524 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad656f41-e055-48bc-8fcf-ae49ef7b4614 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:30.989075 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ad656f41-e055-48bc-8fcf-ae49ef7b4614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:31.050456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1062/2087] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:31.050456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02c183-1e89-4337-8399-4d41fc29d734 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:31.050456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02c183-1e89-4337-8399-4d41fc29d734 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:31.050456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02c183-1e89-4337-8399-4d41fc29d734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:31.061436 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad656f41-e055-48bc-8fcf-ae49ef7b4614 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:31.066657 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc7b01-100b-4dc4-a3de-e3d095c9b5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:31.067308 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-1c02c183-1e89-4337-8399-4d41fc29d734 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:31.067440 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc7b01-100b-4dc4-a3de-e3d095c9b5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:31.067628 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc7b01-100b-4dc4-a3de-e3d095c9b5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:31.068620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc7b01-100b-4dc4-a3de-e3d095c9b5c0 admin admin] PATH_INFO: `/v3/projects/79734d8fd9b94fa2b8f6770c9fd1214f` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:31.069412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1c02c183-1e89-4337-8399-4d41fc29d734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:31.069975 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc7b01-100b-4dc4-a3de-e3d095c9b5c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79734d8fd9b94fa2b8f6770c9fd1214f)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:31.072198 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc7b01-100b-4dc4-a3de-e3d095c9b5c0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:31.077556 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1063/2088] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:31.082163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c197e5f-834a-456f-9ab6-d4fbe8044b40 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:31.082488 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c197e5f-834a-456f-9ab6-d4fbe8044b40 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:31.082679 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c197e5f-834a-456f-9ab6-d4fbe8044b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:31.102192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-4c197e5f-834a-456f-9ab6-d4fbe8044b40 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:31.103401 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4c197e5f-834a-456f-9ab6-d4fbe8044b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:31.111310 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1064/2089] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:31.112071 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c197e5f-834a-456f-9ab6-d4fbe8044b40 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:31.113302 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4c197e5f-834a-456f-9ab6-d4fbe8044b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:31.174160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c197e5f-834a-456f-9ab6-d4fbe8044b40 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:31.178412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbcca2-47d1-4e96-b6b0-a9349caba8bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:31.179154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbcca2-47d1-4e96-b6b0-a9349caba8bf service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:31.179357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbcca2-47d1-4e96-b6b0-a9349caba8bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:31.179577 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbcca2-47d1-4e96-b6b0-a9349caba8bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:31.190918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbcca2-47d1-4e96-b6b0-a9349caba8bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:31.192402 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbcca2-47d1-4e96-b6b0-a9349caba8bf service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:31.192539 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-addc7b01-100b-4dc4-a3de-e3d095c9b5c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79734d8fd9b94fa2b8f6770c9fd1214f', 'request_id': 'req-addc7b01-100b-4dc4-a3de-e3d095c9b5c0'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:31.199061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-addc7b01-100b-4dc4-a3de-e3d095c9b5c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79734d8fd9b94fa2b8f6770c9fd1214f', 'request_id': 'req-addc7b01-100b-4dc4-a3de-e3d095c9b5c0'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:31.202851 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1065/2090] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:31.203815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbcca2-47d1-4e96-b6b0-a9349caba8bf service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:31.204770 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-addc7b01-100b-4dc4-a3de-e3d095c9b5c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79734d8fd9b94fa2b8f6770c9fd1214f', 'request_id': 'req-addc7b01-100b-4dc4-a3de-e3d095c9b5c0'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:31.213596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbcca2-47d1-4e96-b6b0-a9349caba8bf service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:31.238896 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:31.278641 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3287f9-1a10-41f3-b29a-c53ba1b8ab5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:31.279590 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3287f9-1a10-41f3-b29a-c53ba1b8ab5e admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:31.280042 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3287f9-1a10-41f3-b29a-c53ba1b8ab5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:31.280480 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3287f9-1a10-41f3-b29a-c53ba1b8ab5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:31.281366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3287f9-1a10-41f3-b29a-c53ba1b8ab5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:31.284777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3287f9-1a10-41f3-b29a-c53ba1b8ab5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:31.284777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3287f9-1a10-41f3-b29a-c53ba1b8ab5e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:31.297237 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1066/2091] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:24:31.301721 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3287f9-1a10-41f3-b29a-c53ba1b8ab5e admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:31.314903 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3287f9-1a10-41f3-b29a-c53ba1b8ab5e admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:31.315751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-addc7b01-100b-4dc4-a3de-e3d095c9b5c0 admin admin] The token cache is being invalidate because project 79734d8fd9b94fa2b8f6770c9fd1214f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:31.316217 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-addc7b01-100b-4dc4-a3de-e3d095c9b5c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:31.319198 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-addc7b01-100b-4dc4-a3de-e3d095c9b5c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:31.320479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1026/2092] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:30 2022] DELETE /identity/v3/projects/79734d8fd9b94fa2b8f6770c9fd1214f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:31.320604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b788ef-eb49-4751-b042-5d495b9126c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:31.321333 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b788ef-eb49-4751-b042-5d495b9126c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:31.321688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b788ef-eb49-4751-b042-5d495b9126c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:31.321970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b788ef-eb49-4751-b042-5d495b9126c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:31.322678 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b788ef-eb49-4751-b042-5d495b9126c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:31.324682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b788ef-eb49-4751-b042-5d495b9126c5 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:31.325229 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc7b01-100b-4dc4-a3de-e3d095c9b5c0 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:31.326616 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-addc7b01-100b-4dc4-a3de-e3d095c9b5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:31.343796 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc7b01-100b-4dc4-a3de-e3d095c9b5c0 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:31.348839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cebd82-e37a-4cad-a6e2-94d742df2134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:31.350077 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cebd82-e37a-4cad-a6e2-94d742df2134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:31.350422 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cebd82-e37a-4cad-a6e2-94d742df2134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:31.350757 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cebd82-e37a-4cad-a6e2-94d742df2134 admin admin] PATH_INFO: `/v3/users/cb9ab17dc4134b6682f9f416330e239f` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:31.352069 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cebd82-e37a-4cad-a6e2-94d742df2134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb9ab17dc4134b6682f9f416330e239f)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:31.354236 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cebd82-e37a-4cad-a6e2-94d742df2134 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:31.431796 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1067/2093] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:31 2022] POST /identity/v3/projects => generated 374 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:31.436106 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b788ef-eb49-4751-b042-5d495b9126c5 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:31.437902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-67b788ef-eb49-4751-b042-5d495b9126c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:31.507515 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b788ef-eb49-4751-b042-5d495b9126c5 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:31.512022 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b59f1-87f9-42b7-af44-2ee8ba579d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:31.512685 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b59f1-87f9-42b7-af44-2ee8ba579d88 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:31.512980 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b59f1-87f9-42b7-af44-2ee8ba579d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:31.513368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b59f1-87f9-42b7-af44-2ee8ba579d88 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:31.514057 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b59f1-87f9-42b7-af44-2ee8ba579d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:31.516018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b59f1-87f9-42b7-af44-2ee8ba579d88 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:31.569420 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b6cebd82-e37a-4cad-a6e2-94d742df2134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb9ab17dc4134b6682f9f416330e239f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:31.570114 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b6cebd82-e37a-4cad-a6e2-94d742df2134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb9ab17dc4134b6682f9f416330e239f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:31.582512 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b6cebd82-e37a-4cad-a6e2-94d742df2134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb9ab17dc4134b6682f9f416330e239f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:31.590174 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b6cebd82-e37a-4cad-a6e2-94d742df2134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb9ab17dc4134b6682f9f416330e239f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:31.644255 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1068/2094] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:31 2022] POST /identity/v3/users => generated 288 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:24:31.645346 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b59f1-87f9-42b7-af44-2ee8ba579d88 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:31.647676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-403b59f1-87f9-42b7-af44-2ee8ba579d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:31.661236 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b6cebd82-e37a-4cad-a6e2-94d742df2134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb9ab17dc4134b6682f9f416330e239f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:31.662472 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b59f1-87f9-42b7-af44-2ee8ba579d88 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:31.672093 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1027/2095] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:31 2022] DELETE /identity/v3/users/cb9ab17dc4134b6682f9f416330e239f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:31.672093 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cebd82-e37a-4cad-a6e2-94d742df2134 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:31.672093 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b6cebd82-e37a-4cad-a6e2-94d742df2134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:31.673320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b08a3-486e-4aa0-a9cf-5a8eb8b4d8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:31.674582 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b08a3-486e-4aa0-a9cf-5a8eb8b4d8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:31.675052 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b08a3-486e-4aa0-a9cf-5a8eb8b4d8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:31.675367 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b08a3-486e-4aa0-a9cf-5a8eb8b4d8de admin admin] PATH_INFO: `/v3/projects/9557ff9563514d02bb83b968baed10f6` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:31.677209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b08a3-486e-4aa0-a9cf-5a8eb8b4d8de admin admin] RBAC: Authorizing `identity:delete_project(project_id=9557ff9563514d02bb83b968baed10f6)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:31.679631 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b08a3-486e-4aa0-a9cf-5a8eb8b4d8de admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:31.755118 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cebd82-e37a-4cad-a6e2-94d742df2134 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:31.759847 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a69677-9bcf-44b8-b602-9e612cde754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:31.760470 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a69677-9bcf-44b8-b602-9e612cde754d admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:31.760888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a69677-9bcf-44b8-b602-9e612cde754d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:31.761163 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a69677-9bcf-44b8-b602-9e612cde754d admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:31.761855 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a69677-9bcf-44b8-b602-9e612cde754d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:31.765483 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a69677-9bcf-44b8-b602-9e612cde754d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:31.775208 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1028/2096] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:31 2022] GET /identity/v3/roles => generated 1427 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:31.776092 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a69677-9bcf-44b8-b602-9e612cde754d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:31.777809 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-15a69677-9bcf-44b8-b602-9e612cde754d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:31.792125 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a69677-9bcf-44b8-b602-9e612cde754d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:31.804593 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ab0b08a3-486e-4aa0-a9cf-5a8eb8b4d8de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9557ff9563514d02bb83b968baed10f6', 'request_id': 'req-ab0b08a3-486e-4aa0-a9cf-5a8eb8b4d8de'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:31.812134 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ab0b08a3-486e-4aa0-a9cf-5a8eb8b4d8de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9557ff9563514d02bb83b968baed10f6', 'request_id': 'req-ab0b08a3-486e-4aa0-a9cf-5a8eb8b4d8de'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:31.818027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ab0b08a3-486e-4aa0-a9cf-5a8eb8b4d8de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9557ff9563514d02bb83b968baed10f6', 'request_id': 'req-ab0b08a3-486e-4aa0-a9cf-5a8eb8b4d8de'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:31.860076 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed267c-4c98-4a39-922b-db6c1f829e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:31.860884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed267c-4c98-4a39-922b-db6c1f829e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:31.861582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed267c-4c98-4a39-922b-db6c1f829e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:31.861582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed267c-4c98-4a39-922b-db6c1f829e27 admin admin] PATH_INFO: `/v3/projects/bd43e91a4470464281189e2e68fd2ecd` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:31.862670 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed267c-4c98-4a39-922b-db6c1f829e27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd43e91a4470464281189e2e68fd2ecd)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:31.864887 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed267c-4c98-4a39-922b-db6c1f829e27 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:31.920639 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ab0b08a3-486e-4aa0-a9cf-5a8eb8b4d8de admin admin] The token cache is being invalidate because project 9557ff9563514d02bb83b968baed10f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:31.921005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ab0b08a3-486e-4aa0-a9cf-5a8eb8b4d8de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:31.921694 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ab0b08a3-486e-4aa0-a9cf-5a8eb8b4d8de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:31.928773 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1069/2097] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:31 2022] DELETE /identity/v3/projects/9557ff9563514d02bb83b968baed10f6 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:31.929900 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b08a3-486e-4aa0-a9cf-5a8eb8b4d8de admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:31.932990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ab0b08a3-486e-4aa0-a9cf-5a8eb8b4d8de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:31.951189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b08a3-486e-4aa0-a9cf-5a8eb8b4d8de admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:31.959560 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e462543-a8f6-47ed-9502-4aa7acd0d866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:31.961759 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e462543-a8f6-47ed-9502-4aa7acd0d866 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:31.961759 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e462543-a8f6-47ed-9502-4aa7acd0d866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:31.961759 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e462543-a8f6-47ed-9502-4aa7acd0d866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:31.961759 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e462543-a8f6-47ed-9502-4aa7acd0d866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:31.964331 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e462543-a8f6-47ed-9502-4aa7acd0d866 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:31.977789 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1070/2098] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:31 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:31.979050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c92fa-7b3d-4c41-8563-8454289bc1f9 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:31.979329 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c92fa-7b3d-4c41-8563-8454289bc1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:31.979596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c92fa-7b3d-4c41-8563-8454289bc1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:31.999847 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5a2c92fa-7b3d-4c41-8563-8454289bc1f9 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:32.004898 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5a2c92fa-7b3d-4c41-8563-8454289bc1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:32.016031 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c6ed267c-4c98-4a39-922b-db6c1f829e27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd43e91a4470464281189e2e68fd2ecd', 'request_id': 'req-c6ed267c-4c98-4a39-922b-db6c1f829e27'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:32.023953 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c6ed267c-4c98-4a39-922b-db6c1f829e27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd43e91a4470464281189e2e68fd2ecd', 'request_id': 'req-c6ed267c-4c98-4a39-922b-db6c1f829e27'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:32.030139 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c6ed267c-4c98-4a39-922b-db6c1f829e27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd43e91a4470464281189e2e68fd2ecd', 'request_id': 'req-c6ed267c-4c98-4a39-922b-db6c1f829e27'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:32.072136 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1071/2099] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:32.073158 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c92fa-7b3d-4c41-8563-8454289bc1f9 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:32.091215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c92fa-7b3d-4c41-8563-8454289bc1f9 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:32.096106 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0561fd-97f3-46b7-8d9a-2b4ff1bf58dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:32.100581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0561fd-97f3-46b7-8d9a-2b4ff1bf58dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:32.100581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0561fd-97f3-46b7-8d9a-2b4ff1bf58dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:32.100581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0561fd-97f3-46b7-8d9a-2b4ff1bf58dd admin admin] PATH_INFO: `/v3/projects/7e4c18c6f2774e7890f89156ac3a899d/users/60cebc0a7340415f9b676bf2063fedef/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:32.116272 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0561fd-97f3-46b7-8d9a-2b4ff1bf58dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e4c18c6f2774e7890f89156ac3a899d, user_id=60cebc0a7340415f9b676bf2063fedef, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:32.119023 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0561fd-97f3-46b7-8d9a-2b4ff1bf58dd admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:32.155180 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c6ed267c-4c98-4a39-922b-db6c1f829e27 admin admin] The token cache is being invalidate because project bd43e91a4470464281189e2e68fd2ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:32.155456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c6ed267c-4c98-4a39-922b-db6c1f829e27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:32.158062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c6ed267c-4c98-4a39-922b-db6c1f829e27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:32.158202 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1029/2100] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:31 2022] DELETE /identity/v3/projects/bd43e91a4470464281189e2e68fd2ecd => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:32.160984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef4698-2db1-4ca5-8095-cc8cbb6ac48c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:32.161727 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef4698-2db1-4ca5-8095-cc8cbb6ac48c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:32.162271 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef4698-2db1-4ca5-8095-cc8cbb6ac48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:32.185567 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-f5ef4698-2db1-4ca5-8095-cc8cbb6ac48c None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:32.186884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f5ef4698-2db1-4ca5-8095-cc8cbb6ac48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:32.195512 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1030/2101] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:32.196356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef4698-2db1-4ca5-8095-cc8cbb6ac48c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:32.197628 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f5ef4698-2db1-4ca5-8095-cc8cbb6ac48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:32.210025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1072/2102] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:32 2022] PUT /identity/v3/projects/7e4c18c6f2774e7890f89156ac3a899d/users/60cebc0a7340415f9b676bf2063fedef/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:32.210870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0561fd-97f3-46b7-8d9a-2b4ff1bf58dd admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:32.212422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1b0561fd-97f3-46b7-8d9a-2b4ff1bf58dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:32.257086 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef4698-2db1-4ca5-8095-cc8cbb6ac48c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:32.276444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0561fd-97f3-46b7-8d9a-2b4ff1bf58dd admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:32.281053 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751c501-96a9-4beb-862c-5187e3120782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:32.281695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751c501-96a9-4beb-862c-5187e3120782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:32.281986 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751c501-96a9-4beb-862c-5187e3120782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:32.282265 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751c501-96a9-4beb-862c-5187e3120782 admin admin] PATH_INFO: `/v3/projects/07fd0af42fc24fd396fe7d941f722806` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:32.283511 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751c501-96a9-4beb-862c-5187e3120782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07fd0af42fc24fd396fe7d941f722806)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:32.285679 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751c501-96a9-4beb-862c-5187e3120782 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:32.307821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa24d3-e3b9-4320-b22b-a7a78b6477e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:32.308530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa24d3-e3b9-4320-b22b-a7a78b6477e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:32.308841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa24d3-e3b9-4320-b22b-a7a78b6477e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:32.316638 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa24d3-e3b9-4320-b22b-a7a78b6477e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:32.316638 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4baa24d3-e3b9-4320-b22b-a7a78b6477e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:32.369419 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa24d3-e3b9-4320-b22b-a7a78b6477e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:32.370856 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa24d3-e3b9-4320-b22b-a7a78b6477e1 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:32.379688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1031/2103] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:32.381079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa24d3-e3b9-4320-b22b-a7a78b6477e1 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:32.382351 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4baa24d3-e3b9-4320-b22b-a7a78b6477e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:32.396574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa24d3-e3b9-4320-b22b-a7a78b6477e1 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:32.401345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a3e1c-e682-4586-8e55-d4745d02d6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:32.402171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a3e1c-e682-4586-8e55-d4745d02d6fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:32.402453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a3e1c-e682-4586-8e55-d4745d02d6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:32.402737 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a3e1c-e682-4586-8e55-d4745d02d6fa admin admin] PATH_INFO: `/v3/users/a090286bdfa94e76a2f69213d375c91b` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:32.403920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a3e1c-e682-4586-8e55-d4745d02d6fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a090286bdfa94e76a2f69213d375c91b)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:32.404259 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:32.405903 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a3e1c-e682-4586-8e55-d4745d02d6fa admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:32.466581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2751c501-96a9-4beb-862c-5187e3120782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07fd0af42fc24fd396fe7d941f722806', 'request_id': 'req-2751c501-96a9-4beb-862c-5187e3120782'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:32.473166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2751c501-96a9-4beb-862c-5187e3120782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07fd0af42fc24fd396fe7d941f722806', 'request_id': 'req-2751c501-96a9-4beb-862c-5187e3120782'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:32.479002 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2751c501-96a9-4beb-862c-5187e3120782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07fd0af42fc24fd396fe7d941f722806', 'request_id': 'req-2751c501-96a9-4beb-862c-5187e3120782'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:32.569387 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2751c501-96a9-4beb-862c-5187e3120782 admin admin] The token cache is being invalidate because project 07fd0af42fc24fd396fe7d941f722806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:32.570043 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2751c501-96a9-4beb-862c-5187e3120782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:32.570238 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2751c501-96a9-4beb-862c-5187e3120782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:32.571748 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1073/2104] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:32 2022] DELETE /identity/v3/projects/07fd0af42fc24fd396fe7d941f722806 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:32.572651 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751c501-96a9-4beb-862c-5187e3120782 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:32.574098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2751c501-96a9-4beb-862c-5187e3120782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:32.578676 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bb9a3e1c-e682-4586-8e55-d4745d02d6fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a090286bdfa94e76a2f69213d375c91b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:32.579535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bb9a3e1c-e682-4586-8e55-d4745d02d6fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a090286bdfa94e76a2f69213d375c91b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:32.591643 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bb9a3e1c-e682-4586-8e55-d4745d02d6fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a090286bdfa94e76a2f69213d375c91b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:32.598800 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bb9a3e1c-e682-4586-8e55-d4745d02d6fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a090286bdfa94e76a2f69213d375c91b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:32.636959 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751c501-96a9-4beb-862c-5187e3120782 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:32.641618 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afd03e-48f5-4e32-9219-940e3a89522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:32.642225 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afd03e-48f5-4e32-9219-940e3a89522e admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:32.642504 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afd03e-48f5-4e32-9219-940e3a89522e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:32.642771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afd03e-48f5-4e32-9219-940e3a89522e admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:32.643446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6afd03e-48f5-4e32-9219-940e3a89522e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:32.643800 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6afd03e-48f5-4e32-9219-940e3a89522e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:32.645535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6afd03e-48f5-4e32-9219-940e3a89522e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:32.657199 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1074/2105] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:24:32.658649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29ecd7-4ed1-4a72-b0d5-78774c6c56ab None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:32.659582 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29ecd7-4ed1-4a72-b0d5-78774c6c56ab None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:32.659582 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29ecd7-4ed1-4a72-b0d5-78774c6c56ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:32.690615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-7a29ecd7-4ed1-4a72-b0d5-78774c6c56ab None None] MFA Rules not processed for user `60cebc0a7340415f9b676bf2063fedef`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:32.691917 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7a29ecd7-4ed1-4a72-b0d5-78774c6c56ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:32.756916 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1075/2106] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:32.758183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798e784-c0a5-4b0a-81b0-dfb651870183 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:32.758463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798e784-c0a5-4b0a-81b0-dfb651870183 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:32.758731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798e784-c0a5-4b0a-81b0-dfb651870183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:32.778008 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f798e784-c0a5-4b0a-81b0-dfb651870183 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:32.779218 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f798e784-c0a5-4b0a-81b0-dfb651870183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:32.787889 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1076/2107] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:32.788616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798e784-c0a5-4b0a-81b0-dfb651870183 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:32.798198 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798e784-c0a5-4b0a-81b0-dfb651870183 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:32.803320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b826f03-fc9b-4bfc-8043-1a90588da980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:32.803905 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b826f03-fc9b-4bfc-8043-1a90588da980 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:32.804212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b826f03-fc9b-4bfc-8043-1a90588da980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:32.804477 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b826f03-fc9b-4bfc-8043-1a90588da980 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:32.805485 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b826f03-fc9b-4bfc-8043-1a90588da980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:32.807414 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b826f03-fc9b-4bfc-8043-1a90588da980 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:32.909855 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bb9a3e1c-e682-4586-8e55-d4745d02d6fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a090286bdfa94e76a2f69213d375c91b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:32.917451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1032/2108] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:32 2022] DELETE /identity/v3/users/a090286bdfa94e76a2f69213d375c91b => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:32.917930 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a3e1c-e682-4586-8e55-d4745d02d6fa admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:32.919506 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-bb9a3e1c-e682-4586-8e55-d4745d02d6fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:32.987346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a3e1c-e682-4586-8e55-d4745d02d6fa admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:32.994437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207b493-0ab8-4856-a74f-eb3d44b13bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:32.997360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207b493-0ab8-4856-a74f-eb3d44b13bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:32.997360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207b493-0ab8-4856-a74f-eb3d44b13bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:32.997360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207b493-0ab8-4856-a74f-eb3d44b13bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:32.997360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207b493-0ab8-4856-a74f-eb3d44b13bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:32.998411 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207b493-0ab8-4856-a74f-eb3d44b13bf4 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:33.092145 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1077/2109] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:32 2022] POST /identity/v3/projects => generated 386 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:33.093422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845f6cb-f63d-41ba-987f-e5f5f20c3c40 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:33.093712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845f6cb-f63d-41ba-987f-e5f5f20c3c40 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:33.094126 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845f6cb-f63d-41ba-987f-e5f5f20c3c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:33.114051 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-e845f6cb-f63d-41ba-987f-e5f5f20c3c40 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:33.115329 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e845f6cb-f63d-41ba-987f-e5f5f20c3c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:33.142935 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1033/2110] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:32 2022] POST /identity/v3/projects => generated 374 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:33.142935 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207b493-0ab8-4856-a74f-eb3d44b13bf4 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:33.157980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9207b493-0ab8-4856-a74f-eb3d44b13bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:33.192444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1078/2111] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:33.193481 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845f6cb-f63d-41ba-987f-e5f5f20c3c40 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:33.204161 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845f6cb-f63d-41ba-987f-e5f5f20c3c40 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:33.233389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:33.238832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207b493-0ab8-4856-a74f-eb3d44b13bf4 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:33.244054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43486522-c402-4e3c-bb03-7ca63a6306f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:33.244706 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43486522-c402-4e3c-bb03-7ca63a6306f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:33.245306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43486522-c402-4e3c-bb03-7ca63a6306f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:33.245306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43486522-c402-4e3c-bb03-7ca63a6306f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:33.245923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43486522-c402-4e3c-bb03-7ca63a6306f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:33.247867 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43486522-c402-4e3c-bb03-7ca63a6306f0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:33.267524 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f611dca-cd15-4047-a23e-6f48dd148775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:33.268163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f611dca-cd15-4047-a23e-6f48dd148775 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:33.268435 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f611dca-cd15-4047-a23e-6f48dd148775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:33.268757 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f611dca-cd15-4047-a23e-6f48dd148775 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:33.269430 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f611dca-cd15-4047-a23e-6f48dd148775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:33.271932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f611dca-cd15-4047-a23e-6f48dd148775 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:33.368924 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1034/2112] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:33 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:33.369821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43486522-c402-4e3c-bb03-7ca63a6306f0 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:33.379668 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43486522-c402-4e3c-bb03-7ca63a6306f0 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:33.384434 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f90b6-a21d-4589-8be6-53ee283ce9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:33.385054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f90b6-a21d-4589-8be6-53ee283ce9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:33.385342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f90b6-a21d-4589-8be6-53ee283ce9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:33.385617 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f90b6-a21d-4589-8be6-53ee283ce9f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:33.386302 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f90b6-a21d-4589-8be6-53ee283ce9f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:33.386607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f90b6-a21d-4589-8be6-53ee283ce9f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:33.388235 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f90b6-a21d-4589-8be6-53ee283ce9f5 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:33.406791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1079/2113] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:33 2022] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:33.406791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f611dca-cd15-4047-a23e-6f48dd148775 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:33.407115 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1035/2114] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:24:33.407216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f90b6-a21d-4589-8be6-53ee283ce9f5 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:33.409113 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f33f90b6-a21d-4589-8be6-53ee283ce9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:33.422543 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f611dca-cd15-4047-a23e-6f48dd148775 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:33.424091 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f90b6-a21d-4589-8be6-53ee283ce9f5 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:33.426289 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56af54-b635-4a2e-88f8-e5410b497721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:33.427688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56af54-b635-4a2e-88f8-e5410b497721 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:33.428099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56af54-b635-4a2e-88f8-e5410b497721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:33.428581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56af54-b635-4a2e-88f8-e5410b497721 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:33.429224 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b2eaf-be1d-426a-9ec5-5ecaf31cbd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:33.429699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56af54-b635-4a2e-88f8-e5410b497721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:33.429874 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2eaf-be1d-426a-9ec5-5ecaf31cbd26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:33.430160 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2eaf-be1d-426a-9ec5-5ecaf31cbd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:33.430439 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2eaf-be1d-426a-9ec5-5ecaf31cbd26 admin admin] PATH_INFO: `/v3/projects/95a4bd08bdb043e5be4593524bfd9419` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:33.431713 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b2eaf-be1d-426a-9ec5-5ecaf31cbd26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a4bd08bdb043e5be4593524bfd9419)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:33.432431 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56af54-b635-4a2e-88f8-e5410b497721 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:33.433659 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b2eaf-be1d-426a-9ec5-5ecaf31cbd26 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:33.444246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1080/2115] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:33 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:33.445088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56af54-b635-4a2e-88f8-e5410b497721 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:33.454700 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56af54-b635-4a2e-88f8-e5410b497721 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:33.460211 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02a20c-4a7a-437c-a63f-b00fe24cb7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:33.460961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02a20c-4a7a-437c-a63f-b00fe24cb7ee admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:33.461241 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02a20c-4a7a-437c-a63f-b00fe24cb7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:33.461516 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02a20c-4a7a-437c-a63f-b00fe24cb7ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:33.462336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02a20c-4a7a-437c-a63f-b00fe24cb7ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:33.464365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02a20c-4a7a-437c-a63f-b00fe24cb7ee admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:33.582479 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1081/2116] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:33 2022] POST /identity/v3/projects => generated 386 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:33.582479 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02a20c-4a7a-437c-a63f-b00fe24cb7ee admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:33.589235 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-609b2eaf-be1d-426a-9ec5-5ecaf31cbd26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a4bd08bdb043e5be4593524bfd9419', 'request_id': 'req-609b2eaf-be1d-426a-9ec5-5ecaf31cbd26'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:33.595443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-609b2eaf-be1d-426a-9ec5-5ecaf31cbd26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a4bd08bdb043e5be4593524bfd9419', 'request_id': 'req-609b2eaf-be1d-426a-9ec5-5ecaf31cbd26'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:33.601176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-609b2eaf-be1d-426a-9ec5-5ecaf31cbd26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a4bd08bdb043e5be4593524bfd9419', 'request_id': 'req-609b2eaf-be1d-426a-9ec5-5ecaf31cbd26'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:33.645480 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02a20c-4a7a-437c-a63f-b00fe24cb7ee admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:33.650833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ab356-2016-464e-baa4-9c772e4594ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:33.651452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ab356-2016-464e-baa4-9c772e4594ac admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:33.651737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ab356-2016-464e-baa4-9c772e4594ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:33.652046 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ab356-2016-464e-baa4-9c772e4594ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:33.652769 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ab356-2016-464e-baa4-9c772e4594ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:33.654449 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ab356-2016-464e-baa4-9c772e4594ac admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:33.664118 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1082/2117] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:33 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:33.664936 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ab356-2016-464e-baa4-9c772e4594ac admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:33.674728 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ab356-2016-464e-baa4-9c772e4594ac admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:33.680897 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d395bb5-f60d-4e9b-959c-52ccc2b890f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:33.680897 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d395bb5-f60d-4e9b-959c-52ccc2b890f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:33.680897 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d395bb5-f60d-4e9b-959c-52ccc2b890f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:33.680897 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d395bb5-f60d-4e9b-959c-52ccc2b890f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:33.681356 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d395bb5-f60d-4e9b-959c-52ccc2b890f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:33.682940 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d395bb5-f60d-4e9b-959c-52ccc2b890f6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:33.693473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1083/2118] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:33 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:33.694241 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d395bb5-f60d-4e9b-959c-52ccc2b890f6 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:33.703558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d395bb5-f60d-4e9b-959c-52ccc2b890f6 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:33.708226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150e30f-809c-4919-ba64-31454548c313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:33.709480 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150e30f-809c-4919-ba64-31454548c313 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:33.709789 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150e30f-809c-4919-ba64-31454548c313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:33.710069 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150e30f-809c-4919-ba64-31454548c313 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:33.710706 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150e30f-809c-4919-ba64-31454548c313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:33.712589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150e30f-809c-4919-ba64-31454548c313 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:33.729205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-609b2eaf-be1d-426a-9ec5-5ecaf31cbd26 admin admin] The token cache is being invalidate because project 95a4bd08bdb043e5be4593524bfd9419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:33.729500 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-609b2eaf-be1d-426a-9ec5-5ecaf31cbd26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:33.730136 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-609b2eaf-be1d-426a-9ec5-5ecaf31cbd26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:33.731695 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1036/2119] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:33 2022] DELETE /identity/v3/projects/95a4bd08bdb043e5be4593524bfd9419 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:33.732500 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b2eaf-be1d-426a-9ec5-5ecaf31cbd26 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:33.733856 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-609b2eaf-be1d-426a-9ec5-5ecaf31cbd26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:33.798365 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b2eaf-be1d-426a-9ec5-5ecaf31cbd26 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:33.803806 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70dfde-2ed9-4a85-b747-553857fbd16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:33.804471 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70dfde-2ed9-4a85-b747-553857fbd16e admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:33.804783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70dfde-2ed9-4a85-b747-553857fbd16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:33.805999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70dfde-2ed9-4a85-b747-553857fbd16e admin admin] PATH_INFO: `/v3/projects/fb6ac65340844965ba9a5f47ab6553f1/users/977c6fd02bdd407595ffed33e25fadef/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:33.820319 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70dfde-2ed9-4a85-b747-553857fbd16e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6ac65340844965ba9a5f47ab6553f1, user_id=977c6fd02bdd407595ffed33e25fadef, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:33.823113 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70dfde-2ed9-4a85-b747-553857fbd16e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:33.835795 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1084/2120] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:33 2022] POST /identity/v3/users => generated 294 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:33.836913 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150e30f-809c-4919-ba64-31454548c313 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:33.838463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6150e30f-809c-4919-ba64-31454548c313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:33.850532 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150e30f-809c-4919-ba64-31454548c313 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:33.855171 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269907e7-226a-43cf-bbf1-d20cc8bcfcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:33.855800 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269907e7-226a-43cf-bbf1-d20cc8bcfcf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:33.856078 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269907e7-226a-43cf-bbf1-d20cc8bcfcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:33.856355 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269907e7-226a-43cf-bbf1-d20cc8bcfcf2 admin admin] PATH_INFO: `/v3/projects/5fd49c42af6b4df6af97f1d3e161cdc1/users/9188965d42e34881af4d948265e11220/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:33.872163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269907e7-226a-43cf-bbf1-d20cc8bcfcf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fd49c42af6b4df6af97f1d3e161cdc1, user_id=9188965d42e34881af4d948265e11220, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:33.874869 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269907e7-226a-43cf-bbf1-d20cc8bcfcf2 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:33.915929 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1037/2121] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:33 2022] PUT /identity/v3/projects/fb6ac65340844965ba9a5f47ab6553f1/users/977c6fd02bdd407595ffed33e25fadef/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:33.917244 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5579aeb-fe87-440c-9c9e-a5c9f9876d2a None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:33.917527 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5579aeb-fe87-440c-9c9e-a5c9f9876d2a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:33.917823 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5579aeb-fe87-440c-9c9e-a5c9f9876d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:33.938802 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b5579aeb-fe87-440c-9c9e-a5c9f9876d2a None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:33.940138 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b5579aeb-fe87-440c-9c9e-a5c9f9876d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:33.990836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1085/2122] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:33 2022] PUT /identity/v3/projects/5fd49c42af6b4df6af97f1d3e161cdc1/users/9188965d42e34881af4d948265e11220/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:33.998469 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1038/2123] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:34.000053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5579aeb-fe87-440c-9c9e-a5c9f9876d2a None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:34.001460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269907e7-226a-43cf-bbf1-d20cc8bcfcf2 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:34.003233 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-269907e7-226a-43cf-bbf1-d20cc8bcfcf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:34.011048 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5579aeb-fe87-440c-9c9e-a5c9f9876d2a None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:34.071087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55876302-983c-4801-9509-6408f18574c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:34.071636 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55876302-983c-4801-9509-6408f18574c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:34.071922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55876302-983c-4801-9509-6408f18574c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:34.072194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55876302-983c-4801-9509-6408f18574c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:34.072470 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269907e7-226a-43cf-bbf1-d20cc8bcfcf2 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:34.072908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55876302-983c-4801-9509-6408f18574c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:34.074513 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55876302-983c-4801-9509-6408f18574c5 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:34.077192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309ec07-a4b9-4be4-a392-17194960b1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:34.077806 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309ec07-a4b9-4be4-a392-17194960b1df admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:34.078089 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309ec07-a4b9-4be4-a392-17194960b1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:34.078368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309ec07-a4b9-4be4-a392-17194960b1df admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:34.079066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309ec07-a4b9-4be4-a392-17194960b1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:34.080643 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309ec07-a4b9-4be4-a392-17194960b1df admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:34.084352 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1039/2124] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:33 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:34.085605 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e789a51-39ea-47a8-91e0-7f3bc34a3566 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:34.085896 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e789a51-39ea-47a8-91e0-7f3bc34a3566 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:34.086180 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e789a51-39ea-47a8-91e0-7f3bc34a3566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:34.094549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1086/2125] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:33 2022] GET /identity/v3/roles => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:34.094549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11203937-5dda-42ac-94c0-f4806c043ca9 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:34.094549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11203937-5dda-42ac-94c0-f4806c043ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:34.094549 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11203937-5dda-42ac-94c0-f4806c043ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:34.117688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-11203937-5dda-42ac-94c0-f4806c043ca9 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:34.117688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-11203937-5dda-42ac-94c0-f4806c043ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:34.118749 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-0e789a51-39ea-47a8-91e0-7f3bc34a3566 None None] MFA Rules not processed for user `9188965d42e34881af4d948265e11220`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:34.120134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0e789a51-39ea-47a8-91e0-7f3bc34a3566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:34.128212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1087/2126] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:34.129055 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11203937-5dda-42ac-94c0-f4806c043ca9 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:34.139165 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11203937-5dda-42ac-94c0-f4806c043ca9 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:34.144172 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ca12f-1a38-444a-ba41-8906230b4314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:34.144877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ca12f-1a38-444a-ba41-8906230b4314 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:34.145161 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ca12f-1a38-444a-ba41-8906230b4314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:34.145439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ca12f-1a38-444a-ba41-8906230b4314 admin admin] PATH_INFO: `/v3/projects/fb6ac65340844965ba9a5f47ab6553f1/users/977c6fd02bdd407595ffed33e25fadef/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:34.147423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ca12f-1a38-444a-ba41-8906230b4314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6ac65340844965ba9a5f47ab6553f1, user_id=977c6fd02bdd407595ffed33e25fadef, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:34.150116 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ca12f-1a38-444a-ba41-8906230b4314 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:34.161154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1088/2127] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:34 2022] PUT /identity/v3/projects/fb6ac65340844965ba9a5f47ab6553f1/users/977c6fd02bdd407595ffed33e25fadef/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:34.162528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ca12f-1a38-444a-ba41-8906230b4314 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:34.205101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1040/2128] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:34.209121 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e789a51-39ea-47a8-91e0-7f3bc34a3566 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:34.221551 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e789a51-39ea-47a8-91e0-7f3bc34a3566 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:34.251449 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ca12f-1a38-444a-ba41-8906230b4314 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:34.257567 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb97e47-aa8e-4a82-a127-7360839b7ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:34.262397 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb97e47-aa8e-4a82-a127-7360839b7ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:34.262397 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb97e47-aa8e-4a82-a127-7360839b7ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:34.262397 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb97e47-aa8e-4a82-a127-7360839b7ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:34.262397 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb97e47-aa8e-4a82-a127-7360839b7ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:34.263107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb97e47-aa8e-4a82-a127-7360839b7ef4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:34.275540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1089/2129] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:34 2022] GET /identity/v3/roles => generated 1427 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:34.279867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37b691-6fc2-4076-80b2-c3f235f11700 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:34.280162 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37b691-6fc2-4076-80b2-c3f235f11700 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:34.280438 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37b691-6fc2-4076-80b2-c3f235f11700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:34.283897 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0deec-1589-4b27-987b-484c7a09173f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:34.284530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0deec-1589-4b27-987b-484c7a09173f admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:34.284869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0deec-1589-4b27-987b-484c7a09173f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:34.291600 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0deec-1589-4b27-987b-484c7a09173f admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:34.291600 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0deec-1589-4b27-987b-484c7a09173f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:34.291600 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0deec-1589-4b27-987b-484c7a09173f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:34.291600 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0deec-1589-4b27-987b-484c7a09173f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:34.300904 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1041/2130] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:24:34.302089 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0deec-1589-4b27-987b-484c7a09173f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:34.305284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1bc0deec-1589-4b27-987b-484c7a09173f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:34.317505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-cf37b691-6fc2-4076-80b2-c3f235f11700 None None] MFA Rules not processed for user `977c6fd02bdd407595ffed33e25fadef`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:34.319379 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-cf37b691-6fc2-4076-80b2-c3f235f11700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:34.378639 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0deec-1589-4b27-987b-484c7a09173f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:34.383681 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da156957-c25f-4817-ae7a-5dfcbda061cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:34.384327 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da156957-c25f-4817-ae7a-5dfcbda061cc service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:34.384608 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da156957-c25f-4817-ae7a-5dfcbda061cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:34.384912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da156957-c25f-4817-ae7a-5dfcbda061cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:34.399471 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1090/2131] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:34.405573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37b691-6fc2-4076-80b2-c3f235f11700 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:34.405573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-cf37b691-6fc2-4076-80b2-c3f235f11700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:34.418044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37b691-6fc2-4076-80b2-c3f235f11700 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:34.421996 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221005b-d47a-4de2-acb9-11130d1e6a71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:34.422610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221005b-d47a-4de2-acb9-11130d1e6a71 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:34.422908 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221005b-d47a-4de2-acb9-11130d1e6a71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:34.423205 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221005b-d47a-4de2-acb9-11130d1e6a71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:34.425434 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9221005b-d47a-4de2-acb9-11130d1e6a71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:34.443672 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da156957-c25f-4817-ae7a-5dfcbda061cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:34.445250 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da156957-c25f-4817-ae7a-5dfcbda061cc service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:34.454386 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1042/2132] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:34.455176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da156957-c25f-4817-ae7a-5dfcbda061cc service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:34.465714 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da156957-c25f-4817-ae7a-5dfcbda061cc service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:34.471220 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e8bdd-893d-4385-916b-7b245152f6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:34.471885 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e8bdd-893d-4385-916b-7b245152f6ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:34.472173 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e8bdd-893d-4385-916b-7b245152f6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:34.472454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e8bdd-893d-4385-916b-7b245152f6ad admin admin] PATH_INFO: `/v3/projects/2ebcb4f35aa1451f8bff6f6fdfe4cf57/users/57b31e8f336c43229b39ad7e1db5b5f2/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:34.489258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e8bdd-893d-4385-916b-7b245152f6ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ebcb4f35aa1451f8bff6f6fdfe4cf57, user_id=57b31e8f336c43229b39ad7e1db5b5f2, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:34.492959 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e8bdd-893d-4385-916b-7b245152f6ad admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:34.495680 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221005b-d47a-4de2-acb9-11130d1e6a71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:34.497175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221005b-d47a-4de2-acb9-11130d1e6a71 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:34.507098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1091/2133] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:34.507877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221005b-d47a-4de2-acb9-11130d1e6a71 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:34.520184 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221005b-d47a-4de2-acb9-11130d1e6a71 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:34.525888 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44191256-7c25-4d9c-bbd2-8671f3a40e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:34.526497 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44191256-7c25-4d9c-bbd2-8671f3a40e31 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:34.526808 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44191256-7c25-4d9c-bbd2-8671f3a40e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:34.527038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44191256-7c25-4d9c-bbd2-8671f3a40e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:34.527701 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44191256-7c25-4d9c-bbd2-8671f3a40e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:34.529776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44191256-7c25-4d9c-bbd2-8671f3a40e31 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:34.566983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1043/2134] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:34 2022] PUT /identity/v3/projects/2ebcb4f35aa1451f8bff6f6fdfe4cf57/users/57b31e8f336c43229b39ad7e1db5b5f2/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:34.577332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6f805-805d-46cb-987f-bbd6726738e2 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:34.577614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6f805-805d-46cb-987f-bbd6726738e2 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:34.577887 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6f805-805d-46cb-987f-bbd6726738e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:34.606826 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b1a6f805-805d-46cb-987f-bbd6726738e2 None None] MFA Rules not processed for user `57b31e8f336c43229b39ad7e1db5b5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:34.608047 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b1a6f805-805d-46cb-987f-bbd6726738e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:34.671234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1044/2135] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:34.675650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6f805-805d-46cb-987f-bbd6726738e2 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:34.685421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1092/2136] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:34 2022] POST /identity/v3/projects => generated 374 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:34.690588 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44191256-7c25-4d9c-bbd2-8671f3a40e31 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:34.737536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6f805-805d-46cb-987f-bbd6726738e2 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:34.753766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44191256-7c25-4d9c-bbd2-8671f3a40e31 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:34.758551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafee18-1b9c-4ef5-b4b8-1ea768039f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:34.759169 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafee18-1b9c-4ef5-b4b8-1ea768039f8d admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:34.759449 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafee18-1b9c-4ef5-b4b8-1ea768039f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:34.759723 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafee18-1b9c-4ef5-b4b8-1ea768039f8d admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:34.760377 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafee18-1b9c-4ef5-b4b8-1ea768039f8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:34.762395 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafee18-1b9c-4ef5-b4b8-1ea768039f8d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:34.794131 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f16d43-e1bd-4cd0-8e10-efc1f4959565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:34.794755 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f16d43-e1bd-4cd0-8e10-efc1f4959565 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:34.795041 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f16d43-e1bd-4cd0-8e10-efc1f4959565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:34.795321 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f16d43-e1bd-4cd0-8e10-efc1f4959565 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:34.796064 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f16d43-e1bd-4cd0-8e10-efc1f4959565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:34.798022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f16d43-e1bd-4cd0-8e10-efc1f4959565 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:34.829833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1093/2137] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:34 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:34.832970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafee18-1b9c-4ef5-b4b8-1ea768039f8d admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:34.882632 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:34.884109 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafee18-1b9c-4ef5-b4b8-1ea768039f8d admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:34.887774 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b50465-ec86-4dfb-aace-b14f2cedd949 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:34.890142 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b50465-ec86-4dfb-aace-b14f2cedd949 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:34.890142 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b50465-ec86-4dfb-aace-b14f2cedd949 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:34.890142 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b50465-ec86-4dfb-aace-b14f2cedd949 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:34.921230 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1045/2138] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:34 2022] POST /identity/v3/projects => generated 386 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:24:34.922389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f16d43-e1bd-4cd0-8e10-efc1f4959565 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:34.957122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b50465-ec86-4dfb-aace-b14f2cedd949 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:34.959276 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b50465-ec86-4dfb-aace-b14f2cedd949 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:34.969341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1094/2139] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:34.970737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b50465-ec86-4dfb-aace-b14f2cedd949 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:34.980102 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b50465-ec86-4dfb-aace-b14f2cedd949 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:35.001017 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f16d43-e1bd-4cd0-8e10-efc1f4959565 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:35.006758 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7f619-0777-48d0-aa7c-7b5d81ee9967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:35.007387 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7f619-0777-48d0-aa7c-7b5d81ee9967 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:35.007665 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7f619-0777-48d0-aa7c-7b5d81ee9967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:35.007982 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7f619-0777-48d0-aa7c-7b5d81ee9967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:35.008626 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7f619-0777-48d0-aa7c-7b5d81ee9967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:35.010272 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7f619-0777-48d0-aa7c-7b5d81ee9967 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:35.020478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1046/2140] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:34 2022] GET /identity/v3/roles => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:35.024952 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7f619-0777-48d0-aa7c-7b5d81ee9967 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:35.039802 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7f619-0777-48d0-aa7c-7b5d81ee9967 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:35.041267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00202c5f-e2a3-42b6-ac7b-9afe78c13792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:35.041976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00202c5f-e2a3-42b6-ac7b-9afe78c13792 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:35.042324 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00202c5f-e2a3-42b6-ac7b-9afe78c13792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:35.042606 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00202c5f-e2a3-42b6-ac7b-9afe78c13792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:35.043592 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00202c5f-e2a3-42b6-ac7b-9afe78c13792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:35.045212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14049498-807e-4520-bb05-a6bba3e4bd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:35.045337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00202c5f-e2a3-42b6-ac7b-9afe78c13792 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:35.045773 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14049498-807e-4520-bb05-a6bba3e4bd43 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:35.046054 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14049498-807e-4520-bb05-a6bba3e4bd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:35.046335 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14049498-807e-4520-bb05-a6bba3e4bd43 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:35.047175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14049498-807e-4520-bb05-a6bba3e4bd43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:35.049145 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14049498-807e-4520-bb05-a6bba3e4bd43 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:35.056390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1047/2141] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:35 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:24:35.061012 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00202c5f-e2a3-42b6-ac7b-9afe78c13792 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:35.071954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00202c5f-e2a3-42b6-ac7b-9afe78c13792 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:35.076716 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43c2f1-584a-4d53-bfdf-ced549789253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:35.077390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43c2f1-584a-4d53-bfdf-ced549789253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:35.077673 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43c2f1-584a-4d53-bfdf-ced549789253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:35.077974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43c2f1-584a-4d53-bfdf-ced549789253 admin admin] PATH_INFO: `/v3/projects/3b9d338044bc4fa4a603685ea9423828/users/0ab7a9d2b4f44d4e91a3c198f945f980/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:35.097230 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43c2f1-584a-4d53-bfdf-ced549789253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9d338044bc4fa4a603685ea9423828, user_id=0ab7a9d2b4f44d4e91a3c198f945f980, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:35.097410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43c2f1-584a-4d53-bfdf-ced549789253 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:35.178919 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1048/2142] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:35 2022] PUT /identity/v3/projects/3b9d338044bc4fa4a603685ea9423828/users/0ab7a9d2b4f44d4e91a3c198f945f980/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:35.179019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1095/2143] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:34 2022] POST /identity/v3/users => generated 300 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:35.179293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43c2f1-584a-4d53-bfdf-ced549789253 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:35.180887 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9bdc9-25fe-49f7-9e33-a8e19252444e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:35.181183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9bdc9-25fe-49f7-9e33-a8e19252444e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:35.181462 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9bdc9-25fe-49f7-9e33-a8e19252444e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:35.202161 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-dad9bdc9-25fe-49f7-9e33-a8e19252444e None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:35.204209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dad9bdc9-25fe-49f7-9e33-a8e19252444e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:35.245806 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43c2f1-584a-4d53-bfdf-ced549789253 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:35.250618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16629b5b-0234-42d9-a902-765485170a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:35.251313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16629b5b-0234-42d9-a902-765485170a1e admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:35.251529 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16629b5b-0234-42d9-a902-765485170a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:35.251806 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16629b5b-0234-42d9-a902-765485170a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:35.252501 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16629b5b-0234-42d9-a902-765485170a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:35.265324 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16629b5b-0234-42d9-a902-765485170a1e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:35.276707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1049/2144] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:35 2022] GET /identity/v3/roles => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:24:35.282447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1096/2145] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:35.282726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16629b5b-0234-42d9-a902-765485170a1e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:35.289967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9bdc9-25fe-49f7-9e33-a8e19252444e None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:35.293886 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dad9bdc9-25fe-49f7-9e33-a8e19252444e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:35.303475 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16629b5b-0234-42d9-a902-765485170a1e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:35.309513 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a760c6a-de1b-47e5-add5-c8842ff49a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:35.311067 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a760c6a-de1b-47e5-add5-c8842ff49a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:35.311343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a760c6a-de1b-47e5-add5-c8842ff49a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:35.311669 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a760c6a-de1b-47e5-add5-c8842ff49a7d admin admin] PATH_INFO: `/v3/projects/40e1aec02c164aaaad4a00e6a86e28d9/users/38a3a0de60054cd1ba833592a987b035/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:35.330531 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a760c6a-de1b-47e5-add5-c8842ff49a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=40e1aec02c164aaaad4a00e6a86e28d9, user_id=38a3a0de60054cd1ba833592a987b035, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:35.333796 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a760c6a-de1b-47e5-add5-c8842ff49a7d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:35.355783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9bdc9-25fe-49f7-9e33-a8e19252444e None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:35.358625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:35.361177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36b8d2-4681-4848-b6ec-24949256c86c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:35.361842 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36b8d2-4681-4848-b6ec-24949256c86c service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:35.362072 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36b8d2-4681-4848-b6ec-24949256c86c service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:35.362343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36b8d2-4681-4848-b6ec-24949256c86c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:35.372209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36b8d2-4681-4848-b6ec-24949256c86c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:35.373661 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36b8d2-4681-4848-b6ec-24949256c86c service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:35.386918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1097/2146] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:24:35.437159 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1050/2147] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:35 2022] PUT /identity/v3/projects/40e1aec02c164aaaad4a00e6a86e28d9/users/38a3a0de60054cd1ba833592a987b035/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:35.441001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36b8d2-4681-4848-b6ec-24949256c86c service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:35.460275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36b8d2-4681-4848-b6ec-24949256c86c service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:35.528650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ee37c-f600-40c9-a818-a5d8da676353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:35.529739 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ee37c-f600-40c9-a818-a5d8da676353 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:35.530271 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ee37c-f600-40c9-a818-a5d8da676353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:35.530442 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ee37c-f600-40c9-a818-a5d8da676353 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:35.531650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ee37c-f600-40c9-a818-a5d8da676353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:35.533213 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ee37c-f600-40c9-a818-a5d8da676353 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:35.551233 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1098/2148] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:35 2022] GET /identity/v3/roles => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:35.556725 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a760c6a-de1b-47e5-add5-c8842ff49a7d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:35.577602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a760c6a-de1b-47e5-add5-c8842ff49a7d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:35.582901 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767c8ca-c3ed-48be-9ee7-db3e95002fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:35.586983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767c8ca-c3ed-48be-9ee7-db3e95002fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:35.586983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767c8ca-c3ed-48be-9ee7-db3e95002fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:35.586983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767c8ca-c3ed-48be-9ee7-db3e95002fbb admin admin] PATH_INFO: `/v3/projects/40e1aec02c164aaaad4a00e6a86e28d9/users/38a3a0de60054cd1ba833592a987b035/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:35.586983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767c8ca-c3ed-48be-9ee7-db3e95002fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=40e1aec02c164aaaad4a00e6a86e28d9, user_id=38a3a0de60054cd1ba833592a987b035, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:35.592171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767c8ca-c3ed-48be-9ee7-db3e95002fbb admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:35.599875 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1051/2149] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:35 2022] PUT /identity/v3/projects/40e1aec02c164aaaad4a00e6a86e28d9/users/38a3a0de60054cd1ba833592a987b035/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:35.611197 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33b49f-bfa0-4cf9-8412-f4b18d7f2ff8 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:35.611597 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33b49f-bfa0-4cf9-8412-f4b18d7f2ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:35.611944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33b49f-bfa0-4cf9-8412-f4b18d7f2ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:35.640573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-ad33b49f-bfa0-4cf9-8412-f4b18d7f2ff8 None None] MFA Rules not processed for user `38a3a0de60054cd1ba833592a987b035`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:35.644420 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ad33b49f-bfa0-4cf9-8412-f4b18d7f2ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:35.716607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1099/2150] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:35.730022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767c8ca-c3ed-48be-9ee7-db3e95002fbb admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:35.790357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767c8ca-c3ed-48be-9ee7-db3e95002fbb admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:35.794350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd68acc-7abd-4191-a455-80ba831d98ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:35.794965 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd68acc-7abd-4191-a455-80ba831d98ed service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:35.795249 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd68acc-7abd-4191-a455-80ba831d98ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:35.795527 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd68acc-7abd-4191-a455-80ba831d98ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:35.809713 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd68acc-7abd-4191-a455-80ba831d98ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:35.809713 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd68acc-7abd-4191-a455-80ba831d98ed service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:35.816526 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1052/2151] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:24:35.846127 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33b49f-bfa0-4cf9-8412-f4b18d7f2ff8 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:35.917250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33b49f-bfa0-4cf9-8412-f4b18d7f2ff8 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:35.922217 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32acd5-b313-4096-997c-cf51842f6e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:35.922918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32acd5-b313-4096-997c-cf51842f6e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:35.924467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32acd5-b313-4096-997c-cf51842f6e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:35.924467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32acd5-b313-4096-997c-cf51842f6e3d admin admin] PATH_INFO: `/v3/users/57b31e8f336c43229b39ad7e1db5b5f2` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:35.924752 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32acd5-b313-4096-997c-cf51842f6e3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b31e8f336c43229b39ad7e1db5b5f2)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:35.926603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32acd5-b313-4096-997c-cf51842f6e3d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:36.121114 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd68acc-7abd-4191-a455-80ba831d98ed service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:36.131600 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd68acc-7abd-4191-a455-80ba831d98ed service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:36.136220 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df8eb9-4e25-4b0e-ab05-81dfca962f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:36.136894 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df8eb9-4e25-4b0e-ab05-81dfca962f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:36.137189 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df8eb9-4e25-4b0e-ab05-81dfca962f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:36.137485 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df8eb9-4e25-4b0e-ab05-81dfca962f5a admin admin] PATH_INFO: `/v3/users/60cebc0a7340415f9b676bf2063fedef` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:36.138671 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df8eb9-4e25-4b0e-ab05-81dfca962f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=60cebc0a7340415f9b676bf2063fedef)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:36.140601 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df8eb9-4e25-4b0e-ab05-81dfca962f5a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:36.189056 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-da32acd5-b313-4096-997c-cf51842f6e3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b31e8f336c43229b39ad7e1db5b5f2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:36.189814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-da32acd5-b313-4096-997c-cf51842f6e3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b31e8f336c43229b39ad7e1db5b5f2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:36.295748 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-da32acd5-b313-4096-997c-cf51842f6e3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b31e8f336c43229b39ad7e1db5b5f2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:36.309049 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-da32acd5-b313-4096-997c-cf51842f6e3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b31e8f336c43229b39ad7e1db5b5f2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:36.309807 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-da32acd5-b313-4096-997c-cf51842f6e3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b31e8f336c43229b39ad7e1db5b5f2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:36.323085 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1100/2152] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:35 2022] DELETE /identity/v3/users/57b31e8f336c43229b39ad7e1db5b5f2 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:36.327670 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c970c9a-12a1-43ab-bf0e-13b5a9da4a19 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:36.328401 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c970c9a-12a1-43ab-bf0e-13b5a9da4a19 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:36.328401 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c970c9a-12a1-43ab-bf0e-13b5a9da4a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:36.348121 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-4c970c9a-12a1-43ab-bf0e-13b5a9da4a19 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:36.349504 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4c970c9a-12a1-43ab-bf0e-13b5a9da4a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:36.373696 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-89df8eb9-4e25-4b0e-ab05-81dfca962f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60cebc0a7340415f9b676bf2063fedef'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:36.374738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-89df8eb9-4e25-4b0e-ab05-81dfca962f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60cebc0a7340415f9b676bf2063fedef'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:36.389610 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-89df8eb9-4e25-4b0e-ab05-81dfca962f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60cebc0a7340415f9b676bf2063fedef'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:36.398262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-89df8eb9-4e25-4b0e-ab05-81dfca962f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60cebc0a7340415f9b676bf2063fedef'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:36.430319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1101/2153] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:36.439797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c970c9a-12a1-43ab-bf0e-13b5a9da4a19 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:36.441169 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4c970c9a-12a1-43ab-bf0e-13b5a9da4a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:36.477691 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-89df8eb9-4e25-4b0e-ab05-81dfca962f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60cebc0a7340415f9b676bf2063fedef'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:36.479421 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:36.485905 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1053/2154] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:36 2022] DELETE /identity/v3/users/60cebc0a7340415f9b676bf2063fedef => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:36.490923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9222be8-5d80-46ff-a7c8-62998e469dbf None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:36.491220 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9222be8-5d80-46ff-a7c8-62998e469dbf None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:36.491501 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9222be8-5d80-46ff-a7c8-62998e469dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:36.500207 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c970c9a-12a1-43ab-bf0e-13b5a9da4a19 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:36.510106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b9222be8-5d80-46ff-a7c8-62998e469dbf None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:36.511313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b9222be8-5d80-46ff-a7c8-62998e469dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:36.548231 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e33a9-225b-41d5-b9f1-74be82a49ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:36.548829 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e33a9-225b-41d5-b9f1-74be82a49ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:36.549112 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e33a9-225b-41d5-b9f1-74be82a49ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:36.549384 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e33a9-225b-41d5-b9f1-74be82a49ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:36.551289 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-de2e33a9-225b-41d5-b9f1-74be82a49ae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:36.573561 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1054/2155] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:36.585962 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9222be8-5d80-46ff-a7c8-62998e469dbf None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:36.587745 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b9222be8-5d80-46ff-a7c8-62998e469dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:36.600703 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9222be8-5d80-46ff-a7c8-62998e469dbf None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:36.604469 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf5c34-c9ba-48ba-9acc-8a1cd5c895a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:36.605127 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf5c34-c9ba-48ba-9acc-8a1cd5c895a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:36.606275 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf5c34-c9ba-48ba-9acc-8a1cd5c895a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:36.606275 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf5c34-c9ba-48ba-9acc-8a1cd5c895a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:36.616227 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf5c34-c9ba-48ba-9acc-8a1cd5c895a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:36.617692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf5c34-c9ba-48ba-9acc-8a1cd5c895a7 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:36.628176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1055/2156] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:36.631820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e33a9-225b-41d5-b9f1-74be82a49ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:36.632614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e33a9-225b-41d5-b9f1-74be82a49ae0 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:36.643261 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1102/2157] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:24:36.845335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36a30b-8235-4168-842e-171b2c7f9777 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:36.845819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36a30b-8235-4168-842e-171b2c7f9777 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:36.846000 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36a30b-8235-4168-842e-171b2c7f9777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:36.897665 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8d36a30b-8235-4168-842e-171b2c7f9777 None None] MFA Rules not processed for user `0ab7a9d2b4f44d4e91a3c198f945f980`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:36.898910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8d36a30b-8235-4168-842e-171b2c7f9777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:37.041578 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1056/2158] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:37.055140 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e33a9-225b-41d5-b9f1-74be82a49ae0 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:37.056562 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-de2e33a9-225b-41d5-b9f1-74be82a49ae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:37.145603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e33a9-225b-41d5-b9f1-74be82a49ae0 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:37.149165 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43d0a0-43fd-4c22-aee1-94aad4f70d51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:37.149786 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43d0a0-43fd-4c22-aee1-94aad4f70d51 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:37.150066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43d0a0-43fd-4c22-aee1-94aad4f70d51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:37.150403 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43d0a0-43fd-4c22-aee1-94aad4f70d51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:37.163998 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43d0a0-43fd-4c22-aee1-94aad4f70d51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:37.163998 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43d0a0-43fd-4c22-aee1-94aad4f70d51 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:37.173499 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1103/2159] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:37.245393 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36a30b-8235-4168-842e-171b2c7f9777 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:37.246841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8d36a30b-8235-4168-842e-171b2c7f9777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:37.261601 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36a30b-8235-4168-842e-171b2c7f9777 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:37.275421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43d0a0-43fd-4c22-aee1-94aad4f70d51 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:37.277416 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a49fea-b390-4965-8c75-09d3bfba829b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:37.278104 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a49fea-b390-4965-8c75-09d3bfba829b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:37.278383 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a49fea-b390-4965-8c75-09d3bfba829b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:37.278659 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a49fea-b390-4965-8c75-09d3bfba829b admin admin] PATH_INFO: `/v3/projects/7e4c18c6f2774e7890f89156ac3a899d` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:37.279525 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5e43d0a0-43fd-4c22-aee1-94aad4f70d51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:37.283702 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a49fea-b390-4965-8c75-09d3bfba829b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e4c18c6f2774e7890f89156ac3a899d)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:37.290056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a49fea-b390-4965-8c75-09d3bfba829b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:37.301547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43d0a0-43fd-4c22-aee1-94aad4f70d51 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:37.308934 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b278bc0-eecc-45c5-8ff4-d5414b897bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:37.309628 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b278bc0-eecc-45c5-8ff4-d5414b897bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:37.309980 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b278bc0-eecc-45c5-8ff4-d5414b897bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:37.310592 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b278bc0-eecc-45c5-8ff4-d5414b897bdf admin admin] PATH_INFO: `/v3/projects/2ebcb4f35aa1451f8bff6f6fdfe4cf57` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:37.311726 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b278bc0-eecc-45c5-8ff4-d5414b897bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ebcb4f35aa1451f8bff6f6fdfe4cf57)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:37.313814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b278bc0-eecc-45c5-8ff4-d5414b897bdf admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:37.410236 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a8a49fea-b390-4965-8c75-09d3bfba829b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e4c18c6f2774e7890f89156ac3a899d', 'request_id': 'req-a8a49fea-b390-4965-8c75-09d3bfba829b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:37.418611 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a8a49fea-b390-4965-8c75-09d3bfba829b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e4c18c6f2774e7890f89156ac3a899d', 'request_id': 'req-a8a49fea-b390-4965-8c75-09d3bfba829b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:37.425854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a8a49fea-b390-4965-8c75-09d3bfba829b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e4c18c6f2774e7890f89156ac3a899d', 'request_id': 'req-a8a49fea-b390-4965-8c75-09d3bfba829b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:37.451139 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5b278bc0-eecc-45c5-8ff4-d5414b897bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ebcb4f35aa1451f8bff6f6fdfe4cf57', 'request_id': 'req-5b278bc0-eecc-45c5-8ff4-d5414b897bdf'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:37.459332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5b278bc0-eecc-45c5-8ff4-d5414b897bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ebcb4f35aa1451f8bff6f6fdfe4cf57', 'request_id': 'req-5b278bc0-eecc-45c5-8ff4-d5414b897bdf'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:37.466053 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5b278bc0-eecc-45c5-8ff4-d5414b897bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ebcb4f35aa1451f8bff6f6fdfe4cf57', 'request_id': 'req-5b278bc0-eecc-45c5-8ff4-d5414b897bdf'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:37.528809 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a8a49fea-b390-4965-8c75-09d3bfba829b admin admin] The token cache is being invalidate because project 7e4c18c6f2774e7890f89156ac3a899d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:37.529148 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a8a49fea-b390-4965-8c75-09d3bfba829b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:37.529804 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a8a49fea-b390-4965-8c75-09d3bfba829b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:37.531368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1057/2160] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:37 2022] DELETE /identity/v3/projects/7e4c18c6f2774e7890f89156ac3a899d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:37.535168 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a49fea-b390-4965-8c75-09d3bfba829b admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:37.537088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a8a49fea-b390-4965-8c75-09d3bfba829b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:37.602282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a49fea-b390-4965-8c75-09d3bfba829b admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:37.611406 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:37.616293 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5b278bc0-eecc-45c5-8ff4-d5414b897bdf admin admin] The token cache is being invalidate because project 2ebcb4f35aa1451f8bff6f6fdfe4cf57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:37.616612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5b278bc0-eecc-45c5-8ff4-d5414b897bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:37.617279 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5b278bc0-eecc-45c5-8ff4-d5414b897bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:37.618854 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1104/2161] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:37 2022] DELETE /identity/v3/projects/2ebcb4f35aa1451f8bff6f6fdfe4cf57 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:37.623171 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b278bc0-eecc-45c5-8ff4-d5414b897bdf admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:37.624581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5b278bc0-eecc-45c5-8ff4-d5414b897bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:37.658393 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7a471-7d2f-4612-8f87-fd071140f9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:37.659020 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7a471-7d2f-4612-8f87-fd071140f9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:37.659241 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7a471-7d2f-4612-8f87-fd071140f9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:37.659521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7a471-7d2f-4612-8f87-fd071140f9d8 admin admin] PATH_INFO: `/v3/users/977c6fd02bdd407595ffed33e25fadef` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:37.660812 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7a471-7d2f-4612-8f87-fd071140f9d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=977c6fd02bdd407595ffed33e25fadef)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:37.667058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7a471-7d2f-4612-8f87-fd071140f9d8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:37.693448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b278bc0-eecc-45c5-8ff4-d5414b897bdf admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:37.698240 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43450b-7205-4485-96b1-8cdbbbcf0693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:37.698905 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43450b-7205-4485-96b1-8cdbbbcf0693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:37.699216 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43450b-7205-4485-96b1-8cdbbbcf0693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:37.699486 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43450b-7205-4485-96b1-8cdbbbcf0693 admin admin] PATH_INFO: `/v3/users/38a3a0de60054cd1ba833592a987b035` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:37.700688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43450b-7205-4485-96b1-8cdbbbcf0693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a3a0de60054cd1ba833592a987b035)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:37.702651 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43450b-7205-4485-96b1-8cdbbbcf0693 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:37.843285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cbd7a471-7d2f-4612-8f87-fd071140f9d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '977c6fd02bdd407595ffed33e25fadef'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:37.844334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cbd7a471-7d2f-4612-8f87-fd071140f9d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '977c6fd02bdd407595ffed33e25fadef'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:37.861096 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cbd7a471-7d2f-4612-8f87-fd071140f9d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '977c6fd02bdd407595ffed33e25fadef'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:37.868851 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cbd7a471-7d2f-4612-8f87-fd071140f9d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '977c6fd02bdd407595ffed33e25fadef'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:37.890024 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2c43450b-7205-4485-96b1-8cdbbbcf0693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a3a0de60054cd1ba833592a987b035'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:37.890731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2c43450b-7205-4485-96b1-8cdbbbcf0693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a3a0de60054cd1ba833592a987b035'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:37.895722 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:37.946683 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cbd7a471-7d2f-4612-8f87-fd071140f9d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '977c6fd02bdd407595ffed33e25fadef'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:37.954096 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1058/2162] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:37 2022] DELETE /identity/v3/users/977c6fd02bdd407595ffed33e25fadef => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:38.010173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2c43450b-7205-4485-96b1-8cdbbbcf0693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a3a0de60054cd1ba833592a987b035'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:38.033271 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2c43450b-7205-4485-96b1-8cdbbbcf0693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a3a0de60054cd1ba833592a987b035'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:38.033964 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2c43450b-7205-4485-96b1-8cdbbbcf0693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a3a0de60054cd1ba833592a987b035'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:38.048371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1105/2163] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:37 2022] DELETE /identity/v3/users/38a3a0de60054cd1ba833592a987b035 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:38.562592 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7a471-7d2f-4612-8f87-fd071140f9d8 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:38.564148 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-cbd7a471-7d2f-4612-8f87-fd071140f9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:38.586179 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43450b-7205-4485-96b1-8cdbbbcf0693 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:38.588253 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2c43450b-7205-4485-96b1-8cdbbbcf0693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:38.655353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7a471-7d2f-4612-8f87-fd071140f9d8 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:38.673663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43450b-7205-4485-96b1-8cdbbbcf0693 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:38.679412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9712a22-3bdd-428c-93a9-6c5e7cb5c0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:38.680066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9712a22-3bdd-428c-93a9-6c5e7cb5c0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:38.680350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9712a22-3bdd-428c-93a9-6c5e7cb5c0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:38.680628 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9712a22-3bdd-428c-93a9-6c5e7cb5c0f0 admin admin] PATH_INFO: `/v3/projects/40e1aec02c164aaaad4a00e6a86e28d9` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:38.681838 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9712a22-3bdd-428c-93a9-6c5e7cb5c0f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40e1aec02c164aaaad4a00e6a86e28d9)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:38.683783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9712a22-3bdd-428c-93a9-6c5e7cb5c0f0 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:38.716389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d1a6a-31bd-40f6-96b4-4161d7f1f04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:38.717097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d1a6a-31bd-40f6-96b4-4161d7f1f04b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:38.717428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d1a6a-31bd-40f6-96b4-4161d7f1f04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:38.717706 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d1a6a-31bd-40f6-96b4-4161d7f1f04b admin admin] PATH_INFO: `/v3/projects/fb6ac65340844965ba9a5f47ab6553f1` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:38.718936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d1a6a-31bd-40f6-96b4-4161d7f1f04b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb6ac65340844965ba9a5f47ab6553f1)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:38.720932 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d1a6a-31bd-40f6-96b4-4161d7f1f04b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:38.791704 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e9712a22-3bdd-428c-93a9-6c5e7cb5c0f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40e1aec02c164aaaad4a00e6a86e28d9', 'request_id': 'req-e9712a22-3bdd-428c-93a9-6c5e7cb5c0f0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:38.799201 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e9712a22-3bdd-428c-93a9-6c5e7cb5c0f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40e1aec02c164aaaad4a00e6a86e28d9', 'request_id': 'req-e9712a22-3bdd-428c-93a9-6c5e7cb5c0f0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:38.805791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e9712a22-3bdd-428c-93a9-6c5e7cb5c0f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40e1aec02c164aaaad4a00e6a86e28d9', 'request_id': 'req-e9712a22-3bdd-428c-93a9-6c5e7cb5c0f0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:38.807776 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f45d1a6a-31bd-40f6-96b4-4161d7f1f04b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb6ac65340844965ba9a5f47ab6553f1', 'request_id': 'req-f45d1a6a-31bd-40f6-96b4-4161d7f1f04b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:38.814413 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f45d1a6a-31bd-40f6-96b4-4161d7f1f04b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb6ac65340844965ba9a5f47ab6553f1', 'request_id': 'req-f45d1a6a-31bd-40f6-96b4-4161d7f1f04b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:38.820643 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f45d1a6a-31bd-40f6-96b4-4161d7f1f04b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb6ac65340844965ba9a5f47ab6553f1', 'request_id': 'req-f45d1a6a-31bd-40f6-96b4-4161d7f1f04b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:38.888218 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e9712a22-3bdd-428c-93a9-6c5e7cb5c0f0 admin admin] The token cache is being invalidate because project 40e1aec02c164aaaad4a00e6a86e28d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:38.888693 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e9712a22-3bdd-428c-93a9-6c5e7cb5c0f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:38.889763 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e9712a22-3bdd-428c-93a9-6c5e7cb5c0f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:38.892002 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1106/2164] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:38 2022] DELETE /identity/v3/projects/40e1aec02c164aaaad4a00e6a86e28d9 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:38.897619 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d67cd0-1dc9-4f5b-afb5-8f1607c0ae8c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:38.898299 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d67cd0-1dc9-4f5b-afb5-8f1607c0ae8c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:38.898587 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d67cd0-1dc9-4f5b-afb5-8f1607c0ae8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:38.904546 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:38.924813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-57d67cd0-1dc9-4f5b-afb5-8f1607c0ae8c None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:38.925883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-57d67cd0-1dc9-4f5b-afb5-8f1607c0ae8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:38.942332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f45d1a6a-31bd-40f6-96b4-4161d7f1f04b admin admin] The token cache is being invalidate because project fb6ac65340844965ba9a5f47ab6553f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:38.942846 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f45d1a6a-31bd-40f6-96b4-4161d7f1f04b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:38.944582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f45d1a6a-31bd-40f6-96b4-4161d7f1f04b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:38.946922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1059/2165] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:38 2022] DELETE /identity/v3/projects/fb6ac65340844965ba9a5f47ab6553f1 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:38.948246 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31d1a5-a793-4157-bcbd-0f486e81ed66 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:38.948536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31d1a5-a793-4157-bcbd-0f486e81ed66 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:38.948860 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31d1a5-a793-4157-bcbd-0f486e81ed66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:38.968428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-9f31d1a5-a793-4157-bcbd-0f486e81ed66 None None] MFA Rules not processed for user `0ab7a9d2b4f44d4e91a3c198f945f980`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:38.969811 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9f31d1a5-a793-4157-bcbd-0f486e81ed66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:38.993653 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1107/2166] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:39.000027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7dc95-82c4-4662-859d-e6d8f92be9d1 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:39.000027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7dc95-82c4-4662-859d-e6d8f92be9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:39.000027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7dc95-82c4-4662-859d-e6d8f92be9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:39.016023 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-0ea7dc95-82c4-4662-859d-e6d8f92be9d1 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:39.017264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0ea7dc95-82c4-4662-859d-e6d8f92be9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:39.026076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1108/2167] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:39.033215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f7ba7-ec18-43df-ad31-66216fb09de8 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:39.033215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f7ba7-ec18-43df-ad31-66216fb09de8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:39.033215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f7ba7-ec18-43df-ad31-66216fb09de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:39.042196 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1060/2168] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:39.043733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec70d8-321e-487a-b7fc-b1ab59a02762 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:39.044026 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec70d8-321e-487a-b7fc-b1ab59a02762 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:39.044441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec70d8-321e-487a-b7fc-b1ab59a02762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:39.059149 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-b78f7ba7-ec18-43df-ad31-66216fb09de8 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:39.060707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b78f7ba7-ec18-43df-ad31-66216fb09de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:39.069029 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-5eec70d8-321e-487a-b7fc-b1ab59a02762 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:39.069593 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1109/2169] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:39.071025 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5eec70d8-321e-487a-b7fc-b1ab59a02762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:39.073745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f7ba7-ec18-43df-ad31-66216fb09de8 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:39.082365 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1061/2170] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:39.086909 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f7ba7-ec18-43df-ad31-66216fb09de8 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:39.088603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec70d8-321e-487a-b7fc-b1ab59a02762 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:39.091461 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528a2ef-446e-48eb-83f3-1083a684403d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:39.091874 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528a2ef-446e-48eb-83f3-1083a684403d admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:39.092157 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528a2ef-446e-48eb-83f3-1083a684403d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:39.092434 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528a2ef-446e-48eb-83f3-1083a684403d admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:39.093326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528a2ef-446e-48eb-83f3-1083a684403d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:39.093688 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528a2ef-446e-48eb-83f3-1083a684403d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:39.095404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528a2ef-446e-48eb-83f3-1083a684403d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:39.103650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec70d8-321e-487a-b7fc-b1ab59a02762 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:39.111674 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6915ef3-ea13-4712-819c-8035681c8fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:39.112264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6915ef3-ea13-4712-819c-8035681c8fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:39.112632 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6915ef3-ea13-4712-819c-8035681c8fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:39.113036 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6915ef3-ea13-4712-819c-8035681c8fc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:39.113810 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6915ef3-ea13-4712-819c-8035681c8fc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:39.114218 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6915ef3-ea13-4712-819c-8035681c8fc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:39.115830 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1110/2171] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:24:39.116413 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6915ef3-ea13-4712-819c-8035681c8fc8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:39.116693 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528a2ef-446e-48eb-83f3-1083a684403d admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:39.128352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528a2ef-446e-48eb-83f3-1083a684403d admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:39.136039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1062/2172] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:24:39.136951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6915ef3-ea13-4712-819c-8035681c8fc8 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:39.141794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624d4bb-a924-42c3-98a6-6fea9cf9f9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:39.142818 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624d4bb-a924-42c3-98a6-6fea9cf9f9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:39.143252 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624d4bb-a924-42c3-98a6-6fea9cf9f9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:39.143675 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624d4bb-a924-42c3-98a6-6fea9cf9f9f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:39.144596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624d4bb-a924-42c3-98a6-6fea9cf9f9f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:39.147634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624d4bb-a924-42c3-98a6-6fea9cf9f9f1 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:39.150502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6915ef3-ea13-4712-819c-8035681c8fc8 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:39.158396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45a5d2-219e-4f7b-bc44-e6d7abbc7f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:39.160107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45a5d2-219e-4f7b-bc44-e6d7abbc7f90 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:39.160990 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45a5d2-219e-4f7b-bc44-e6d7abbc7f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:39.161281 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45a5d2-219e-4f7b-bc44-e6d7abbc7f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:39.162539 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45a5d2-219e-4f7b-bc44-e6d7abbc7f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:39.164789 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45a5d2-219e-4f7b-bc44-e6d7abbc7f90 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:39.322017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1111/2173] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:39 2022] POST /identity/v3/projects => generated 380 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:39.322108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1063/2174] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:39 2022] POST /identity/v3/projects => generated 382 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:39.323185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624d4bb-a924-42c3-98a6-6fea9cf9f9f1 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:39.324015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45a5d2-219e-4f7b-bc44-e6d7abbc7f90 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:39.396242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45a5d2-219e-4f7b-bc44-e6d7abbc7f90 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:39.401944 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1940f-4e88-42e5-b197-6bb6e446d836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:39.402753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1940f-4e88-42e5-b197-6bb6e446d836 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:39.403041 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1940f-4e88-42e5-b197-6bb6e446d836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:39.403319 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1940f-4e88-42e5-b197-6bb6e446d836 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:39.404021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1940f-4e88-42e5-b197-6bb6e446d836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:39.405998 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1940f-4e88-42e5-b197-6bb6e446d836 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:39.412067 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624d4bb-a924-42c3-98a6-6fea9cf9f9f1 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:39.418976 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1e6ab-03f3-419c-9a7d-8a88a4065aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:39.419667 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1e6ab-03f3-419c-9a7d-8a88a4065aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:39.422991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1e6ab-03f3-419c-9a7d-8a88a4065aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:39.422991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1e6ab-03f3-419c-9a7d-8a88a4065aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:39.422991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1e6ab-03f3-419c-9a7d-8a88a4065aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:39.422991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1e6ab-03f3-419c-9a7d-8a88a4065aa2 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:39.522315 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1064/2175] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:39 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:39.523443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1940f-4e88-42e5-b197-6bb6e446d836 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:39.529792 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1112/2176] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:39 2022] POST /identity/v3/users => generated 291 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:39.532833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1e6ab-03f3-419c-9a7d-8a88a4065aa2 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:39.535971 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1940f-4e88-42e5-b197-6bb6e446d836 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:39.549974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443f18a-e041-46c7-9ffb-d956b57cd46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:39.549974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443f18a-e041-46c7-9ffb-d956b57cd46e admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:39.549974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443f18a-e041-46c7-9ffb-d956b57cd46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:39.549974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443f18a-e041-46c7-9ffb-d956b57cd46e admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:39.550333 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443f18a-e041-46c7-9ffb-d956b57cd46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:39.550333 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443f18a-e041-46c7-9ffb-d956b57cd46e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:39.550494 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1e6ab-03f3-419c-9a7d-8a88a4065aa2 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:39.551863 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d8b01-0696-42bb-bd6e-3268cae0f0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:39.552758 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d8b01-0696-42bb-bd6e-3268cae0f0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:39.553220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d8b01-0696-42bb-bd6e-3268cae0f0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:39.553682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d8b01-0696-42bb-bd6e-3268cae0f0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:39.554624 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d8b01-0696-42bb-bd6e-3268cae0f0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:39.556177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d8b01-0696-42bb-bd6e-3268cae0f0a3 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:39.558058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1065/2177] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:39 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:39.562372 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443f18a-e041-46c7-9ffb-d956b57cd46e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:39.572693 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1113/2178] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:39 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:24:39.574343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d8b01-0696-42bb-bd6e-3268cae0f0a3 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:39.577434 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443f18a-e041-46c7-9ffb-d956b57cd46e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:39.584566 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d0df6-25f3-47b3-a60d-7c4f42dc7512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:39.585285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d0df6-25f3-47b3-a60d-7c4f42dc7512 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:39.585569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d0df6-25f3-47b3-a60d-7c4f42dc7512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:39.585850 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d0df6-25f3-47b3-a60d-7c4f42dc7512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:39.586340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d8b01-0696-42bb-bd6e-3268cae0f0a3 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:39.586778 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d0df6-25f3-47b3-a60d-7c4f42dc7512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:39.588232 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d0df6-25f3-47b3-a60d-7c4f42dc7512 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:39.591265 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c981d1e-5b2f-46df-96ea-95a4086549ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:39.591939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c981d1e-5b2f-46df-96ea-95a4086549ef admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:39.592288 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c981d1e-5b2f-46df-96ea-95a4086549ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:39.592628 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c981d1e-5b2f-46df-96ea-95a4086549ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:39.593453 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c981d1e-5b2f-46df-96ea-95a4086549ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:39.595158 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c981d1e-5b2f-46df-96ea-95a4086549ef admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:39.601269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1066/2179] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:39 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:39.603641 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d0df6-25f3-47b3-a60d-7c4f42dc7512 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:39.609186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1114/2180] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:39 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:39.614017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c981d1e-5b2f-46df-96ea-95a4086549ef admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:39.614342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d0df6-25f3-47b3-a60d-7c4f42dc7512 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:39.619182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a877f13-7335-445d-a2e2-fd0ce6e13763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:39.619842 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a877f13-7335-445d-a2e2-fd0ce6e13763 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:39.620131 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a877f13-7335-445d-a2e2-fd0ce6e13763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:39.620429 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a877f13-7335-445d-a2e2-fd0ce6e13763 admin admin] PATH_INFO: `/v3/projects/a537dd3466c34d258972a089530332c0/users/3f413845bfbd42229f24d48648bf6ee6/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:39.631719 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c981d1e-5b2f-46df-96ea-95a4086549ef admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:39.648022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a877f13-7335-445d-a2e2-fd0ce6e13763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a537dd3466c34d258972a089530332c0, user_id=3f413845bfbd42229f24d48648bf6ee6, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:39.648305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b067c-28cd-49c3-a455-3d72d64fe0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:39.648305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b067c-28cd-49c3-a455-3d72d64fe0cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:39.648305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b067c-28cd-49c3-a455-3d72d64fe0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:39.648305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b067c-28cd-49c3-a455-3d72d64fe0cc admin admin] PATH_INFO: `/v3/projects/ee604811a00143aea836dc70955fd2ff/users/525d04a9e4a94e0a9da15ee721d54812/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:39.648731 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a877f13-7335-445d-a2e2-fd0ce6e13763 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:39.660122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b067c-28cd-49c3-a455-3d72d64fe0cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee604811a00143aea836dc70955fd2ff, user_id=525d04a9e4a94e0a9da15ee721d54812, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:39.663323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b067c-28cd-49c3-a455-3d72d64fe0cc admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:39.861961 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1067/2181] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:39 2022] PUT /identity/v3/projects/a537dd3466c34d258972a089530332c0/users/3f413845bfbd42229f24d48648bf6ee6/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:39.865087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a877f13-7335-445d-a2e2-fd0ce6e13763 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:39.865281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1115/2182] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:39 2022] PUT /identity/v3/projects/ee604811a00143aea836dc70955fd2ff/users/525d04a9e4a94e0a9da15ee721d54812/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:39.865606 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8a877f13-7335-445d-a2e2-fd0ce6e13763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:39.882005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70e9de-8f0d-407a-a95d-a050f330559b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:39.882303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70e9de-8f0d-407a-a95d-a050f330559b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:39.882591 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70e9de-8f0d-407a-a95d-a050f330559b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:39.926597 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-be70e9de-8f0d-407a-a95d-a050f330559b None None] MFA Rules not processed for user `3f413845bfbd42229f24d48648bf6ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:39.928554 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-be70e9de-8f0d-407a-a95d-a050f330559b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:39.976272 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a877f13-7335-445d-a2e2-fd0ce6e13763 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:40.014886 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1116/2183] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:40.016161 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08604ebb-3d27-437c-a7ea-8dc1e7d65c09 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:40.016470 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08604ebb-3d27-437c-a7ea-8dc1e7d65c09 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:40.016802 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08604ebb-3d27-437c-a7ea-8dc1e7d65c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:40.042661 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468b7ba-dedc-4c65-87d8-e51315ff90be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:40.043591 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468b7ba-dedc-4c65-87d8-e51315ff90be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:40.043943 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468b7ba-dedc-4c65-87d8-e51315ff90be admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:40.044287 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468b7ba-dedc-4c65-87d8-e51315ff90be admin admin] PATH_INFO: `/v3/users/5a342556241e4ab69387ac45d1b7a966` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:40.046237 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468b7ba-dedc-4c65-87d8-e51315ff90be admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a342556241e4ab69387ac45d1b7a966)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:40.047483 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-08604ebb-3d27-437c-a7ea-8dc1e7d65c09 None None] MFA Rules not processed for user `525d04a9e4a94e0a9da15ee721d54812`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:40.048797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-08604ebb-3d27-437c-a7ea-8dc1e7d65c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:40.049353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468b7ba-dedc-4c65-87d8-e51315ff90be admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:40.112509 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1117/2184] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:40.113391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08604ebb-3d27-437c-a7ea-8dc1e7d65c09 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:40.124077 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08604ebb-3d27-437c-a7ea-8dc1e7d65c09 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:40.130961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96217f3-0451-4d48-bf05-d280c147b9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:40.132283 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96217f3-0451-4d48-bf05-d280c147b9ff admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:40.132283 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96217f3-0451-4d48-bf05-d280c147b9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:40.132283 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96217f3-0451-4d48-bf05-d280c147b9ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:40.132823 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96217f3-0451-4d48-bf05-d280c147b9ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:40.134719 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96217f3-0451-4d48-bf05-d280c147b9ff admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:40.238109 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:40.245743 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1118/2185] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:40 2022] POST /identity/v3/projects => generated 380 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:40.249520 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96217f3-0451-4d48-bf05-d280c147b9ff admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:40.254437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f468b7ba-dedc-4c65-87d8-e51315ff90be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a342556241e4ab69387ac45d1b7a966'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:40.255676 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f468b7ba-dedc-4c65-87d8-e51315ff90be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a342556241e4ab69387ac45d1b7a966'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:40.270097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f468b7ba-dedc-4c65-87d8-e51315ff90be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a342556241e4ab69387ac45d1b7a966'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:40.281397 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f468b7ba-dedc-4c65-87d8-e51315ff90be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a342556241e4ab69387ac45d1b7a966'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:40.315680 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96217f3-0451-4d48-bf05-d280c147b9ff admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:40.320784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2c946-c997-4255-913c-b4d9ccbc1d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:40.321408 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2c946-c997-4255-913c-b4d9ccbc1d40 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:40.321691 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2c946-c997-4255-913c-b4d9ccbc1d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:40.321970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2c946-c997-4255-913c-b4d9ccbc1d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:40.322671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2c946-c997-4255-913c-b4d9ccbc1d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:40.324598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2c946-c997-4255-913c-b4d9ccbc1d40 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:40.397711 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f468b7ba-dedc-4c65-87d8-e51315ff90be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a342556241e4ab69387ac45d1b7a966'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:40.404435 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1068/2186] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:39 2022] DELETE /identity/v3/users/5a342556241e4ab69387ac45d1b7a966 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:40.405251 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468b7ba-dedc-4c65-87d8-e51315ff90be admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:40.406592 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f468b7ba-dedc-4c65-87d8-e51315ff90be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:40.447999 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1119/2187] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:40 2022] POST /identity/v3/projects => generated 380 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:40.447999 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc90846-2859-48db-9595-9acf02434cea None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:40.447999 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc90846-2859-48db-9595-9acf02434cea None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:40.447999 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc90846-2859-48db-9595-9acf02434cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:40.466243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-edc90846-2859-48db-9595-9acf02434cea None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:40.472754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-edc90846-2859-48db-9595-9acf02434cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:40.474275 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468b7ba-dedc-4c65-87d8-e51315ff90be admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:40.536958 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c52767-452f-4a4c-9230-6456016c6812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:40.537599 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c52767-452f-4a4c-9230-6456016c6812 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:40.537885 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c52767-452f-4a4c-9230-6456016c6812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:40.538160 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c52767-452f-4a4c-9230-6456016c6812 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:40.538853 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c52767-452f-4a4c-9230-6456016c6812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:40.540818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c52767-452f-4a4c-9230-6456016c6812 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:40.546368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1120/2188] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:40.547368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc90846-2859-48db-9595-9acf02434cea None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:40.549143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-edc90846-2859-48db-9595-9acf02434cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:40.561267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc90846-2859-48db-9595-9acf02434cea None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:40.565968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2d0ca-b3f5-4274-993b-4543fa9d6356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:40.566669 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2d0ca-b3f5-4274-993b-4543fa9d6356 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:40.566952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2d0ca-b3f5-4274-993b-4543fa9d6356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:40.567233 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2d0ca-b3f5-4274-993b-4543fa9d6356 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:40.567901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2d0ca-b3f5-4274-993b-4543fa9d6356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:40.569876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2d0ca-b3f5-4274-993b-4543fa9d6356 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:40.612221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1069/2189] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:40 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:40.613256 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c52767-452f-4a4c-9230-6456016c6812 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:40.614944 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-24c52767-452f-4a4c-9230-6456016c6812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:40.671769 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c52767-452f-4a4c-9230-6456016c6812 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:40.675381 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95cd3c-70e8-41cc-a279-804f9ca0bd69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:40.675996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95cd3c-70e8-41cc-a279-804f9ca0bd69 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:40.676307 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95cd3c-70e8-41cc-a279-804f9ca0bd69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:40.676580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95cd3c-70e8-41cc-a279-804f9ca0bd69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:40.684993 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1121/2190] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:40 2022] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:40.696269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2d0ca-b3f5-4274-993b-4543fa9d6356 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:40.696617 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95cd3c-70e8-41cc-a279-804f9ca0bd69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:40.696617 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95cd3c-70e8-41cc-a279-804f9ca0bd69 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:40.698252 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1070/2191] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:40.699120 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95cd3c-70e8-41cc-a279-804f9ca0bd69 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:40.701145 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2d0ca-b3f5-4274-993b-4543fa9d6356 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:40.709536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95cd3c-70e8-41cc-a279-804f9ca0bd69 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:40.718678 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec65eae-9bbb-474b-ab37-025f0c1cf658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:40.719126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aded335-a6ac-4104-b57d-8be681123770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:40.719870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec65eae-9bbb-474b-ab37-025f0c1cf658 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:40.719997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aded335-a6ac-4104-b57d-8be681123770 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:40.720324 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aded335-a6ac-4104-b57d-8be681123770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:40.720685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aded335-a6ac-4104-b57d-8be681123770 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:40.721115 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec65eae-9bbb-474b-ab37-025f0c1cf658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:40.721678 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec65eae-9bbb-474b-ab37-025f0c1cf658 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:40.721949 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aded335-a6ac-4104-b57d-8be681123770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:40.722828 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec65eae-9bbb-474b-ab37-025f0c1cf658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:40.723801 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aded335-a6ac-4104-b57d-8be681123770 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:40.726133 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec65eae-9bbb-474b-ab37-025f0c1cf658 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:40.738356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1071/2192] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:40 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:40.743476 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1122/2193] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:40 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:40.743641 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aded335-a6ac-4104-b57d-8be681123770 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:40.745153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec65eae-9bbb-474b-ab37-025f0c1cf658 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:40.753401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aded335-a6ac-4104-b57d-8be681123770 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:40.755872 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec65eae-9bbb-474b-ab37-025f0c1cf658 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:40.758176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e042a-d0ac-4a3e-b89e-c0406a3e2406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:40.758844 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e042a-d0ac-4a3e-b89e-c0406a3e2406 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:40.759126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e042a-d0ac-4a3e-b89e-c0406a3e2406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:40.759406 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e042a-d0ac-4a3e-b89e-c0406a3e2406 admin admin] PATH_INFO: `/v3/projects/dcd2eb1dc5ff4224bbc94fb940b9dce0/users/a43d90fd7a1f455bb3b4354d456dc9a9/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:40.761293 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973d317-e609-4ffc-bcc9-f1c0659dfe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:40.761954 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973d317-e609-4ffc-bcc9-f1c0659dfe44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:40.762234 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973d317-e609-4ffc-bcc9-f1c0659dfe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:40.762666 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973d317-e609-4ffc-bcc9-f1c0659dfe44 admin admin] PATH_INFO: `/v3/projects/afeb7cf4e359409bb8272134007969c7/users/fac971a55d3d4f0b852d66940241625d/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:40.778087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e042a-d0ac-4a3e-b89e-c0406a3e2406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd2eb1dc5ff4224bbc94fb940b9dce0, user_id=a43d90fd7a1f455bb3b4354d456dc9a9, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:40.781154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e042a-d0ac-4a3e-b89e-c0406a3e2406 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:40.794125 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973d317-e609-4ffc-bcc9-f1c0659dfe44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afeb7cf4e359409bb8272134007969c7, user_id=fac971a55d3d4f0b852d66940241625d, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:40.798966 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973d317-e609-4ffc-bcc9-f1c0659dfe44 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:40.864054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1072/2194] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:40 2022] PUT /identity/v3/projects/dcd2eb1dc5ff4224bbc94fb940b9dce0/users/a43d90fd7a1f455bb3b4354d456dc9a9/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:40.868136 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e042a-d0ac-4a3e-b89e-c0406a3e2406 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:40.887484 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1123/2195] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:40 2022] PUT /identity/v3/projects/afeb7cf4e359409bb8272134007969c7/users/fac971a55d3d4f0b852d66940241625d/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:40.893191 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973d317-e609-4ffc-bcc9-f1c0659dfe44 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:40.979089 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e042a-d0ac-4a3e-b89e-c0406a3e2406 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:41.015054 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973d317-e609-4ffc-bcc9-f1c0659dfe44 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:41.024710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9d006-64a7-4c6d-a65b-6d8e8d704c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:41.026133 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9d006-64a7-4c6d-a65b-6d8e8d704c0c admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:41.026654 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9d006-64a7-4c6d-a65b-6d8e8d704c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:41.026943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9d006-64a7-4c6d-a65b-6d8e8d704c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:41.028192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9d006-64a7-4c6d-a65b-6d8e8d704c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:41.029899 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9d006-64a7-4c6d-a65b-6d8e8d704c0c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:41.043941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1124/2196] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:40 2022] GET /identity/v3/roles => generated 1427 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:41.049692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9d006-64a7-4c6d-a65b-6d8e8d704c0c admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:41.070191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62fa3d-71cc-493b-896c-7fc87797efcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:41.070575 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9d006-64a7-4c6d-a65b-6d8e8d704c0c admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:41.071065 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62fa3d-71cc-493b-896c-7fc87797efcb admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:41.071367 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62fa3d-71cc-493b-896c-7fc87797efcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:41.072499 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62fa3d-71cc-493b-896c-7fc87797efcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:41.073331 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62fa3d-71cc-493b-896c-7fc87797efcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:41.075169 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62fa3d-71cc-493b-896c-7fc87797efcb admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:41.077851 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e030c-1b9b-4a44-9877-0f91a7832030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:41.079072 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e030c-1b9b-4a44-9877-0f91a7832030 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:41.084143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e030c-1b9b-4a44-9877-0f91a7832030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:41.084143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e030c-1b9b-4a44-9877-0f91a7832030 admin admin] PATH_INFO: `/v3/projects/afeb7cf4e359409bb8272134007969c7/users/fac971a55d3d4f0b852d66940241625d/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:41.084143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e030c-1b9b-4a44-9877-0f91a7832030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afeb7cf4e359409bb8272134007969c7, user_id=fac971a55d3d4f0b852d66940241625d, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:41.085699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e030c-1b9b-4a44-9877-0f91a7832030 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:41.088194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1073/2197] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:40 2022] GET /identity/v3/roles => generated 1427 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:24:41.092269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62fa3d-71cc-493b-896c-7fc87797efcb admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:41.105330 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62fa3d-71cc-493b-896c-7fc87797efcb admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:41.112710 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1125/2198] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:41 2022] PUT /identity/v3/projects/afeb7cf4e359409bb8272134007969c7/users/fac971a55d3d4f0b852d66940241625d/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:41.129304 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45f358-c144-46f9-96fd-f055234dc095 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:41.129616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45f358-c144-46f9-96fd-f055234dc095 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:41.130692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45f358-c144-46f9-96fd-f055234dc095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:41.165190 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-8d45f358-c144-46f9-96fd-f055234dc095 None None] MFA Rules not processed for user `fac971a55d3d4f0b852d66940241625d`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:41.168956 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8d45f358-c144-46f9-96fd-f055234dc095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:41.172636 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54eb2d3-9af1-4e54-8b54-ecb0d79094fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:41.173420 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54eb2d3-9af1-4e54-8b54-ecb0d79094fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:41.173778 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54eb2d3-9af1-4e54-8b54-ecb0d79094fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:41.174135 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54eb2d3-9af1-4e54-8b54-ecb0d79094fe admin admin] PATH_INFO: `/v3/projects/dcd2eb1dc5ff4224bbc94fb940b9dce0/users/a43d90fd7a1f455bb3b4354d456dc9a9/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:41.176189 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54eb2d3-9af1-4e54-8b54-ecb0d79094fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd2eb1dc5ff4224bbc94fb940b9dce0, user_id=a43d90fd7a1f455bb3b4354d456dc9a9, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:41.178999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54eb2d3-9af1-4e54-8b54-ecb0d79094fe admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:41.189693 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1074/2199] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:41 2022] PUT /identity/v3/projects/dcd2eb1dc5ff4224bbc94fb940b9dce0/users/a43d90fd7a1f455bb3b4354d456dc9a9/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:41.202292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df77515-0620-4bbc-8b52-32e87bb9a79a None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:41.202582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df77515-0620-4bbc-8b52-32e87bb9a79a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:41.202860 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df77515-0620-4bbc-8b52-32e87bb9a79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:41.232598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-1df77515-0620-4bbc-8b52-32e87bb9a79a None None] MFA Rules not processed for user `a43d90fd7a1f455bb3b4354d456dc9a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:41.234413 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1df77515-0620-4bbc-8b52-32e87bb9a79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:41.243974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1126/2200] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:41.260356 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45f358-c144-46f9-96fd-f055234dc095 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:41.262939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8d45f358-c144-46f9-96fd-f055234dc095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:41.277366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45f358-c144-46f9-96fd-f055234dc095 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:41.286598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:41.316463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1075/2201] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:41.317312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df77515-0620-4bbc-8b52-32e87bb9a79a None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:41.319203 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1df77515-0620-4bbc-8b52-32e87bb9a79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:41.350951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be67aa4-8f8a-4c6d-93e5-47be0da15114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:41.351371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be67aa4-8f8a-4c6d-93e5-47be0da15114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:41.351658 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be67aa4-8f8a-4c6d-93e5-47be0da15114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:41.351931 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be67aa4-8f8a-4c6d-93e5-47be0da15114 admin admin] PATH_INFO: `/v3/projects/db53a5690051406fa2775b602223d92c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:41.353184 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be67aa4-8f8a-4c6d-93e5-47be0da15114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db53a5690051406fa2775b602223d92c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:41.355113 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be67aa4-8f8a-4c6d-93e5-47be0da15114 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:41.378051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df77515-0620-4bbc-8b52-32e87bb9a79a None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:41.382652 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5039641-1012-46e5-992d-8952bf2ab039 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:41.383268 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5039641-1012-46e5-992d-8952bf2ab039 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:41.383549 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5039641-1012-46e5-992d-8952bf2ab039 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:41.383826 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5039641-1012-46e5-992d-8952bf2ab039 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:41.445937 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5039641-1012-46e5-992d-8952bf2ab039 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:41.447383 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5039641-1012-46e5-992d-8952bf2ab039 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:41.458100 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6be67aa4-8f8a-4c6d-93e5-47be0da15114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db53a5690051406fa2775b602223d92c', 'request_id': 'req-6be67aa4-8f8a-4c6d-93e5-47be0da15114'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:41.458816 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1076/2202] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:41 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:41.459933 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5039641-1012-46e5-992d-8952bf2ab039 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:41.461222 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c5039641-1012-46e5-992d-8952bf2ab039 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:41.470138 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6be67aa4-8f8a-4c6d-93e5-47be0da15114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db53a5690051406fa2775b602223d92c', 'request_id': 'req-6be67aa4-8f8a-4c6d-93e5-47be0da15114'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:41.474876 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5039641-1012-46e5-992d-8952bf2ab039 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:41.479527 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6be67aa4-8f8a-4c6d-93e5-47be0da15114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db53a5690051406fa2775b602223d92c', 'request_id': 'req-6be67aa4-8f8a-4c6d-93e5-47be0da15114'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:41.534988 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9422d54-5fd9-4d1b-b160-7a86de59e9d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:41.535720 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9422d54-5fd9-4d1b-b160-7a86de59e9d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:41.536103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9422d54-5fd9-4d1b-b160-7a86de59e9d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:41.536537 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9422d54-5fd9-4d1b-b160-7a86de59e9d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:41.575202 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:41.575869 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6be67aa4-8f8a-4c6d-93e5-47be0da15114 admin admin] The token cache is being invalidate because project db53a5690051406fa2775b602223d92c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:41.576168 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6be67aa4-8f8a-4c6d-93e5-47be0da15114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:41.576933 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6be67aa4-8f8a-4c6d-93e5-47be0da15114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:41.579803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1127/2203] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:41 2022] DELETE /identity/v3/projects/db53a5690051406fa2775b602223d92c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:41.584449 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be67aa4-8f8a-4c6d-93e5-47be0da15114 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:41.586097 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6be67aa4-8f8a-4c6d-93e5-47be0da15114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:41.609676 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9422d54-5fd9-4d1b-b160-7a86de59e9d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:41.611131 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9422d54-5fd9-4d1b-b160-7a86de59e9d4 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:41.622928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1077/2204] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:41 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:41.661873 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be67aa4-8f8a-4c6d-93e5-47be0da15114 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:41.666548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34c149-2210-448c-89f7-28ca2a177321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:41.667190 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34c149-2210-448c-89f7-28ca2a177321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:41.668839 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34c149-2210-448c-89f7-28ca2a177321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:41.668839 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34c149-2210-448c-89f7-28ca2a177321 admin admin] PATH_INFO: `/v3/users/65ed3170ef8f4405b4c7926a803b816b` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:41.669248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34c149-2210-448c-89f7-28ca2a177321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65ed3170ef8f4405b4c7926a803b816b)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:41.671172 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34c149-2210-448c-89f7-28ca2a177321 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:41.888420 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7a34c149-2210-448c-89f7-28ca2a177321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65ed3170ef8f4405b4c7926a803b816b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:41.889300 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7a34c149-2210-448c-89f7-28ca2a177321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65ed3170ef8f4405b4c7926a803b816b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:42.013419 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7a34c149-2210-448c-89f7-28ca2a177321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65ed3170ef8f4405b4c7926a803b816b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:42.031073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7a34c149-2210-448c-89f7-28ca2a177321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65ed3170ef8f4405b4c7926a803b816b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:42.037298 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7a34c149-2210-448c-89f7-28ca2a177321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65ed3170ef8f4405b4c7926a803b816b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:42.040443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9422d54-5fd9-4d1b-b160-7a86de59e9d4 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:42.051157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f9422d54-5fd9-4d1b-b160-7a86de59e9d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:42.051330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1128/2205] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:41 2022] DELETE /identity/v3/users/65ed3170ef8f4405b4c7926a803b816b => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:42.079987 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9422d54-5fd9-4d1b-b160-7a86de59e9d4 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:42.200908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec08b92-e52d-47d0-9d27-bf89a3c21ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:42.201592 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec08b92-e52d-47d0-9d27-bf89a3c21ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:42.201888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec08b92-e52d-47d0-9d27-bf89a3c21ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:42.202258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec08b92-e52d-47d0-9d27-bf89a3c21ca2 admin admin] PATH_INFO: `/v3/users/9188965d42e34881af4d948265e11220` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:42.203477 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec08b92-e52d-47d0-9d27-bf89a3c21ca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9188965d42e34881af4d948265e11220)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:42.205828 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec08b92-e52d-47d0-9d27-bf89a3c21ca2 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:42.243148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34c149-2210-448c-89f7-28ca2a177321 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:42.244751 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7a34c149-2210-448c-89f7-28ca2a177321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:42.259797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34c149-2210-448c-89f7-28ca2a177321 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:42.265116 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8f323-b815-4ebb-aa79-88116e7142fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:42.265757 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8f323-b815-4ebb-aa79-88116e7142fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:42.266038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8f323-b815-4ebb-aa79-88116e7142fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:42.266313 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8f323-b815-4ebb-aa79-88116e7142fe admin admin] PATH_INFO: `/v3/users/525d04a9e4a94e0a9da15ee721d54812` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:42.267677 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8f323-b815-4ebb-aa79-88116e7142fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=525d04a9e4a94e0a9da15ee721d54812)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:42.269641 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8f323-b815-4ebb-aa79-88116e7142fe admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:42.430054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2ec08b92-e52d-47d0-9d27-bf89a3c21ca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9188965d42e34881af4d948265e11220'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:42.430747 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2ec08b92-e52d-47d0-9d27-bf89a3c21ca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9188965d42e34881af4d948265e11220'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:42.444266 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2ec08b92-e52d-47d0-9d27-bf89a3c21ca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9188965d42e34881af4d948265e11220'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:42.451243 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2ec08b92-e52d-47d0-9d27-bf89a3c21ca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9188965d42e34881af4d948265e11220'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:42.552256 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2ec08b92-e52d-47d0-9d27-bf89a3c21ca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9188965d42e34881af4d948265e11220'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:42.560371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1078/2206] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:42 2022] DELETE /identity/v3/users/9188965d42e34881af4d948265e11220 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:42.565246 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57050205-6a7a-4fba-a8b7-e07fdfcd6aa2 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:42.565542 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57050205-6a7a-4fba-a8b7-e07fdfcd6aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:42.565981 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57050205-6a7a-4fba-a8b7-e07fdfcd6aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:42.587229 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-57050205-6a7a-4fba-a8b7-e07fdfcd6aa2 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:42.588623 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-57050205-6a7a-4fba-a8b7-e07fdfcd6aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:42.648893 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1079/2207] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:42.650242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57050205-6a7a-4fba-a8b7-e07fdfcd6aa2 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:42.651407 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-57050205-6a7a-4fba-a8b7-e07fdfcd6aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:42.661784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-32f8f323-b815-4ebb-aa79-88116e7142fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '525d04a9e4a94e0a9da15ee721d54812'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:42.662513 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-32f8f323-b815-4ebb-aa79-88116e7142fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '525d04a9e4a94e0a9da15ee721d54812'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:42.663589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57050205-6a7a-4fba-a8b7-e07fdfcd6aa2 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:42.669842 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa2a13-b189-4fc4-801f-f814891bdb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:42.670487 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa2a13-b189-4fc4-801f-f814891bdb55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:42.670776 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa2a13-b189-4fc4-801f-f814891bdb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:42.671056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa2a13-b189-4fc4-801f-f814891bdb55 admin admin] PATH_INFO: `/v3/projects/743e9047dbd94533b3f8043aa84c3779` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:42.672425 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa2a13-b189-4fc4-801f-f814891bdb55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=743e9047dbd94533b3f8043aa84c3779)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:42.674411 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa2a13-b189-4fc4-801f-f814891bdb55 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:42.727476 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-32f8f323-b815-4ebb-aa79-88116e7142fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '525d04a9e4a94e0a9da15ee721d54812'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:42.746609 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-32f8f323-b815-4ebb-aa79-88116e7142fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '525d04a9e4a94e0a9da15ee721d54812'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:42.747358 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-32f8f323-b815-4ebb-aa79-88116e7142fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '525d04a9e4a94e0a9da15ee721d54812'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:42.760944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1129/2208] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:42 2022] DELETE /identity/v3/users/525d04a9e4a94e0a9da15ee721d54812 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:42.762284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8f323-b815-4ebb-aa79-88116e7142fe admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:42.763613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-32f8f323-b815-4ebb-aa79-88116e7142fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:42.823956 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-13fa2a13-b189-4fc4-801f-f814891bdb55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '743e9047dbd94533b3f8043aa84c3779', 'request_id': 'req-13fa2a13-b189-4fc4-801f-f814891bdb55'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:42.838127 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8f323-b815-4ebb-aa79-88116e7142fe admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:42.844175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-13fa2a13-b189-4fc4-801f-f814891bdb55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '743e9047dbd94533b3f8043aa84c3779', 'request_id': 'req-13fa2a13-b189-4fc4-801f-f814891bdb55'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:42.851238 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-13fa2a13-b189-4fc4-801f-f814891bdb55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '743e9047dbd94533b3f8043aa84c3779', 'request_id': 'req-13fa2a13-b189-4fc4-801f-f814891bdb55'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:42.887441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694f062-6e56-4839-b464-5cf4fffad107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:42.888062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694f062-6e56-4839-b464-5cf4fffad107 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:42.888343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694f062-6e56-4839-b464-5cf4fffad107 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:42.888615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694f062-6e56-4839-b464-5cf4fffad107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:42.890473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1694f062-6e56-4839-b464-5cf4fffad107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:42.928954 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-13fa2a13-b189-4fc4-801f-f814891bdb55 admin admin] The token cache is being invalidate because project 743e9047dbd94533b3f8043aa84c3779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:42.929245 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-13fa2a13-b189-4fc4-801f-f814891bdb55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:42.929912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-13fa2a13-b189-4fc4-801f-f814891bdb55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:42.931464 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1080/2209] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:42 2022] DELETE /identity/v3/projects/743e9047dbd94533b3f8043aa84c3779 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:42.933478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa2a13-b189-4fc4-801f-f814891bdb55 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:42.934779 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-13fa2a13-b189-4fc4-801f-f814891bdb55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:42.954393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694f062-6e56-4839-b464-5cf4fffad107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:42.955852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694f062-6e56-4839-b464-5cf4fffad107 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:42.965676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1130/2210] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:42.966996 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f24ee0-c423-4e0e-9a30-2183b31b5a50 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:42.967637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f24ee0-c423-4e0e-9a30-2183b31b5a50 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:42.972745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f24ee0-c423-4e0e-9a30-2183b31b5a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:42.997905 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c3f24ee0-c423-4e0e-9a30-2183b31b5a50 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:42.999132 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c3f24ee0-c423-4e0e-9a30-2183b31b5a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:43.008506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1131/2211] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:43.009552 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f24ee0-c423-4e0e-9a30-2183b31b5a50 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:43.009686 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa2a13-b189-4fc4-801f-f814891bdb55 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:43.013697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c3f24ee0-c423-4e0e-9a30-2183b31b5a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:43.014509 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11f5c6-5f84-4d03-a9da-23d16bf92840 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac971a55d3d4f0b852d66940241625d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afeb7cf4e359409bb8272134007969c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:43.015161 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11f5c6-5f84-4d03-a9da-23d16bf92840 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:43.015439 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11f5c6-5f84-4d03-a9da-23d16bf92840 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:43.015721 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11f5c6-5f84-4d03-a9da-23d16bf92840 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:43.016434 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11f5c6-5f84-4d03-a9da-23d16bf92840 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:43.016841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11f5c6-5f84-4d03-a9da-23d16bf92840 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:43.018554 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11f5c6-5f84-4d03-a9da-23d16bf92840 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:43.027001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f24ee0-c423-4e0e-9a30-2183b31b5a50 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:43.028896 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:43.032805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af86ca-25ac-4dba-bfe4-b82f5f3661db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:43.033534 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1081/2212] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:24:43.033771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af86ca-25ac-4dba-bfe4-b82f5f3661db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:43.033866 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af86ca-25ac-4dba-bfe4-b82f5f3661db admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:43.034169 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af86ca-25ac-4dba-bfe4-b82f5f3661db admin admin] PATH_INFO: `/v3/users/55487b88cf44425b88e4aa86222a4b19` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:43.035461 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af86ca-25ac-4dba-bfe4-b82f5f3661db admin admin] RBAC: Authorizing `identity:delete_user(user_id=55487b88cf44425b88e4aa86222a4b19)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:43.037623 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af86ca-25ac-4dba-bfe4-b82f5f3661db admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:43.037764 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11f5c6-5f84-4d03-a9da-23d16bf92840 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:43.039421 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4a11f5c6-5f84-4d03-a9da-23d16bf92840 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:43.054930 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11f5c6-5f84-4d03-a9da-23d16bf92840 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:43.060582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd2459-b897-41f5-8b39-e1f9a986b488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:43.061240 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd2459-b897-41f5-8b39-e1f9a986b488 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:43.061527 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd2459-b897-41f5-8b39-e1f9a986b488 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:43.061802 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd2459-b897-41f5-8b39-e1f9a986b488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:43.071968 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd2459-b897-41f5-8b39-e1f9a986b488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:43.073438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd2459-b897-41f5-8b39-e1f9a986b488 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:43.088942 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1082/2213] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:43.089760 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd2459-b897-41f5-8b39-e1f9a986b488 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:43.100685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd2459-b897-41f5-8b39-e1f9a986b488 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:43.105868 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be67ca-aac2-412d-b3ed-6d73b99a6b54 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac971a55d3d4f0b852d66940241625d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afeb7cf4e359409bb8272134007969c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:43.106502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be67ca-aac2-412d-b3ed-6d73b99a6b54 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:43.106793 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be67ca-aac2-412d-b3ed-6d73b99a6b54 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:43.107067 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be67ca-aac2-412d-b3ed-6d73b99a6b54 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:43.107762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be67ca-aac2-412d-b3ed-6d73b99a6b54 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:43.109738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be67ca-aac2-412d-b3ed-6d73b99a6b54 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:43.231493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1083/2214] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:43 2022] POST /identity/v3/projects => generated 355 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:43.236312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be67ca-aac2-412d-b3ed-6d73b99a6b54 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:43.271411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-14af86ca-25ac-4dba-bfe4-b82f5f3661db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55487b88cf44425b88e4aa86222a4b19'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:43.272218 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-14af86ca-25ac-4dba-bfe4-b82f5f3661db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55487b88cf44425b88e4aa86222a4b19'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:43.324532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be67ca-aac2-412d-b3ed-6d73b99a6b54 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:43.331874 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6d4d1-4b4c-44b3-9d8e-5577ec50247d tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac971a55d3d4f0b852d66940241625d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afeb7cf4e359409bb8272134007969c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:43.332509 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6d4d1-4b4c-44b3-9d8e-5577ec50247d tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:43.332967 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6d4d1-4b4c-44b3-9d8e-5577ec50247d tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:43.333273 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6d4d1-4b4c-44b3-9d8e-5577ec50247d tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:43.334298 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6d4d1-4b4c-44b3-9d8e-5577ec50247d tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:43.334669 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6d4d1-4b4c-44b3-9d8e-5577ec50247d tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:43.337368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6d4d1-4b4c-44b3-9d8e-5577ec50247d tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:43.367498 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1084/2215] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:24:43.415585 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-14af86ca-25ac-4dba-bfe4-b82f5f3661db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55487b88cf44425b88e4aa86222a4b19'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:43.415758 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6d4d1-4b4c-44b3-9d8e-5577ec50247d tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:43.416783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-14af86ca-25ac-4dba-bfe4-b82f5f3661db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55487b88cf44425b88e4aa86222a4b19'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:43.417629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-14af86ca-25ac-4dba-bfe4-b82f5f3661db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55487b88cf44425b88e4aa86222a4b19'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:43.417900 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6d4d1-4b4c-44b3-9d8e-5577ec50247d tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:43.424372 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ec493-54f0-4cc2-be5e-aabcc985bc94 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fac971a55d3d4f0b852d66940241625d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afeb7cf4e359409bb8272134007969c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:43.426603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ec493-54f0-4cc2-be5e-aabcc985bc94 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:43.426890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ec493-54f0-4cc2-be5e-aabcc985bc94 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:43.427892 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ec493-54f0-4cc2-be5e-aabcc985bc94 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] PATH_INFO: `/v3/projects/bee185fd34e846718f592a0c989ce050` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:43.429240 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ec493-54f0-4cc2-be5e-aabcc985bc94 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bee185fd34e846718f592a0c989ce050)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:43.433790 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ec493-54f0-4cc2-be5e-aabcc985bc94 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:43.437912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1132/2216] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:43 2022] DELETE /identity/v3/users/55487b88cf44425b88e4aa86222a4b19 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:43.444356 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:43.472335 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af86ca-25ac-4dba-bfe4-b82f5f3661db admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:43.474781 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-14af86ca-25ac-4dba-bfe4-b82f5f3661db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:43.544382 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af86ca-25ac-4dba-bfe4-b82f5f3661db admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:43.556064 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7166b-0373-4ae6-863e-2afcc8dd5cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:43.556064 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7166b-0373-4ae6-863e-2afcc8dd5cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:43.556349 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7166b-0373-4ae6-863e-2afcc8dd5cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:43.556528 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7166b-0373-4ae6-863e-2afcc8dd5cce admin admin] PATH_INFO: `/v3/projects/5fd49c42af6b4df6af97f1d3e161cdc1` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:43.557852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7166b-0373-4ae6-863e-2afcc8dd5cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fd49c42af6b4df6af97f1d3e161cdc1)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:43.559784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7166b-0373-4ae6-863e-2afcc8dd5cce admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:43.596990 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9e6ec493-54f0-4cc2-be5e-aabcc985bc94 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bee185fd34e846718f592a0c989ce050', 'request_id': 'req-9e6ec493-54f0-4cc2-be5e-aabcc985bc94'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:43.604552 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9e6ec493-54f0-4cc2-be5e-aabcc985bc94 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bee185fd34e846718f592a0c989ce050', 'request_id': 'req-9e6ec493-54f0-4cc2-be5e-aabcc985bc94'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:43.610502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9e6ec493-54f0-4cc2-be5e-aabcc985bc94 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bee185fd34e846718f592a0c989ce050', 'request_id': 'req-9e6ec493-54f0-4cc2-be5e-aabcc985bc94'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:43.695949 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9e6ec493-54f0-4cc2-be5e-aabcc985bc94 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] The token cache is being invalidate because project bee185fd34e846718f592a0c989ce050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:43.696472 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9e6ec493-54f0-4cc2-be5e-aabcc985bc94 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:43.697387 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9e6ec493-54f0-4cc2-be5e-aabcc985bc94 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:43.699124 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1085/2217] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:43 2022] DELETE /identity/v3/projects/bee185fd34e846718f592a0c989ce050 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:43.702158 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ec493-54f0-4cc2-be5e-aabcc985bc94 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:43.717971 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9e6ec493-54f0-4cc2-be5e-aabcc985bc94 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:43.739975 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-aec7166b-0373-4ae6-863e-2afcc8dd5cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fd49c42af6b4df6af97f1d3e161cdc1', 'request_id': 'req-aec7166b-0373-4ae6-863e-2afcc8dd5cce'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:43.761193 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-aec7166b-0373-4ae6-863e-2afcc8dd5cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fd49c42af6b4df6af97f1d3e161cdc1', 'request_id': 'req-aec7166b-0373-4ae6-863e-2afcc8dd5cce'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:43.772561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-aec7166b-0373-4ae6-863e-2afcc8dd5cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fd49c42af6b4df6af97f1d3e161cdc1', 'request_id': 'req-aec7166b-0373-4ae6-863e-2afcc8dd5cce'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:43.823383 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ec493-54f0-4cc2-be5e-aabcc985bc94 tempest-VolumeQuotaClassesTest-588734930 tempest-VolumeQuotaClassesTest-588734930-project-admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:43.891312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5edb9-a2e3-4efc-8c9d-54024c8c15f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:43.892420 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5edb9-a2e3-4efc-8c9d-54024c8c15f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:43.892743 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5edb9-a2e3-4efc-8c9d-54024c8c15f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:43.893022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5edb9-a2e3-4efc-8c9d-54024c8c15f2 admin admin] PATH_INFO: `/v3/projects/ee604811a00143aea836dc70955fd2ff` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:43.894830 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5edb9-a2e3-4efc-8c9d-54024c8c15f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee604811a00143aea836dc70955fd2ff)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:43.896894 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5edb9-a2e3-4efc-8c9d-54024c8c15f2 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:43.930958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-aec7166b-0373-4ae6-863e-2afcc8dd5cce admin admin] The token cache is being invalidate because project 5fd49c42af6b4df6af97f1d3e161cdc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:43.933173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-aec7166b-0373-4ae6-863e-2afcc8dd5cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:43.933173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-aec7166b-0373-4ae6-863e-2afcc8dd5cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:43.934724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1133/2218] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:43 2022] DELETE /identity/v3/projects/5fd49c42af6b4df6af97f1d3e161cdc1 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:43.939403 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4a92a-9844-417b-9633-0effdf4d5aa4 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:43.939690 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4a92a-9844-417b-9633-0effdf4d5aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:43.939969 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4a92a-9844-417b-9633-0effdf4d5aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:43.968893 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a9f4a92a-9844-417b-9633-0effdf4d5aa4 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:43.970129 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a9f4a92a-9844-417b-9633-0effdf4d5aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:43.979274 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1134/2219] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:43.988004 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d83e2b-570c-4866-ba73-8b7991d889ea None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:43.988376 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d83e2b-570c-4866-ba73-8b7991d889ea None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:43.990518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d83e2b-570c-4866-ba73-8b7991d889ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:44.009507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c9d83e2b-570c-4866-ba73-8b7991d889ea None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:44.010718 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c9d83e2b-570c-4866-ba73-8b7991d889ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:44.020169 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1135/2220] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:44.024078 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d83e2b-570c-4866-ba73-8b7991d889ea None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:44.037097 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d83e2b-570c-4866-ba73-8b7991d889ea None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:44.046929 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b9e5edb9-a2e3-4efc-8c9d-54024c8c15f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee604811a00143aea836dc70955fd2ff', 'request_id': 'req-b9e5edb9-a2e3-4efc-8c9d-54024c8c15f2'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:44.054653 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b9e5edb9-a2e3-4efc-8c9d-54024c8c15f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee604811a00143aea836dc70955fd2ff', 'request_id': 'req-b9e5edb9-a2e3-4efc-8c9d-54024c8c15f2'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:44.062949 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b9e5edb9-a2e3-4efc-8c9d-54024c8c15f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee604811a00143aea836dc70955fd2ff', 'request_id': 'req-b9e5edb9-a2e3-4efc-8c9d-54024c8c15f2'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:44.099914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09b184-a0a1-47d2-8cfd-dbc6f4d6e43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:44.100459 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09b184-a0a1-47d2-8cfd-dbc6f4d6e43f admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:44.100789 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09b184-a0a1-47d2-8cfd-dbc6f4d6e43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:44.101189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09b184-a0a1-47d2-8cfd-dbc6f4d6e43f admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:44.101886 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09b184-a0a1-47d2-8cfd-dbc6f4d6e43f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:44.102195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09b184-a0a1-47d2-8cfd-dbc6f4d6e43f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:44.103809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09b184-a0a1-47d2-8cfd-dbc6f4d6e43f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:44.117167 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1136/2221] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:24:44.128832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09b184-a0a1-47d2-8cfd-dbc6f4d6e43f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:44.133649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09b184-a0a1-47d2-8cfd-dbc6f4d6e43f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:44.138264 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ab030-4339-4ae5-a53c-c9f01e88e439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:44.139321 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ab030-4339-4ae5-a53c-c9f01e88e439 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:44.139628 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ab030-4339-4ae5-a53c-c9f01e88e439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:44.140867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ab030-4339-4ae5-a53c-c9f01e88e439 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:44.149353 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ab030-4339-4ae5-a53c-c9f01e88e439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:44.149353 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ab030-4339-4ae5-a53c-c9f01e88e439 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:44.149841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b9e5edb9-a2e3-4efc-8c9d-54024c8c15f2 admin admin] The token cache is being invalidate because project ee604811a00143aea836dc70955fd2ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:44.149841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b9e5edb9-a2e3-4efc-8c9d-54024c8c15f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:44.149841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b9e5edb9-a2e3-4efc-8c9d-54024c8c15f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:44.149841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1086/2222] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:43 2022] DELETE /identity/v3/projects/ee604811a00143aea836dc70955fd2ff => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:44.150792 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5edb9-a2e3-4efc-8c9d-54024c8c15f2 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:44.152196 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b9e5edb9-a2e3-4efc-8c9d-54024c8c15f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:44.165926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5edb9-a2e3-4efc-8c9d-54024c8c15f2 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:44.171563 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cc86f-e47c-4452-b1f9-ef9ff67566e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:44.172193 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cc86f-e47c-4452-b1f9-ef9ff67566e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:44.172559 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cc86f-e47c-4452-b1f9-ef9ff67566e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:44.172855 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cc86f-e47c-4452-b1f9-ef9ff67566e2 admin admin] PATH_INFO: `/v3/users/a43d90fd7a1f455bb3b4354d456dc9a9` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:44.174069 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cc86f-e47c-4452-b1f9-ef9ff67566e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43d90fd7a1f455bb3b4354d456dc9a9)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:44.175990 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cc86f-e47c-4452-b1f9-ef9ff67566e2 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:44.260221 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1137/2223] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:44 2022] POST /identity/v3/projects => generated 384 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:24:44.260221 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ab030-4339-4ae5-a53c-c9f01e88e439 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:44.262794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-549ab030-4339-4ae5-a53c-c9f01e88e439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:44.366465 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ab030-4339-4ae5-a53c-c9f01e88e439 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:44.373181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edc853-10d5-4a17-9490-5ff22d665488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:44.373830 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edc853-10d5-4a17-9490-5ff22d665488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:44.374122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edc853-10d5-4a17-9490-5ff22d665488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:44.374692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edc853-10d5-4a17-9490-5ff22d665488 admin admin] PATH_INFO: `/v3/projects/9d4939a0a728424ba1d89f38f3a64698` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:44.376298 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edc853-10d5-4a17-9490-5ff22d665488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d4939a0a728424ba1d89f38f3a64698)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:44.378837 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edc853-10d5-4a17-9490-5ff22d665488 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:44.423497 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ea2cc86f-e47c-4452-b1f9-ef9ff67566e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43d90fd7a1f455bb3b4354d456dc9a9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:44.424205 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ea2cc86f-e47c-4452-b1f9-ef9ff67566e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43d90fd7a1f455bb3b4354d456dc9a9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:44.438707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ea2cc86f-e47c-4452-b1f9-ef9ff67566e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43d90fd7a1f455bb3b4354d456dc9a9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:44.446990 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ea2cc86f-e47c-4452-b1f9-ef9ff67566e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43d90fd7a1f455bb3b4354d456dc9a9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:44.540587 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ea2cc86f-e47c-4452-b1f9-ef9ff67566e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43d90fd7a1f455bb3b4354d456dc9a9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:44.547689 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1087/2224] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:44 2022] DELETE /identity/v3/users/a43d90fd7a1f455bb3b4354d456dc9a9 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:44.548494 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cc86f-e47c-4452-b1f9-ef9ff67566e2 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:44.549910 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ea2cc86f-e47c-4452-b1f9-ef9ff67566e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:44.563760 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-38edc853-10d5-4a17-9490-5ff22d665488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d4939a0a728424ba1d89f38f3a64698', 'request_id': 'req-38edc853-10d5-4a17-9490-5ff22d665488'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:44.572366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-38edc853-10d5-4a17-9490-5ff22d665488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d4939a0a728424ba1d89f38f3a64698', 'request_id': 'req-38edc853-10d5-4a17-9490-5ff22d665488'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:44.579183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-38edc853-10d5-4a17-9490-5ff22d665488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d4939a0a728424ba1d89f38f3a64698', 'request_id': 'req-38edc853-10d5-4a17-9490-5ff22d665488'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:44.626188 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cc86f-e47c-4452-b1f9-ef9ff67566e2 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:44.631752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759d782-3018-4ba0-8afa-53fd276f9b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:44.632458 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759d782-3018-4ba0-8afa-53fd276f9b69 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:44.632885 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759d782-3018-4ba0-8afa-53fd276f9b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:44.633262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759d782-3018-4ba0-8afa-53fd276f9b69 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:44.634032 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759d782-3018-4ba0-8afa-53fd276f9b69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:44.636073 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759d782-3018-4ba0-8afa-53fd276f9b69 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:44.651235 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-38edc853-10d5-4a17-9490-5ff22d665488 admin admin] The token cache is being invalidate because project 9d4939a0a728424ba1d89f38f3a64698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:44.651619 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-38edc853-10d5-4a17-9490-5ff22d665488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:44.652426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-38edc853-10d5-4a17-9490-5ff22d665488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:44.654171 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1138/2225] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:44 2022] DELETE /identity/v3/projects/9d4939a0a728424ba1d89f38f3a64698 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:44.654936 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edc853-10d5-4a17-9490-5ff22d665488 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:44.656222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-38edc853-10d5-4a17-9490-5ff22d665488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:44.724420 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edc853-10d5-4a17-9490-5ff22d665488 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:44.729362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421ff0e-25c7-48b7-a8a4-99749ad4be90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:44.730005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421ff0e-25c7-48b7-a8a4-99749ad4be90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:44.730290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421ff0e-25c7-48b7-a8a4-99749ad4be90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:44.730566 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421ff0e-25c7-48b7-a8a4-99749ad4be90 admin admin] PATH_INFO: `/v3/users/3f413845bfbd42229f24d48648bf6ee6` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:44.731783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421ff0e-25c7-48b7-a8a4-99749ad4be90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f413845bfbd42229f24d48648bf6ee6)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:44.733814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421ff0e-25c7-48b7-a8a4-99749ad4be90 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:44.750663 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1088/2226] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:44 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:44.750663 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f85ae-c7d2-4da3-ab9b-e14e119ae911 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:44.751192 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f85ae-c7d2-4da3-ab9b-e14e119ae911 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:44.751769 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f85ae-c7d2-4da3-ab9b-e14e119ae911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:44.774746 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-fe2f85ae-c7d2-4da3-ab9b-e14e119ae911 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:44.775970 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fe2f85ae-c7d2-4da3-ab9b-e14e119ae911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:44.784289 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1089/2227] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:44.785240 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f85ae-c7d2-4da3-ab9b-e14e119ae911 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:44.786692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fe2f85ae-c7d2-4da3-ab9b-e14e119ae911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:44.799680 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f85ae-c7d2-4da3-ab9b-e14e119ae911 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:44.804646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cde3e-ad4a-4816-99ac-7f25af44d357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:44.805418 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cde3e-ad4a-4816-99ac-7f25af44d357 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:44.805708 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cde3e-ad4a-4816-99ac-7f25af44d357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:44.805987 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cde3e-ad4a-4816-99ac-7f25af44d357 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:44.806699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cde3e-ad4a-4816-99ac-7f25af44d357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:44.808352 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cde3e-ad4a-4816-99ac-7f25af44d357 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:44.819073 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1090/2228] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:44 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:44.821865 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d84abd-0706-4bcf-a395-a1173d3ca776 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:44.821865 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d84abd-0706-4bcf-a395-a1173d3ca776 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:44.821865 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d84abd-0706-4bcf-a395-a1173d3ca776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:44.841565 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-46d84abd-0706-4bcf-a395-a1173d3ca776 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:44.842805 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-46d84abd-0706-4bcf-a395-a1173d3ca776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:44.851377 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1091/2229] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:44.852279 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d84abd-0706-4bcf-a395-a1173d3ca776 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:44.868072 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d84abd-0706-4bcf-a395-a1173d3ca776 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:44.868937 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597b5d2-9060-4499-bc67-ab5b718171fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:44.869771 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597b5d2-9060-4499-bc67-ab5b718171fa admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:44.870060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597b5d2-9060-4499-bc67-ab5b718171fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:44.870336 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597b5d2-9060-4499-bc67-ab5b718171fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:44.871044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597b5d2-9060-4499-bc67-ab5b718171fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:44.872963 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597b5d2-9060-4499-bc67-ab5b718171fa admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:44.887604 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1092/2230] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:44 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:44.887604 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597b5d2-9060-4499-bc67-ab5b718171fa admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:44.899934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597b5d2-9060-4499-bc67-ab5b718171fa admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:44.905719 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f4e49-72dd-4b80-9587-4e2c5dfdd057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:44.906375 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f4e49-72dd-4b80-9587-4e2c5dfdd057 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:44.906895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f4e49-72dd-4b80-9587-4e2c5dfdd057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:44.907178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f4e49-72dd-4b80-9587-4e2c5dfdd057 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:44.907875 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f4e49-72dd-4b80-9587-4e2c5dfdd057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:44.908185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f4e49-72dd-4b80-9587-4e2c5dfdd057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:44.909996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f4e49-72dd-4b80-9587-4e2c5dfdd057 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:44.929978 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1093/2231] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:24:44.929978 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f4e49-72dd-4b80-9587-4e2c5dfdd057 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:44.935231 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2421ff0e-25c7-48b7-a8a4-99749ad4be90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f413845bfbd42229f24d48648bf6ee6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:44.936819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2421ff0e-25c7-48b7-a8a4-99749ad4be90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f413845bfbd42229f24d48648bf6ee6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:44.946678 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:44.948290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f4e49-72dd-4b80-9587-4e2c5dfdd057 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:44.953876 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b19909-5c9e-4b05-b426-cfd0f6d9b3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:44.954558 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b19909-5c9e-4b05-b426-cfd0f6d9b3d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:44.954839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b19909-5c9e-4b05-b426-cfd0f6d9b3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:44.955113 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b19909-5c9e-4b05-b426-cfd0f6d9b3d2 admin admin] PATH_INFO: `/v3/projects/655175878a7f460f8390382b16a23c88/users/a0a9e30da2bd4698abcff2bc5c4aba70/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:44.971641 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b19909-5c9e-4b05-b426-cfd0f6d9b3d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=655175878a7f460f8390382b16a23c88, user_id=a0a9e30da2bd4698abcff2bc5c4aba70, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:44.974531 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b19909-5c9e-4b05-b426-cfd0f6d9b3d2 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:45.021584 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2421ff0e-25c7-48b7-a8a4-99749ad4be90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f413845bfbd42229f24d48648bf6ee6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:45.035012 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2421ff0e-25c7-48b7-a8a4-99749ad4be90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f413845bfbd42229f24d48648bf6ee6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:45.036339 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2421ff0e-25c7-48b7-a8a4-99749ad4be90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f413845bfbd42229f24d48648bf6ee6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:45.049658 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1139/2232] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:44 2022] DELETE /identity/v3/users/3f413845bfbd42229f24d48648bf6ee6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:45.050468 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421ff0e-25c7-48b7-a8a4-99749ad4be90 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:45.054124 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2421ff0e-25c7-48b7-a8a4-99749ad4be90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:45.095772 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:45.102109 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1094/2233] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:44 2022] PUT /identity/v3/projects/655175878a7f460f8390382b16a23c88/users/a0a9e30da2bd4698abcff2bc5c4aba70/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:45.104617 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b468c-2a01-4086-a14b-f11eafc12fcb None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:45.111933 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b468c-2a01-4086-a14b-f11eafc12fcb None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:45.111933 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b468c-2a01-4086-a14b-f11eafc12fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:45.139290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b52b468c-2a01-4086-a14b-f11eafc12fcb None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:45.140618 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b52b468c-2a01-4086-a14b-f11eafc12fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:45.190656 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421ff0e-25c7-48b7-a8a4-99749ad4be90 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:45.217683 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1095/2234] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:45.218893 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b468c-2a01-4086-a14b-f11eafc12fcb None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:45.222039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b52b468c-2a01-4086-a14b-f11eafc12fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:45.234057 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b468c-2a01-4086-a14b-f11eafc12fcb None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:45.238649 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaf7fd-6ca1-4a85-a8eb-e060334c2f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:45.239288 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaf7fd-6ca1-4a85-a8eb-e060334c2f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:45.240089 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaf7fd-6ca1-4a85-a8eb-e060334c2f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:45.240365 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaf7fd-6ca1-4a85-a8eb-e060334c2f17 admin admin] PATH_INFO: `/v3/projects/dcd2eb1dc5ff4224bbc94fb940b9dce0` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:45.241565 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faaf7fd-6ca1-4a85-a8eb-e060334c2f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd2eb1dc5ff4224bbc94fb940b9dce0)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:45.244583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faaf7fd-6ca1-4a85-a8eb-e060334c2f17 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:45.249425 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b50e0d-cf95-4197-bb3f-eee945046bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:45.250052 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b50e0d-cf95-4197-bb3f-eee945046bbe admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:45.250346 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b50e0d-cf95-4197-bb3f-eee945046bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:45.250621 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b50e0d-cf95-4197-bb3f-eee945046bbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:45.251287 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b50e0d-cf95-4197-bb3f-eee945046bbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:45.253220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b50e0d-cf95-4197-bb3f-eee945046bbe admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:45.391978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1140/2235] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:45 2022] POST /identity/v3/projects => generated 370 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:45.391978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818af0a-b01a-4b6d-9eb5-acc5023e2364 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:45.391978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818af0a-b01a-4b6d-9eb5-acc5023e2364 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:45.391978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818af0a-b01a-4b6d-9eb5-acc5023e2364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:45.407970 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9faaf7fd-6ca1-4a85-a8eb-e060334c2f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd2eb1dc5ff4224bbc94fb940b9dce0', 'request_id': 'req-9faaf7fd-6ca1-4a85-a8eb-e060334c2f17'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:45.415620 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f818af0a-b01a-4b6d-9eb5-acc5023e2364 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:45.416180 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9faaf7fd-6ca1-4a85-a8eb-e060334c2f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd2eb1dc5ff4224bbc94fb940b9dce0', 'request_id': 'req-9faaf7fd-6ca1-4a85-a8eb-e060334c2f17'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:45.420477 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f818af0a-b01a-4b6d-9eb5-acc5023e2364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:45.422373 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9faaf7fd-6ca1-4a85-a8eb-e060334c2f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd2eb1dc5ff4224bbc94fb940b9dce0', 'request_id': 'req-9faaf7fd-6ca1-4a85-a8eb-e060334c2f17'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:45.476581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1141/2236] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:45.478934 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818af0a-b01a-4b6d-9eb5-acc5023e2364 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:45.481696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f818af0a-b01a-4b6d-9eb5-acc5023e2364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:45.519828 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9faaf7fd-6ca1-4a85-a8eb-e060334c2f17 admin admin] The token cache is being invalidate because project dcd2eb1dc5ff4224bbc94fb940b9dce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:45.523631 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9faaf7fd-6ca1-4a85-a8eb-e060334c2f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:45.523631 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9faaf7fd-6ca1-4a85-a8eb-e060334c2f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:45.523631 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1096/2237] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:45 2022] DELETE /identity/v3/projects/dcd2eb1dc5ff4224bbc94fb940b9dce0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:45.527289 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaf7fd-6ca1-4a85-a8eb-e060334c2f17 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:45.528708 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9faaf7fd-6ca1-4a85-a8eb-e060334c2f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:45.542892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818af0a-b01a-4b6d-9eb5-acc5023e2364 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:45.545056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaf7fd-6ca1-4a85-a8eb-e060334c2f17 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:45.547089 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1f176-0a85-4bfa-bc06-2965e3e49a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:45.552756 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1f176-0a85-4bfa-bc06-2965e3e49a76 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:45.552756 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1f176-0a85-4bfa-bc06-2965e3e49a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:45.552756 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1f176-0a85-4bfa-bc06-2965e3e49a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:45.553037 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2227f-aa63-4e1b-bffe-d1680a7dc3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:45.553177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6ff1f176-0a85-4bfa-bc06-2965e3e49a76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:45.553274 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2227f-aa63-4e1b-bffe-d1680a7dc3ad admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:45.553274 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2227f-aa63-4e1b-bffe-d1680a7dc3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:45.553274 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2227f-aa63-4e1b-bffe-d1680a7dc3ad admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:45.553274 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2227f-aa63-4e1b-bffe-d1680a7dc3ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:45.554576 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2227f-aa63-4e1b-bffe-d1680a7dc3ad admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:45.564143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1f176-0a85-4bfa-bc06-2965e3e49a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:45.565753 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1f176-0a85-4bfa-bc06-2965e3e49a76 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:45.578824 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1142/2238] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:45.579510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1f176-0a85-4bfa-bc06-2965e3e49a76 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:45.580815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6ff1f176-0a85-4bfa-bc06-2965e3e49a76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:45.593054 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1f176-0a85-4bfa-bc06-2965e3e49a76 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:45.598286 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a35702-27c2-4906-b129-4faa0d1d15ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:45.599450 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a35702-27c2-4906-b129-4faa0d1d15ff service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:45.599738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a35702-27c2-4906-b129-4faa0d1d15ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:45.600636 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a35702-27c2-4906-b129-4faa0d1d15ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:45.602506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d0a35702-27c2-4906-b129-4faa0d1d15ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:45.617022 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a35702-27c2-4906-b129-4faa0d1d15ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:45.618686 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a35702-27c2-4906-b129-4faa0d1d15ff service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:45.632203 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1143/2239] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:45.633242 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce41f7-4545-4ebd-96da-d92a88be7b9b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:45.639784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce41f7-4545-4ebd-96da-d92a88be7b9b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:45.639784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce41f7-4545-4ebd-96da-d92a88be7b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:45.653598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1097/2240] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:45 2022] POST /identity/v3/users => generated 286 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:45.657934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2227f-aa63-4e1b-bffe-d1680a7dc3ad admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:45.660964 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c1ce41f7-4545-4ebd-96da-d92a88be7b9b None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:45.662746 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c1ce41f7-4545-4ebd-96da-d92a88be7b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:45.673222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1144/2241] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:45.681474 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626a909-74ad-4cdf-ba9c-05f6bb105409 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:45.681766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626a909-74ad-4cdf-ba9c-05f6bb105409 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:45.682046 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626a909-74ad-4cdf-ba9c-05f6bb105409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:45.687712 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2227f-aa63-4e1b-bffe-d1680a7dc3ad admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:45.698951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bae453-6a38-4fc3-a4c6-7ea73b47b927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:45.699857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bae453-6a38-4fc3-a4c6-7ea73b47b927 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:45.700286 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bae453-6a38-4fc3-a4c6-7ea73b47b927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:45.700748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bae453-6a38-4fc3-a4c6-7ea73b47b927 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:45.705137 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bae453-6a38-4fc3-a4c6-7ea73b47b927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:45.705137 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bae453-6a38-4fc3-a4c6-7ea73b47b927 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:45.706955 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c626a909-74ad-4cdf-ba9c-05f6bb105409 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:45.709280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c626a909-74ad-4cdf-ba9c-05f6bb105409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:45.718335 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1098/2242] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:45 2022] GET /identity/v3/roles => generated 1427 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:24:45.721763 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1145/2243] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:45.722752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bae453-6a38-4fc3-a4c6-7ea73b47b927 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:45.740080 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626a909-74ad-4cdf-ba9c-05f6bb105409 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:45.750070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bae453-6a38-4fc3-a4c6-7ea73b47b927 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:45.755663 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff874f-a91b-4c92-9bf6-b1df96a98756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:45.756486 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff874f-a91b-4c92-9bf6-b1df96a98756 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:45.756815 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff874f-a91b-4c92-9bf6-b1df96a98756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:45.757096 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff874f-a91b-4c92-9bf6-b1df96a98756 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:45.758017 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff874f-a91b-4c92-9bf6-b1df96a98756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:45.759837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff874f-a91b-4c92-9bf6-b1df96a98756 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:45.764569 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626a909-74ad-4cdf-ba9c-05f6bb105409 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:45.773164 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485e5b0-1a26-4dcf-bdc0-08bc2f336a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:45.773973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485e5b0-1a26-4dcf-bdc0-08bc2f336a22 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:45.774439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485e5b0-1a26-4dcf-bdc0-08bc2f336a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:45.774887 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485e5b0-1a26-4dcf-bdc0-08bc2f336a22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:45.778644 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1099/2244] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:45 2022] GET /identity/v3/roles => generated 1427 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:24:45.779345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485e5b0-1a26-4dcf-bdc0-08bc2f336a22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:45.779864 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485e5b0-1a26-4dcf-bdc0-08bc2f336a22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:45.779991 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff874f-a91b-4c92-9bf6-b1df96a98756 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:45.782403 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485e5b0-1a26-4dcf-bdc0-08bc2f336a22 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:45.792911 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff874f-a91b-4c92-9bf6-b1df96a98756 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:45.796309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1146/2245] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:24:45.800508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485e5b0-1a26-4dcf-bdc0-08bc2f336a22 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:45.801630 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaea60-96dc-4261-82a7-3ee612d4f10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:45.802377 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaea60-96dc-4261-82a7-3ee612d4f10a admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:45.802668 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaea60-96dc-4261-82a7-3ee612d4f10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:45.802951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaea60-96dc-4261-82a7-3ee612d4f10a admin admin] PATH_INFO: `/v3/projects/50e4167880df4de19cc8d4862d43b158/users/67cafe4f77e54be683a56074c5fda71f/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:45.812595 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485e5b0-1a26-4dcf-bdc0-08bc2f336a22 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:45.817713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa0c9e-f590-4eae-8890-816f1242d943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:45.820044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa0c9e-f590-4eae-8890-816f1242d943 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:45.820044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa0c9e-f590-4eae-8890-816f1242d943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:45.820044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa0c9e-f590-4eae-8890-816f1242d943 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:45.820044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa0c9e-f590-4eae-8890-816f1242d943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:45.821302 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaea60-96dc-4261-82a7-3ee612d4f10a admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e4167880df4de19cc8d4862d43b158, user_id=67cafe4f77e54be683a56074c5fda71f, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:45.822527 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa0c9e-f590-4eae-8890-816f1242d943 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:45.824146 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaea60-96dc-4261-82a7-3ee612d4f10a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:45.888317 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1100/2246] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:45 2022] PUT /identity/v3/projects/50e4167880df4de19cc8d4862d43b158/users/67cafe4f77e54be683a56074c5fda71f/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:45.899000 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5bbaa-a4c2-45d1-99c0-5812773819ff None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:45.899296 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5bbaa-a4c2-45d1-99c0-5812773819ff None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:45.899578 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5bbaa-a4c2-45d1-99c0-5812773819ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:45.943332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-bba5bbaa-a4c2-45d1-99c0-5812773819ff None None] MFA Rules not processed for user `67cafe4f77e54be683a56074c5fda71f`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:45.950599 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-bba5bbaa-a4c2-45d1-99c0-5812773819ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:45.950744 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1147/2247] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:45 2022] POST /identity/v3/projects => generated 386 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:45.953395 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa0c9e-f590-4eae-8890-816f1242d943 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:46.035733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1101/2248] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:46.043925 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa0c9e-f590-4eae-8890-816f1242d943 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:46.052038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acb60a-940b-40c3-b9dc-c33569a60092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:46.052038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acb60a-940b-40c3-b9dc-c33569a60092 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:46.052363 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:46.052881 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acb60a-940b-40c3-b9dc-c33569a60092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:46.055066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acb60a-940b-40c3-b9dc-c33569a60092 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:46.055066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acb60a-940b-40c3-b9dc-c33569a60092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:46.056321 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acb60a-940b-40c3-b9dc-c33569a60092 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:46.062999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5bbaa-a4c2-45d1-99c0-5812773819ff None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:46.066372 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-bba5bbaa-a4c2-45d1-99c0-5812773819ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:46.159235 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5bbaa-a4c2-45d1-99c0-5812773819ff None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:46.163235 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133d358-39b9-4204-be0f-2227b5f66794 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d25aebc2bbc47b5adb7200275c98d90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:46.164718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133d358-39b9-4204-be0f-2227b5f66794 service glance] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:46.164718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133d358-39b9-4204-be0f-2227b5f66794 service glance] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:46.164718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133d358-39b9-4204-be0f-2227b5f66794 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:46.176478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133d358-39b9-4204-be0f-2227b5f66794 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:46.178028 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133d358-39b9-4204-be0f-2227b5f66794 service glance] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:46.188630 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1102/2249] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:46.191227 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133d358-39b9-4204-be0f-2227b5f66794 service glance] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:46.193529 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d133d358-39b9-4204-be0f-2227b5f66794 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:46.210827 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1148/2250] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:45 2022] POST /identity/v3/users => generated 294 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:24:46.217511 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acb60a-940b-40c3-b9dc-c33569a60092 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:46.219285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133d358-39b9-4204-be0f-2227b5f66794 service glance] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:46.225575 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0354179-4e7c-4cfc-bb33-7ddffcb1c5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:46.226291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0354179-4e7c-4cfc-bb33-7ddffcb1c5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:46.226863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0354179-4e7c-4cfc-bb33-7ddffcb1c5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:46.226981 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0354179-4e7c-4cfc-bb33-7ddffcb1c5d3 admin admin] PATH_INFO: `/v3/projects/a537dd3466c34d258972a089530332c0` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:46.228229 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0354179-4e7c-4cfc-bb33-7ddffcb1c5d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a537dd3466c34d258972a089530332c0)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:46.230752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0354179-4e7c-4cfc-bb33-7ddffcb1c5d3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:46.248523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acb60a-940b-40c3-b9dc-c33569a60092 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:46.266584 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c58d16-a934-4006-adde-47f575334d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:46.267222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c58d16-a934-4006-adde-47f575334d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:46.267638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c58d16-a934-4006-adde-47f575334d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:46.267918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c58d16-a934-4006-adde-47f575334d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:46.268746 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c58d16-a934-4006-adde-47f575334d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:46.270391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c58d16-a934-4006-adde-47f575334d07 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:46.289143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1149/2251] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:46 2022] GET /identity/v3/roles => generated 1427 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:46.290626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c58d16-a934-4006-adde-47f575334d07 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:46.302184 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c58d16-a934-4006-adde-47f575334d07 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:46.307938 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08682cd8-b6fe-4827-904a-c67ef70975a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:46.308776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08682cd8-b6fe-4827-904a-c67ef70975a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:46.309128 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08682cd8-b6fe-4827-904a-c67ef70975a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:46.309715 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08682cd8-b6fe-4827-904a-c67ef70975a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:46.314121 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08682cd8-b6fe-4827-904a-c67ef70975a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:46.316513 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08682cd8-b6fe-4827-904a-c67ef70975a2 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:46.327037 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1150/2252] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:46 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:46.331173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08682cd8-b6fe-4827-904a-c67ef70975a2 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:46.342847 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08682cd8-b6fe-4827-904a-c67ef70975a2 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:46.347696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea30589-1214-4acf-9745-5f3c0f37deec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:46.348361 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea30589-1214-4acf-9745-5f3c0f37deec admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:46.348641 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea30589-1214-4acf-9745-5f3c0f37deec admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:46.348970 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea30589-1214-4acf-9745-5f3c0f37deec admin admin] PATH_INFO: `/v3/projects/d8dd4454620649c7a6f7fcc4ce07c857/users/64ff32b258004d92a27c19bc25e9079e/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:46.370261 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea30589-1214-4acf-9745-5f3c0f37deec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8dd4454620649c7a6f7fcc4ce07c857, user_id=64ff32b258004d92a27c19bc25e9079e, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:46.374655 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea30589-1214-4acf-9745-5f3c0f37deec admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:46.384679 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c0354179-4e7c-4cfc-bb33-7ddffcb1c5d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a537dd3466c34d258972a089530332c0', 'request_id': 'req-c0354179-4e7c-4cfc-bb33-7ddffcb1c5d3'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:46.394081 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c0354179-4e7c-4cfc-bb33-7ddffcb1c5d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a537dd3466c34d258972a089530332c0', 'request_id': 'req-c0354179-4e7c-4cfc-bb33-7ddffcb1c5d3'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:46.409090 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c0354179-4e7c-4cfc-bb33-7ddffcb1c5d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a537dd3466c34d258972a089530332c0', 'request_id': 'req-c0354179-4e7c-4cfc-bb33-7ddffcb1c5d3'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:46.486986 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1151/2253] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:46 2022] PUT /identity/v3/projects/d8dd4454620649c7a6f7fcc4ce07c857/users/64ff32b258004d92a27c19bc25e9079e/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:46.498249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c501d0-a268-449c-8c3d-c8b0109a5600 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:46.498629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c501d0-a268-449c-8c3d-c8b0109a5600 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:46.498910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c501d0-a268-449c-8c3d-c8b0109a5600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:46.529123 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c0354179-4e7c-4cfc-bb33-7ddffcb1c5d3 admin admin] The token cache is being invalidate because project a537dd3466c34d258972a089530332c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:46.529409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c0354179-4e7c-4cfc-bb33-7ddffcb1c5d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:46.531323 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c0354179-4e7c-4cfc-bb33-7ddffcb1c5d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:46.533395 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1103/2254] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:46 2022] DELETE /identity/v3/projects/a537dd3466c34d258972a089530332c0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:46.537088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0354179-4e7c-4cfc-bb33-7ddffcb1c5d3 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:46.539238 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c0354179-4e7c-4cfc-bb33-7ddffcb1c5d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:46.558338 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c1c501d0-a268-449c-8c3d-c8b0109a5600 None None] MFA Rules not processed for user `64ff32b258004d92a27c19bc25e9079e`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:46.560522 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c1c501d0-a268-449c-8c3d-c8b0109a5600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:46.638175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1152/2255] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:46.642680 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c501d0-a268-449c-8c3d-c8b0109a5600 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:46.644080 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c1c501d0-a268-449c-8c3d-c8b0109a5600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:46.662311 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0354179-4e7c-4cfc-bb33-7ddffcb1c5d3 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:46.749006 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c501d0-a268-449c-8c3d-c8b0109a5600 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:46.763877 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb531eb-849c-4c93-93a2-6b9d0257d121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:46.764062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fbc79-ffec-47ca-a22b-d1a0212c7b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:46.764527 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fbc79-ffec-47ca-a22b-d1a0212c7b13 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:46.764864 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb531eb-849c-4c93-93a2-6b9d0257d121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:46.765244 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb531eb-849c-4c93-93a2-6b9d0257d121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:46.765674 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb531eb-849c-4c93-93a2-6b9d0257d121 admin admin] PATH_INFO: `/v3/users/fac971a55d3d4f0b852d66940241625d` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:46.768048 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fbc79-ffec-47ca-a22b-d1a0212c7b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:46.768048 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fbc79-ffec-47ca-a22b-d1a0212c7b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:46.768285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb531eb-849c-4c93-93a2-6b9d0257d121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fac971a55d3d4f0b852d66940241625d)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:46.770040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb531eb-849c-4c93-93a2-6b9d0257d121 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:46.779193 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:46.779928 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fbc79-ffec-47ca-a22b-d1a0212c7b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:46.785190 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fbc79-ffec-47ca-a22b-d1a0212c7b13 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:46.878745 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1153/2256] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:46 2022] POST /identity/v3/projects => generated 386 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:46.883637 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fbc79-ffec-47ca-a22b-d1a0212c7b13 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:46.952111 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fbc79-ffec-47ca-a22b-d1a0212c7b13 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:46.959026 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75063cb0-1aad-4fcb-9ad3-20ac8724b04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:46.959768 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75063cb0-1aad-4fcb-9ad3-20ac8724b04b admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:46.960153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75063cb0-1aad-4fcb-9ad3-20ac8724b04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:46.960609 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75063cb0-1aad-4fcb-9ad3-20ac8724b04b admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:46.961412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75063cb0-1aad-4fcb-9ad3-20ac8724b04b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:46.963463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75063cb0-1aad-4fcb-9ad3-20ac8724b04b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:46.984593 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-fdb531eb-849c-4c93-93a2-6b9d0257d121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fac971a55d3d4f0b852d66940241625d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:46.985291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-fdb531eb-849c-4c93-93a2-6b9d0257d121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fac971a55d3d4f0b852d66940241625d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:47.005574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-fdb531eb-849c-4c93-93a2-6b9d0257d121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fac971a55d3d4f0b852d66940241625d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:47.012505 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-fdb531eb-849c-4c93-93a2-6b9d0257d121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fac971a55d3d4f0b852d66940241625d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:47.078389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1154/2257] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:46 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:47.082329 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75063cb0-1aad-4fcb-9ad3-20ac8724b04b admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:47.092460 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75063cb0-1aad-4fcb-9ad3-20ac8724b04b admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:47.097125 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fc769-9e81-42e7-b9b0-dc374b1885e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:47.097742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fc769-9e81-42e7-b9b0-dc374b1885e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:47.098025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fc769-9e81-42e7-b9b0-dc374b1885e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:47.098300 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fc769-9e81-42e7-b9b0-dc374b1885e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:47.099499 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fc769-9e81-42e7-b9b0-dc374b1885e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:47.101132 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fc769-9e81-42e7-b9b0-dc374b1885e0 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:47.112416 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-fdb531eb-849c-4c93-93a2-6b9d0257d121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fac971a55d3d4f0b852d66940241625d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:47.112605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1155/2258] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:47 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:24:47.116842 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fc769-9e81-42e7-b9b0-dc374b1885e0 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:47.121116 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-aa6fc769-9e81-42e7-b9b0-dc374b1885e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:47.121360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1104/2259] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:46 2022] DELETE /identity/v3/users/fac971a55d3d4f0b852d66940241625d => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:47.131501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fc769-9e81-42e7-b9b0-dc374b1885e0 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:47.196309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55e181-e66b-4feb-8b94-ffbc87968d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:47.197331 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55e181-e66b-4feb-8b94-ffbc87968d1b admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:47.197703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55e181-e66b-4feb-8b94-ffbc87968d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:47.198209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55e181-e66b-4feb-8b94-ffbc87968d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:47.199036 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55e181-e66b-4feb-8b94-ffbc87968d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:47.200767 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55e181-e66b-4feb-8b94-ffbc87968d1b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:47.214040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1156/2260] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:47 2022] GET /identity/v3/roles => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:47.218453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb531eb-849c-4c93-93a2-6b9d0257d121 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:47.229825 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb531eb-849c-4c93-93a2-6b9d0257d121 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:47.236050 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d32da5-aa55-4b04-85af-808e3420ee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:47.236895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d32da5-aa55-4b04-85af-808e3420ee82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:47.237239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d32da5-aa55-4b04-85af-808e3420ee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:47.237518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d32da5-aa55-4b04-85af-808e3420ee82 admin admin] PATH_INFO: `/v3/projects/bceb7fa7667343feacc6f3f450f7d82e/users/83226c1034264629840e21e4f849c515/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:47.262437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d32da5-aa55-4b04-85af-808e3420ee82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bceb7fa7667343feacc6f3f450f7d82e, user_id=83226c1034264629840e21e4f849c515, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:47.279934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d32da5-aa55-4b04-85af-808e3420ee82 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:47.402619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1105/2261] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:47 2022] PUT /identity/v3/projects/bceb7fa7667343feacc6f3f450f7d82e/users/83226c1034264629840e21e4f849c515/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:47.405099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1b847-328a-40d2-b63b-903e3eeb1ff4 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:47.405391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1b847-328a-40d2-b63b-903e3eeb1ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:47.405675 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1b847-328a-40d2-b63b-903e3eeb1ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:47.439461 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f3c1b847-328a-40d2-b63b-903e3eeb1ff4 None None] MFA Rules not processed for user `83226c1034264629840e21e4f849c515`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:47.440825 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f3c1b847-328a-40d2-b63b-903e3eeb1ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:47.534068 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1157/2262] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:47.536097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d32da5-aa55-4b04-85af-808e3420ee82 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:47.607720 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d32da5-aa55-4b04-85af-808e3420ee82 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:47.612723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12dc96-1f28-4578-adbb-74ef64ac650e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:47.613387 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12dc96-1f28-4578-adbb-74ef64ac650e admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:47.613672 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12dc96-1f28-4578-adbb-74ef64ac650e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:47.614875 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12dc96-1f28-4578-adbb-74ef64ac650e admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:47.615293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12dc96-1f28-4578-adbb-74ef64ac650e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:47.617262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12dc96-1f28-4578-adbb-74ef64ac650e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:47.643566 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:47.707437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1106/2263] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:47 2022] POST /identity/v3/projects => generated 386 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:47.711542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1b847-328a-40d2-b63b-903e3eeb1ff4 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:47.725002 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1b847-328a-40d2-b63b-903e3eeb1ff4 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:47.784082 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa82f2-dbfb-49b9-9937-1cdca1daec15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:47.784793 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa82f2-dbfb-49b9-9937-1cdca1daec15 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:47.785017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa82f2-dbfb-49b9-9937-1cdca1daec15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:47.785294 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa82f2-dbfb-49b9-9937-1cdca1daec15 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:47.785960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa82f2-dbfb-49b9-9937-1cdca1daec15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:47.788395 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa82f2-dbfb-49b9-9937-1cdca1daec15 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:47.822689 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12dc96-1f28-4578-adbb-74ef64ac650e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:47.824499 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-af12dc96-1f28-4578-adbb-74ef64ac650e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:47.838270 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12dc96-1f28-4578-adbb-74ef64ac650e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:47.843788 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3fd53-7dca-4c1e-a437-aae676be2a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:47.844552 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3fd53-7dca-4c1e-a437-aae676be2a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:47.844971 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3fd53-7dca-4c1e-a437-aae676be2a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:47.845375 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3fd53-7dca-4c1e-a437-aae676be2a8b admin admin] PATH_INFO: `/v3/projects/afeb7cf4e359409bb8272134007969c7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:47.846792 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3fd53-7dca-4c1e-a437-aae676be2a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=afeb7cf4e359409bb8272134007969c7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:47.849633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3fd53-7dca-4c1e-a437-aae676be2a8b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:47.906674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1158/2264] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:47 2022] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:47.910541 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa82f2-dbfb-49b9-9937-1cdca1daec15 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:47.923014 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa82f2-dbfb-49b9-9937-1cdca1daec15 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:47.929200 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0814f1-7627-493d-83b1-991ac16bc601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:47.930362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0814f1-7627-493d-83b1-991ac16bc601 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:47.930362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0814f1-7627-493d-83b1-991ac16bc601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:47.930507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0814f1-7627-493d-83b1-991ac16bc601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:47.931888 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0814f1-7627-493d-83b1-991ac16bc601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:47.934104 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0814f1-7627-493d-83b1-991ac16bc601 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:47.947670 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1159/2265] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:47 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:24:47.950550 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0814f1-7627-493d-83b1-991ac16bc601 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:47.960424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0814f1-7627-493d-83b1-991ac16bc601 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:47.965172 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534cc14-6b13-4f16-9c72-cf0af297261d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:47.966980 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534cc14-6b13-4f16-9c72-cf0af297261d admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:47.966980 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534cc14-6b13-4f16-9c72-cf0af297261d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:47.966980 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534cc14-6b13-4f16-9c72-cf0af297261d admin admin] PATH_INFO: `/v3/projects/f7e07086367742c78b6da3138c416fc9/users/e0f2e8b3f1dc48d68acb43d0b4f88446/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:47.982234 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534cc14-6b13-4f16-9c72-cf0af297261d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7e07086367742c78b6da3138c416fc9, user_id=e0f2e8b3f1dc48d68acb43d0b4f88446, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:47.985084 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534cc14-6b13-4f16-9c72-cf0af297261d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:48.109484 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1160/2266] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:47 2022] PUT /identity/v3/projects/f7e07086367742c78b6da3138c416fc9/users/e0f2e8b3f1dc48d68acb43d0b4f88446/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:48.114412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534cc14-6b13-4f16-9c72-cf0af297261d admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:48.123663 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-97d3fd53-7dca-4c1e-a437-aae676be2a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afeb7cf4e359409bb8272134007969c7', 'request_id': 'req-97d3fd53-7dca-4c1e-a437-aae676be2a8b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:48.131112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-97d3fd53-7dca-4c1e-a437-aae676be2a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afeb7cf4e359409bb8272134007969c7', 'request_id': 'req-97d3fd53-7dca-4c1e-a437-aae676be2a8b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:48.147258 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-97d3fd53-7dca-4c1e-a437-aae676be2a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afeb7cf4e359409bb8272134007969c7', 'request_id': 'req-97d3fd53-7dca-4c1e-a437-aae676be2a8b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:48.203296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534cc14-6b13-4f16-9c72-cf0af297261d admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:48.239898 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-97d3fd53-7dca-4c1e-a437-aae676be2a8b admin admin] The token cache is being invalidate because project afeb7cf4e359409bb8272134007969c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:48.240927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-97d3fd53-7dca-4c1e-a437-aae676be2a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:48.242220 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-97d3fd53-7dca-4c1e-a437-aae676be2a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:48.244731 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1107/2267] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:47 2022] DELETE /identity/v3/projects/afeb7cf4e359409bb8272134007969c7 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:24:48.249746 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfafa6-264a-4d15-acef-cc3b1e5d5672 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:48.250040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfafa6-264a-4d15-acef-cc3b1e5d5672 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:48.250324 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfafa6-264a-4d15-acef-cc3b1e5d5672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:48.272859 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492cba9-48eb-46b5-bd84-107612a26522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:48.273783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492cba9-48eb-46b5-bd84-107612a26522 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:48.274071 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492cba9-48eb-46b5-bd84-107612a26522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:48.274343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492cba9-48eb-46b5-bd84-107612a26522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:48.275040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492cba9-48eb-46b5-bd84-107612a26522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:48.276950 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492cba9-48eb-46b5-bd84-107612a26522 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:48.281479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-48dfafa6-264a-4d15-acef-cc3b1e5d5672 None None] MFA Rules not processed for user `a0a9e30da2bd4698abcff2bc5c4aba70`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:48.282710 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-48dfafa6-264a-4d15-acef-cc3b1e5d5672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:48.288694 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1161/2268] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:48 2022] GET /identity/v3/roles => generated 1427 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:24:48.290037 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb87fc-7b3b-4dbe-ac1c-1f6854d209d2 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:48.290329 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb87fc-7b3b-4dbe-ac1c-1f6854d209d2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:48.290606 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb87fc-7b3b-4dbe-ac1c-1f6854d209d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:48.316927 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5dcb87fc-7b3b-4dbe-ac1c-1f6854d209d2 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:48.318188 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5dcb87fc-7b3b-4dbe-ac1c-1f6854d209d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:48.334791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1162/2269] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:48.335805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb87fc-7b3b-4dbe-ac1c-1f6854d209d2 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:48.337333 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5dcb87fc-7b3b-4dbe-ac1c-1f6854d209d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:48.357640 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb87fc-7b3b-4dbe-ac1c-1f6854d209d2 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:48.363037 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145071c-d6ca-4f92-8e90-5df34fb82cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:48.363816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145071c-d6ca-4f92-8e90-5df34fb82cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:48.364223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145071c-d6ca-4f92-8e90-5df34fb82cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:48.365072 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145071c-d6ca-4f92-8e90-5df34fb82cb7 admin admin] PATH_INFO: `/v3/projects/f7e07086367742c78b6da3138c416fc9/users/e0f2e8b3f1dc48d68acb43d0b4f88446/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:48.367658 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145071c-d6ca-4f92-8e90-5df34fb82cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7e07086367742c78b6da3138c416fc9, user_id=e0f2e8b3f1dc48d68acb43d0b4f88446, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:48.388141 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145071c-d6ca-4f92-8e90-5df34fb82cb7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:48.393419 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1108/2270] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:48.394289 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1163/2271] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:48 2022] PUT /identity/v3/projects/f7e07086367742c78b6da3138c416fc9/users/e0f2e8b3f1dc48d68acb43d0b4f88446/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:48.394387 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06edbdd-c899-4c93-8c85-254082a6410f None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:48.394387 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06edbdd-c899-4c93-8c85-254082a6410f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:48.394387 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06edbdd-c899-4c93-8c85-254082a6410f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:48.403538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47325116-9b50-4e35-adc8-d0a84aabdf2c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:48.404322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47325116-9b50-4e35-adc8-d0a84aabdf2c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:48.404322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47325116-9b50-4e35-adc8-d0a84aabdf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:48.430516 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b06edbdd-c899-4c93-8c85-254082a6410f None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:48.431999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b06edbdd-c899-4c93-8c85-254082a6410f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:48.452471 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-47325116-9b50-4e35-adc8-d0a84aabdf2c None None] MFA Rules not processed for user `e0f2e8b3f1dc48d68acb43d0b4f88446`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:48.453828 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-47325116-9b50-4e35-adc8-d0a84aabdf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:48.527530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1109/2272] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:48.528043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06edbdd-c899-4c93-8c85-254082a6410f None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:48.529819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b06edbdd-c899-4c93-8c85-254082a6410f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:48.536959 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1164/2273] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:48.541836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47325116-9b50-4e35-adc8-d0a84aabdf2c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:48.548456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47325116-9b50-4e35-adc8-d0a84aabdf2c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:48.553692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983d51d-df37-4706-a865-8606c16e9065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:48.554306 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983d51d-df37-4706-a865-8606c16e9065 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:48.554592 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983d51d-df37-4706-a865-8606c16e9065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:48.554870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983d51d-df37-4706-a865-8606c16e9065 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:48.555566 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983d51d-df37-4706-a865-8606c16e9065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:48.555876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983d51d-df37-4706-a865-8606c16e9065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:48.557515 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983d51d-df37-4706-a865-8606c16e9065 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:48.562577 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:48.570721 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1165/2274] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:24:48.573433 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983d51d-df37-4706-a865-8606c16e9065 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:48.575676 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7983d51d-df37-4706-a865-8606c16e9065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:48.601164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06edbdd-c899-4c93-8c85-254082a6410f None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:48.605100 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6060370-584d-4a1f-920e-1128b30ee299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:48.605945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6060370-584d-4a1f-920e-1128b30ee299 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:48.606306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6060370-584d-4a1f-920e-1128b30ee299 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:48.606653 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6060370-584d-4a1f-920e-1128b30ee299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:48.648639 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983d51d-df37-4706-a865-8606c16e9065 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:48.653409 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdd8ec-b5c1-4c75-ba2c-c422cfdfd1f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:48.654040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdd8ec-b5c1-4c75-ba2c-c422cfdfd1f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:48.654334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdd8ec-b5c1-4c75-ba2c-c422cfdfd1f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:48.654615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdd8ec-b5c1-4c75-ba2c-c422cfdfd1f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:48.656488 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-18bdd8ec-b5c1-4c75-ba2c-c422cfdfd1f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:48.676999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6060370-584d-4a1f-920e-1128b30ee299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:48.682142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6060370-584d-4a1f-920e-1128b30ee299 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:48.688219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1110/2275] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:48.689049 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6060370-584d-4a1f-920e-1128b30ee299 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:48.700654 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6060370-584d-4a1f-920e-1128b30ee299 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:48.706477 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10aa66-161d-4c1e-8b69-9ad43dd48c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:48.710912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10aa66-161d-4c1e-8b69-9ad43dd48c77 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:48.710912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10aa66-161d-4c1e-8b69-9ad43dd48c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:48.710912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10aa66-161d-4c1e-8b69-9ad43dd48c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:48.710912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10aa66-161d-4c1e-8b69-9ad43dd48c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:48.711410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10aa66-161d-4c1e-8b69-9ad43dd48c77 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:48.726795 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bdd8ec-b5c1-4c75-ba2c-c422cfdfd1f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:48.728740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bdd8ec-b5c1-4c75-ba2c-c422cfdfd1f8 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:48.740287 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1166/2276] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:48.789639 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1111/2277] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:48 2022] POST /identity/v3/projects => generated 382 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:48.790941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdd8ec-b5c1-4c75-ba2c-c422cfdfd1f8 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:48.812095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdd8ec-b5c1-4c75-ba2c-c422cfdfd1f8 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:48.890322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0567396-67d4-46e7-8b89-d33e3f012d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:48.892443 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0567396-67d4-46e7-8b89-d33e3f012d40 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:48.892443 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0567396-67d4-46e7-8b89-d33e3f012d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:48.892443 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0567396-67d4-46e7-8b89-d33e3f012d40 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:48.892443 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0567396-67d4-46e7-8b89-d33e3f012d40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:48.894403 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0567396-67d4-46e7-8b89-d33e3f012d40 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:48.913001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:49.009640 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1167/2278] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:48 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:49.013778 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10aa66-161d-4c1e-8b69-9ad43dd48c77 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:49.025406 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10aa66-161d-4c1e-8b69-9ad43dd48c77 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:49.031292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dda18-5dff-4625-910b-7016b2577760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:49.032080 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dda18-5dff-4625-910b-7016b2577760 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:49.032363 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dda18-5dff-4625-910b-7016b2577760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:49.032643 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dda18-5dff-4625-910b-7016b2577760 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:49.033669 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25dda18-5dff-4625-910b-7016b2577760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:49.035516 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25dda18-5dff-4625-910b-7016b2577760 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:49.048474 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1112/2279] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:49 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:49.053160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0567396-67d4-46e7-8b89-d33e3f012d40 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:49.063381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0567396-67d4-46e7-8b89-d33e3f012d40 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:49.069023 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308c901-f408-4d69-823e-b9b5b5b266f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:49.069742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308c901-f408-4d69-823e-b9b5b5b266f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:49.070032 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308c901-f408-4d69-823e-b9b5b5b266f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:49.070308 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308c901-f408-4d69-823e-b9b5b5b266f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:49.071005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308c901-f408-4d69-823e-b9b5b5b266f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:49.072630 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308c901-f408-4d69-823e-b9b5b5b266f5 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:49.087735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1168/2280] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:49 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:49.088985 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dda18-5dff-4625-910b-7016b2577760 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:49.101456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dda18-5dff-4625-910b-7016b2577760 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:49.108746 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ac3ed-2e18-40ae-8155-bbb9bc7c672d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:49.109033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ac3ed-2e18-40ae-8155-bbb9bc7c672d admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:49.109304 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ac3ed-2e18-40ae-8155-bbb9bc7c672d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:49.109628 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ac3ed-2e18-40ae-8155-bbb9bc7c672d admin admin] PATH_INFO: `/v3/projects/d0a4f0c15bca47a1be671aa938bbfcda/users/3516bc20f9214c7bbd1fe044b85b6e93/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:49.125424 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ac3ed-2e18-40ae-8155-bbb9bc7c672d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a4f0c15bca47a1be671aa938bbfcda, user_id=3516bc20f9214c7bbd1fe044b85b6e93, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:49.128101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ac3ed-2e18-40ae-8155-bbb9bc7c672d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:49.249547 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1113/2281] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:49 2022] PUT /identity/v3/projects/d0a4f0c15bca47a1be671aa938bbfcda/users/3516bc20f9214c7bbd1fe044b85b6e93/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:49.260825 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c001e4-24a5-4afa-bf48-683a8905ae2c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:49.261047 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c001e4-24a5-4afa-bf48-683a8905ae2c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:49.261323 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c001e4-24a5-4afa-bf48-683a8905ae2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:49.290282 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-85c001e4-24a5-4afa-bf48-683a8905ae2c None None] MFA Rules not processed for user `3516bc20f9214c7bbd1fe044b85b6e93`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:49.291867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-85c001e4-24a5-4afa-bf48-683a8905ae2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:49.356979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1169/2282] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:49.362122 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ac3ed-2e18-40ae-8155-bbb9bc7c672d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:49.425833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ac3ed-2e18-40ae-8155-bbb9bc7c672d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:49.431110 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fed60-dd18-476d-8bbc-2c1d036d9af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:49.431723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fed60-dd18-476d-8bbc-2c1d036d9af5 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:49.432003 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fed60-dd18-476d-8bbc-2c1d036d9af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:49.432274 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fed60-dd18-476d-8bbc-2c1d036d9af5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:49.432995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fed60-dd18-476d-8bbc-2c1d036d9af5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:49.434898 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fed60-dd18-476d-8bbc-2c1d036d9af5 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:49.534843 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1114/2283] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:49 2022] POST /identity/v3/projects => generated 384 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:49.540161 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c001e4-24a5-4afa-bf48-683a8905ae2c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:49.555859 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c001e4-24a5-4afa-bf48-683a8905ae2c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:49.639975 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbe9a8-16f2-44b4-b5a7-e3824a892533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:49.640630 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbe9a8-16f2-44b4-b5a7-e3824a892533 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:49.640949 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbe9a8-16f2-44b4-b5a7-e3824a892533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:49.641231 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbe9a8-16f2-44b4-b5a7-e3824a892533 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:49.641917 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbe9a8-16f2-44b4-b5a7-e3824a892533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:49.643863 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbe9a8-16f2-44b4-b5a7-e3824a892533 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:49.660555 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:49.747396 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1170/2284] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:49 2022] POST /identity/v3/users => generated 299 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:49.751474 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fed60-dd18-476d-8bbc-2c1d036d9af5 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:49.761912 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fed60-dd18-476d-8bbc-2c1d036d9af5 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:49.766277 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1aac6b-e6b0-4c16-8989-3e6737c5279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:49.766879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1aac6b-e6b0-4c16-8989-3e6737c5279d admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:49.767158 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1aac6b-e6b0-4c16-8989-3e6737c5279d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:49.767483 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1aac6b-e6b0-4c16-8989-3e6737c5279d admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:49.768170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1aac6b-e6b0-4c16-8989-3e6737c5279d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:49.769895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1aac6b-e6b0-4c16-8989-3e6737c5279d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:49.781084 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1115/2285] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:49 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:49.784969 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbe9a8-16f2-44b4-b5a7-e3824a892533 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:49.797750 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbe9a8-16f2-44b4-b5a7-e3824a892533 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:49.801304 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9d4d2-9bf4-483a-88d4-c6bb65fc243e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:49.802032 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9d4d2-9bf4-483a-88d4-c6bb65fc243e admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:49.802316 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9d4d2-9bf4-483a-88d4-c6bb65fc243e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:49.802594 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9d4d2-9bf4-483a-88d4-c6bb65fc243e admin admin] PATH_INFO: `/v3/projects/e1cfbf28b8f74a2293a8efbc01221429/users/95edfe49e1e94713b3847d9f6dc21fac/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:49.818035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9d4d2-9bf4-483a-88d4-c6bb65fc243e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1cfbf28b8f74a2293a8efbc01221429, user_id=95edfe49e1e94713b3847d9f6dc21fac, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:49.820787 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9d4d2-9bf4-483a-88d4-c6bb65fc243e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:49.947272 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1171/2286] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:49 2022] PUT /identity/v3/projects/e1cfbf28b8f74a2293a8efbc01221429/users/95edfe49e1e94713b3847d9f6dc21fac/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:49.951407 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1aac6b-e6b0-4c16-8989-3e6737c5279d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:49.962096 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1aac6b-e6b0-4c16-8989-3e6737c5279d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:50.021437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4a21e-6f04-4f87-a982-6132a1208542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:50.021437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4a21e-6f04-4f87-a982-6132a1208542 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:50.021437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4a21e-6f04-4f87-a982-6132a1208542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:50.021437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4a21e-6f04-4f87-a982-6132a1208542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:50.021899 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4a21e-6f04-4f87-a982-6132a1208542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:50.021899 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4a21e-6f04-4f87-a982-6132a1208542 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:50.030153 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1116/2287] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:49 2022] GET /identity/v3/roles => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:50.034419 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9d4d2-9bf4-483a-88d4-c6bb65fc243e admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:50.045077 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9d4d2-9bf4-483a-88d4-c6bb65fc243e admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:50.049692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0499471-ae0f-4bf8-8a82-ff51ba9f6586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:50.050347 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0499471-ae0f-4bf8-8a82-ff51ba9f6586 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:50.050633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0499471-ae0f-4bf8-8a82-ff51ba9f6586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:50.050907 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0499471-ae0f-4bf8-8a82-ff51ba9f6586 admin admin] PATH_INFO: `/v3/projects/e1cfbf28b8f74a2293a8efbc01221429/users/95edfe49e1e94713b3847d9f6dc21fac/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:50.052886 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0499471-ae0f-4bf8-8a82-ff51ba9f6586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1cfbf28b8f74a2293a8efbc01221429, user_id=95edfe49e1e94713b3847d9f6dc21fac, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:50.055514 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0499471-ae0f-4bf8-8a82-ff51ba9f6586 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:50.065494 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1172/2288] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:50 2022] PUT /identity/v3/projects/e1cfbf28b8f74a2293a8efbc01221429/users/95edfe49e1e94713b3847d9f6dc21fac/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:50.076425 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f75b0-34db-4fbc-b7bb-304ddfc6debd None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:50.076753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f75b0-34db-4fbc-b7bb-304ddfc6debd None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:50.077034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f75b0-34db-4fbc-b7bb-304ddfc6debd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:50.104554 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-158f75b0-34db-4fbc-b7bb-304ddfc6debd None None] MFA Rules not processed for user `95edfe49e1e94713b3847d9f6dc21fac`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:50.105814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-158f75b0-34db-4fbc-b7bb-304ddfc6debd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:50.177720 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1117/2289] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:50.189638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0499471-ae0f-4bf8-8a82-ff51ba9f6586 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:50.211270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:50.248674 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0499471-ae0f-4bf8-8a82-ff51ba9f6586 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:50.252530 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639dd15c-a489-4ce1-9947-7bef2827f6f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:50.253218 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dd15c-a489-4ce1-9947-7bef2827f6f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:50.253491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dd15c-a489-4ce1-9947-7bef2827f6f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:50.253767 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dd15c-a489-4ce1-9947-7bef2827f6f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:50.264452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639dd15c-a489-4ce1-9947-7bef2827f6f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:50.265921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639dd15c-a489-4ce1-9947-7bef2827f6f9 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:50.276079 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1173/2290] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:50.385224 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f75b0-34db-4fbc-b7bb-304ddfc6debd None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:50.396186 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f75b0-34db-4fbc-b7bb-304ddfc6debd None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:50.405628 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1ede1-3f5e-4edc-8434-12c1a53cfca8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:50.405628 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1ede1-3f5e-4edc-8434-12c1a53cfca8 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:50.405628 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1ede1-3f5e-4edc-8434-12c1a53cfca8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:50.405628 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1ede1-3f5e-4edc-8434-12c1a53cfca8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:50.460508 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1ede1-3f5e-4edc-8434-12c1a53cfca8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:50.461984 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1ede1-3f5e-4edc-8434-12c1a53cfca8 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:50.470851 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1118/2291] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:50.646203 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ef927-2a83-45ad-81d7-c247ef96dcb8 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:50.646203 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ef927-2a83-45ad-81d7-c247ef96dcb8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:50.646203 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ef927-2a83-45ad-81d7-c247ef96dcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:50.665221 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-498ef927-2a83-45ad-81d7-c247ef96dcb8 None None] MFA Rules not processed for user `a0a9e30da2bd4698abcff2bc5c4aba70`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:50.666462 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-498ef927-2a83-45ad-81d7-c247ef96dcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:50.734064 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1174/2292] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:50.825223 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:50.961879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1ede1-3f5e-4edc-8434-12c1a53cfca8 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:50.978997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1ede1-3f5e-4edc-8434-12c1a53cfca8 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:50.978997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eea7da-1cc5-4777-ac41-6da21a097776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:50.978997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eea7da-1cc5-4777-ac41-6da21a097776 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:50.978997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eea7da-1cc5-4777-ac41-6da21a097776 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:50.979795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eea7da-1cc5-4777-ac41-6da21a097776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:50.979795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-30eea7da-1cc5-4777-ac41-6da21a097776 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:51.047221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eea7da-1cc5-4777-ac41-6da21a097776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:51.048755 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eea7da-1cc5-4777-ac41-6da21a097776 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:51.058146 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1119/2293] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:52.403855 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:52.755619 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ef927-2a83-45ad-81d7-c247ef96dcb8 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:52.765689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ef927-2a83-45ad-81d7-c247ef96dcb8 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:52.770034 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76712d-ea0e-4681-b219-7830a88e214b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:52.770142 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76712d-ea0e-4681-b219-7830a88e214b service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:52.771035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76712d-ea0e-4681-b219-7830a88e214b service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:52.771419 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76712d-ea0e-4681-b219-7830a88e214b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:52.851679 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76712d-ea0e-4681-b219-7830a88e214b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:52.855579 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76712d-ea0e-4681-b219-7830a88e214b service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:52.863833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1175/2294] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:53.264199 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:53.824555 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eea7da-1cc5-4777-ac41-6da21a097776 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:53.922112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eea7da-1cc5-4777-ac41-6da21a097776 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:53.927273 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069484b6-29a1-4b43-89ad-cfdb73ecefaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:53.927932 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069484b6-29a1-4b43-89ad-cfdb73ecefaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:53.928389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069484b6-29a1-4b43-89ad-cfdb73ecefaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:53.928857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069484b6-29a1-4b43-89ad-cfdb73ecefaa admin admin] PATH_INFO: `/v3/users/3516bc20f9214c7bbd1fe044b85b6e93` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:53.932155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069484b6-29a1-4b43-89ad-cfdb73ecefaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3516bc20f9214c7bbd1fe044b85b6e93)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:53.934604 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069484b6-29a1-4b43-89ad-cfdb73ecefaa admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:54.129354 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-069484b6-29a1-4b43-89ad-cfdb73ecefaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3516bc20f9214c7bbd1fe044b85b6e93'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:54.130610 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-069484b6-29a1-4b43-89ad-cfdb73ecefaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3516bc20f9214c7bbd1fe044b85b6e93'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:54.143607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-069484b6-29a1-4b43-89ad-cfdb73ecefaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3516bc20f9214c7bbd1fe044b85b6e93'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:54.150662 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-069484b6-29a1-4b43-89ad-cfdb73ecefaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3516bc20f9214c7bbd1fe044b85b6e93'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:54.217867 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-069484b6-29a1-4b43-89ad-cfdb73ecefaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3516bc20f9214c7bbd1fe044b85b6e93'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:54.228380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1120/2295] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:53 2022] DELETE /identity/v3/users/3516bc20f9214c7bbd1fe044b85b6e93 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:54.230024 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a431da-b02a-4afa-a5ad-d41f1f78dd88 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:54.230940 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a431da-b02a-4afa-a5ad-d41f1f78dd88 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:54.231223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a431da-b02a-4afa-a5ad-d41f1f78dd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:54.253307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-e3a431da-b02a-4afa-a5ad-d41f1f78dd88 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:54.256530 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e3a431da-b02a-4afa-a5ad-d41f1f78dd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:54.339002 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1176/2296] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:54.349928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069484b6-29a1-4b43-89ad-cfdb73ecefaa admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:54.351449 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-069484b6-29a1-4b43-89ad-cfdb73ecefaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:54.446679 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069484b6-29a1-4b43-89ad-cfdb73ecefaa admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:54.451560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f528d-46d1-4af0-8d6a-904dc3a8b98a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:54.452416 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f528d-46d1-4af0-8d6a-904dc3a8b98a service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:54.452799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f528d-46d1-4af0-8d6a-904dc3a8b98a service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:54.453143 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f528d-46d1-4af0-8d6a-904dc3a8b98a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:54.464459 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f528d-46d1-4af0-8d6a-904dc3a8b98a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:54.466025 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f528d-46d1-4af0-8d6a-904dc3a8b98a service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:54.484486 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1121/2297] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:54.878021 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:54.951319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a431da-b02a-4afa-a5ad-d41f1f78dd88 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:54.952844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e3a431da-b02a-4afa-a5ad-d41f1f78dd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:54.965766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a431da-b02a-4afa-a5ad-d41f1f78dd88 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:54.985382 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e5c60-9901-4d86-9c9d-5f16be69e1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:54.986592 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e5c60-9901-4d86-9c9d-5f16be69e1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:54.987039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e5c60-9901-4d86-9c9d-5f16be69e1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:54.987487 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e5c60-9901-4d86-9c9d-5f16be69e1c4 admin admin] PATH_INFO: `/v3/projects/d0a4f0c15bca47a1be671aa938bbfcda` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:54.991978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e5c60-9901-4d86-9c9d-5f16be69e1c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a4f0c15bca47a1be671aa938bbfcda)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:54.991978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e5c60-9901-4d86-9c9d-5f16be69e1c4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:55.114509 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-907e5c60-9901-4d86-9c9d-5f16be69e1c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a4f0c15bca47a1be671aa938bbfcda', 'request_id': 'req-907e5c60-9901-4d86-9c9d-5f16be69e1c4'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:55.157090 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-907e5c60-9901-4d86-9c9d-5f16be69e1c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a4f0c15bca47a1be671aa938bbfcda', 'request_id': 'req-907e5c60-9901-4d86-9c9d-5f16be69e1c4'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:55.173227 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-907e5c60-9901-4d86-9c9d-5f16be69e1c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a4f0c15bca47a1be671aa938bbfcda', 'request_id': 'req-907e5c60-9901-4d86-9c9d-5f16be69e1c4'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:55.295915 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-907e5c60-9901-4d86-9c9d-5f16be69e1c4 admin admin] The token cache is being invalidate because project d0a4f0c15bca47a1be671aa938bbfcda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:55.296572 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-907e5c60-9901-4d86-9c9d-5f16be69e1c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:55.297166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-907e5c60-9901-4d86-9c9d-5f16be69e1c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:55.298712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1177/2298] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:54 2022] DELETE /identity/v3/projects/d0a4f0c15bca47a1be671aa938bbfcda => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:55.302894 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f528d-46d1-4af0-8d6a-904dc3a8b98a service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:55.313052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f528d-46d1-4af0-8d6a-904dc3a8b98a service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:55.372083 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3848289-e8bf-4809-8d75-916ffe2a99d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:55.372749 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3848289-e8bf-4809-8d75-916ffe2a99d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:55.373032 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3848289-e8bf-4809-8d75-916ffe2a99d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:55.373306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3848289-e8bf-4809-8d75-916ffe2a99d9 admin admin] PATH_INFO: `/v3/users/95edfe49e1e94713b3847d9f6dc21fac` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:55.374460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3848289-e8bf-4809-8d75-916ffe2a99d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95edfe49e1e94713b3847d9f6dc21fac)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:55.376414 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3848289-e8bf-4809-8d75-916ffe2a99d9 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:55.407111 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:55.640455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f3848289-e8bf-4809-8d75-916ffe2a99d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95edfe49e1e94713b3847d9f6dc21fac'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:55.641144 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f3848289-e8bf-4809-8d75-916ffe2a99d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95edfe49e1e94713b3847d9f6dc21fac'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:55.652741 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f3848289-e8bf-4809-8d75-916ffe2a99d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95edfe49e1e94713b3847d9f6dc21fac'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:55.660094 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f3848289-e8bf-4809-8d75-916ffe2a99d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95edfe49e1e94713b3847d9f6dc21fac'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:55.800726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f3848289-e8bf-4809-8d75-916ffe2a99d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95edfe49e1e94713b3847d9f6dc21fac'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:55.808676 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1122/2299] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:55 2022] DELETE /identity/v3/users/95edfe49e1e94713b3847d9f6dc21fac => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:56.349649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:56.642229 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e5c60-9901-4d86-9c9d-5f16be69e1c4 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:56.643694 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-907e5c60-9901-4d86-9c9d-5f16be69e1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:56.656271 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e5c60-9901-4d86-9c9d-5f16be69e1c4 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:56.721779 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b535c2-1232-4112-b594-582311606376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:56.722610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b535c2-1232-4112-b594-582311606376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:56.723097 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b535c2-1232-4112-b594-582311606376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:56.723987 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b535c2-1232-4112-b594-582311606376 admin admin] PATH_INFO: `/v3/projects/e1cfbf28b8f74a2293a8efbc01221429` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:56.725581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b535c2-1232-4112-b594-582311606376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1cfbf28b8f74a2293a8efbc01221429)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:56.739899 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b535c2-1232-4112-b594-582311606376 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:56.834898 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-85b535c2-1232-4112-b594-582311606376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1cfbf28b8f74a2293a8efbc01221429', 'request_id': 'req-85b535c2-1232-4112-b594-582311606376'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:56.843366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-85b535c2-1232-4112-b594-582311606376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1cfbf28b8f74a2293a8efbc01221429', 'request_id': 'req-85b535c2-1232-4112-b594-582311606376'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:56.854237 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-85b535c2-1232-4112-b594-582311606376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1cfbf28b8f74a2293a8efbc01221429', 'request_id': 'req-85b535c2-1232-4112-b594-582311606376'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:56.931043 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-85b535c2-1232-4112-b594-582311606376 admin admin] The token cache is being invalidate because project e1cfbf28b8f74a2293a8efbc01221429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:24:56.931359 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-85b535c2-1232-4112-b594-582311606376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:56.932200 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-85b535c2-1232-4112-b594-582311606376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:56.934056 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1178/2300] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:56 2022] DELETE /identity/v3/projects/e1cfbf28b8f74a2293a8efbc01221429 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:56.939491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037afff-82f7-49f0-973c-0feefde5974c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:56.939959 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037afff-82f7-49f0-973c-0feefde5974c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:56.940118 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037afff-82f7-49f0-973c-0feefde5974c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:56.959855 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e037afff-82f7-49f0-973c-0feefde5974c None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:56.961106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e037afff-82f7-49f0-973c-0feefde5974c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:57.032821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1123/2301] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:57.037271 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc97e39-9b8a-4351-bf9d-fa170e402d3e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:57.037559 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc97e39-9b8a-4351-bf9d-fa170e402d3e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:57.037836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc97e39-9b8a-4351-bf9d-fa170e402d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:57.079204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-1cc97e39-9b8a-4351-bf9d-fa170e402d3e None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:57.082315 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1cc97e39-9b8a-4351-bf9d-fa170e402d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:57.095236 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1179/2302] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:24:57.100611 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037afff-82f7-49f0-973c-0feefde5974c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:57.111815 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037afff-82f7-49f0-973c-0feefde5974c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:57.116946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca86ef-2009-430e-8a04-1de7e39c99c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:57.117462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca86ef-2009-430e-8a04-1de7e39c99c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:57.117778 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca86ef-2009-430e-8a04-1de7e39c99c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:57.118162 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca86ef-2009-430e-8a04-1de7e39c99c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:57.119220 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca86ef-2009-430e-8a04-1de7e39c99c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:24:57.119667 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca86ef-2009-430e-8a04-1de7e39c99c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:57.121862 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca86ef-2009-430e-8a04-1de7e39c99c4 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:57.174246 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1124/2303] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:24:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:24:57.177816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc97e39-9b8a-4351-bf9d-fa170e402d3e None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:57.200039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc97e39-9b8a-4351-bf9d-fa170e402d3e None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:57.200869 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c8a26-2e66-4ccc-9078-0436db68a0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:57.201651 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c8a26-2e66-4ccc-9078-0436db68a0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:57.202076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c8a26-2e66-4ccc-9078-0436db68a0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:57.202368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c8a26-2e66-4ccc-9078-0436db68a0c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:57.203090 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c8a26-2e66-4ccc-9078-0436db68a0c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:57.206087 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c8a26-2e66-4ccc-9078-0436db68a0c8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:57.371207 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1180/2304] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:57 2022] POST /identity/v3/projects => generated 374 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:57.373243 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca86ef-2009-430e-8a04-1de7e39c99c4 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:57.386197 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca86ef-2009-430e-8a04-1de7e39c99c4 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:57.454623 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524962ad-2603-4907-97c2-5309c4b1d622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:57.455250 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524962ad-2603-4907-97c2-5309c4b1d622 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:57.455536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524962ad-2603-4907-97c2-5309c4b1d622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:57.455816 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524962ad-2603-4907-97c2-5309c4b1d622 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:57.456488 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524962ad-2603-4907-97c2-5309c4b1d622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:57.461342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524962ad-2603-4907-97c2-5309c4b1d622 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:57.553503 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1125/2305] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:57 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:24:57.557712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c8a26-2e66-4ccc-9078-0436db68a0c8 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:57.580813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c8a26-2e66-4ccc-9078-0436db68a0c8 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:57.586711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d57ea-b61e-4d55-8c48-5ac564e9ea23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:57.591365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d57ea-b61e-4d55-8c48-5ac564e9ea23 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:57.591365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d57ea-b61e-4d55-8c48-5ac564e9ea23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:57.591365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d57ea-b61e-4d55-8c48-5ac564e9ea23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:57.591365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d57ea-b61e-4d55-8c48-5ac564e9ea23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:57.591365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d57ea-b61e-4d55-8c48-5ac564e9ea23 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:57.602563 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1181/2306] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:57 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:57.606394 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524962ad-2603-4907-97c2-5309c4b1d622 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:57.618080 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524962ad-2603-4907-97c2-5309c4b1d622 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:57.623172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09295318-902a-4539-b041-a140e3e8ba34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:57.623859 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09295318-902a-4539-b041-a140e3e8ba34 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:57.624224 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09295318-902a-4539-b041-a140e3e8ba34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:57.624537 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09295318-902a-4539-b041-a140e3e8ba34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:57.625399 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09295318-902a-4539-b041-a140e3e8ba34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:57.627342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09295318-902a-4539-b041-a140e3e8ba34 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:57.647608 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1126/2307] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:24:57 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:24:57.648369 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d57ea-b61e-4d55-8c48-5ac564e9ea23 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:57.658751 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d57ea-b61e-4d55-8c48-5ac564e9ea23 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:57.664145 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55422a-43ae-471d-a55f-d71912dc0633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:57.664879 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55422a-43ae-471d-a55f-d71912dc0633 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:57.665168 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55422a-43ae-471d-a55f-d71912dc0633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:57.665453 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55422a-43ae-471d-a55f-d71912dc0633 admin admin] PATH_INFO: `/v3/projects/2ed990b2222841ff8040bb6f076ee50c/users/b19e0e76e9844195b3baad3b59f34774/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:57.675371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:57.683078 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55422a-43ae-471d-a55f-d71912dc0633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed990b2222841ff8040bb6f076ee50c, user_id=b19e0e76e9844195b3baad3b59f34774, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:57.685867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55422a-43ae-471d-a55f-d71912dc0633 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:57.803882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1182/2308] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:24:57 2022] PUT /identity/v3/projects/2ed990b2222841ff8040bb6f076ee50c/users/b19e0e76e9844195b3baad3b59f34774/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:57.808975 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e527222-319c-4b24-86c6-1da3aff8b872 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:57.809288 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e527222-319c-4b24-86c6-1da3aff8b872 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:57.809555 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e527222-319c-4b24-86c6-1da3aff8b872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:57.825979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:57.837782 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8e527222-319c-4b24-86c6-1da3aff8b872 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:57.839054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8e527222-319c-4b24-86c6-1da3aff8b872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:57.924788 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1127/2309] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:57.939774 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55422a-43ae-471d-a55f-d71912dc0633 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:57.950366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1d55422a-43ae-471d-a55f-d71912dc0633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:58.017151 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55422a-43ae-471d-a55f-d71912dc0633 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:58.021465 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2635b-16f8-4c82-ab65-69b808e7189d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:58.022115 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2635b-16f8-4c82-ab65-69b808e7189d service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:58.023099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2635b-16f8-4c82-ab65-69b808e7189d service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:58.023099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2635b-16f8-4c82-ab65-69b808e7189d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:58.032407 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2635b-16f8-4c82-ab65-69b808e7189d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:58.033994 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2635b-16f8-4c82-ab65-69b808e7189d service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:58.044724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1183/2310] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:58.704177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e527222-319c-4b24-86c6-1da3aff8b872 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:58.706389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8e527222-319c-4b24-86c6-1da3aff8b872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:58.720513 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e527222-319c-4b24-86c6-1da3aff8b872 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:58.725343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22773be6-a401-41b2-9974-75fafea66efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:58.726295 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22773be6-a401-41b2-9974-75fafea66efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:58.726650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22773be6-a401-41b2-9974-75fafea66efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:58.726997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22773be6-a401-41b2-9974-75fafea66efd admin admin] PATH_INFO: `/v3/users/64ff32b258004d92a27c19bc25e9079e` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:58.729979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22773be6-a401-41b2-9974-75fafea66efd admin admin] RBAC: Authorizing `identity:delete_user(user_id=64ff32b258004d92a27c19bc25e9079e)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:58.735923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22773be6-a401-41b2-9974-75fafea66efd admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:58.977699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-22773be6-a401-41b2-9974-75fafea66efd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64ff32b258004d92a27c19bc25e9079e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:58.978465 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-22773be6-a401-41b2-9974-75fafea66efd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64ff32b258004d92a27c19bc25e9079e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:58.992479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-22773be6-a401-41b2-9974-75fafea66efd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64ff32b258004d92a27c19bc25e9079e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:59.000533 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-22773be6-a401-41b2-9974-75fafea66efd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64ff32b258004d92a27c19bc25e9079e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:59.091755 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-22773be6-a401-41b2-9974-75fafea66efd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64ff32b258004d92a27c19bc25e9079e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:24:59.098034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1128/2311] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:24:58 2022] DELETE /identity/v3/users/64ff32b258004d92a27c19bc25e9079e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:24:59.102514 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3522f-02a9-44a8-a28b-59025822d134 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:59.103438 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3522f-02a9-44a8-a28b-59025822d134 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:59.103746 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3522f-02a9-44a8-a28b-59025822d134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:59.105763 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:59.126202 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f7e3522f-02a9-44a8-a28b-59025822d134 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:59.127441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f7e3522f-02a9-44a8-a28b-59025822d134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:59.226926 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1184/2312] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:59.237378 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22773be6-a401-41b2-9974-75fafea66efd admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:59.238813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-22773be6-a401-41b2-9974-75fafea66efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:59.304413 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22773be6-a401-41b2-9974-75fafea66efd admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:59.308152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4b7b0-f8d0-4a80-881d-14f63be2ae7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:59.313211 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4b7b0-f8d0-4a80-881d-14f63be2ae7d service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:59.313211 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4b7b0-f8d0-4a80-881d-14f63be2ae7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:59.313211 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4b7b0-f8d0-4a80-881d-14f63be2ae7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:59.326017 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4b7b0-f8d0-4a80-881d-14f63be2ae7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:59.327585 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4b7b0-f8d0-4a80-881d-14f63be2ae7d service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:59.339770 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1129/2313] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:24:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:24:59.501452 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:59.539878 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2343ef1-d0d2-42d8-86e7-ff0497b7fea9 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:59.540176 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2343ef1-d0d2-42d8-86e7-ff0497b7fea9 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:59.540473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2343ef1-d0d2-42d8-86e7-ff0497b7fea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:59.575511 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d2343ef1-d0d2-42d8-86e7-ff0497b7fea9 None None] MFA Rules not processed for user `b19e0e76e9844195b3baad3b59f34774`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:24:59.576783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d2343ef1-d0d2-42d8-86e7-ff0497b7fea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:59.725193 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1185/2314] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:24:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:24:59.729794 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4b7b0-f8d0-4a80-881d-14f63be2ae7d service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:59.731455 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6af4b7b0-f8d0-4a80-881d-14f63be2ae7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:59.745813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4b7b0-f8d0-4a80-881d-14f63be2ae7d service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:59.752221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b960af-5be6-41b1-ad4c-334a7dc0729f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:24:59.752879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b960af-5be6-41b1-ad4c-334a7dc0729f admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:24:59.753158 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b960af-5be6-41b1-ad4c-334a7dc0729f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:24:59.753594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b960af-5be6-41b1-ad4c-334a7dc0729f admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:24:59.756774 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b960af-5be6-41b1-ad4c-334a7dc0729f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:24:59.756774 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b960af-5be6-41b1-ad4c-334a7dc0729f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:24:59.885080 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2343ef1-d0d2-42d8-86e7-ff0497b7fea9 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:59.885420 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1130/2315] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:24:59 2022] POST /identity/v3/projects => generated 374 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:24:59.886649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d2343ef1-d0d2-42d8-86e7-ff0497b7fea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:24:59.889655 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b960af-5be6-41b1-ad4c-334a7dc0729f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:24:59.921844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2343ef1-d0d2-42d8-86e7-ff0497b7fea9 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:24:59.993243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:59.997886 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b960af-5be6-41b1-ad4c-334a7dc0729f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:00.005340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf34fe-7caa-47ee-97a8-f0ee86f6b93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:00.005991 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf34fe-7caa-47ee-97a8-f0ee86f6b93d admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:00.006798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf34fe-7caa-47ee-97a8-f0ee86f6b93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:00.007226 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf34fe-7caa-47ee-97a8-f0ee86f6b93d admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:00.008486 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf34fe-7caa-47ee-97a8-f0ee86f6b93d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:00.010838 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf34fe-7caa-47ee-97a8-f0ee86f6b93d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:00.023698 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e128677-4019-4f97-9173-29624ac47121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:00.024462 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e128677-4019-4f97-9173-29624ac47121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:00.024911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e128677-4019-4f97-9173-29624ac47121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:00.025276 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e128677-4019-4f97-9173-29624ac47121 admin admin] PATH_INFO: `/v3/projects/d8dd4454620649c7a6f7fcc4ce07c857` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:00.026566 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e128677-4019-4f97-9173-29624ac47121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8dd4454620649c7a6f7fcc4ce07c857)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:00.028560 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e128677-4019-4f97-9173-29624ac47121 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:00.144706 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1131/2316] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:24:59 2022] POST /identity/v3/users => generated 294 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:25:00.146242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf34fe-7caa-47ee-97a8-f0ee86f6b93d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:00.157927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf34fe-7caa-47ee-97a8-f0ee86f6b93d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:00.177938 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4e128677-4019-4f97-9173-29624ac47121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8dd4454620649c7a6f7fcc4ce07c857', 'request_id': 'req-4e128677-4019-4f97-9173-29624ac47121'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:00.188998 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4e128677-4019-4f97-9173-29624ac47121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8dd4454620649c7a6f7fcc4ce07c857', 'request_id': 'req-4e128677-4019-4f97-9173-29624ac47121'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:00.196309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4e128677-4019-4f97-9173-29624ac47121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8dd4454620649c7a6f7fcc4ce07c857', 'request_id': 'req-4e128677-4019-4f97-9173-29624ac47121'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:00.226143 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb7ac8-8e62-441d-b1e6-8a8c16a1a426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:00.226774 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb7ac8-8e62-441d-b1e6-8a8c16a1a426 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:00.227058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb7ac8-8e62-441d-b1e6-8a8c16a1a426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:00.227333 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb7ac8-8e62-441d-b1e6-8a8c16a1a426 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:00.228036 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb7ac8-8e62-441d-b1e6-8a8c16a1a426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:00.230156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb7ac8-8e62-441d-b1e6-8a8c16a1a426 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:00.245816 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1132/2317] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:25:00 2022] GET /identity/v3/roles => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:25:00.245816 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb7ac8-8e62-441d-b1e6-8a8c16a1a426 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:00.256085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb7ac8-8e62-441d-b1e6-8a8c16a1a426 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:00.262233 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd44e7a-37d5-40d9-b2bf-dc2c5dd13b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:00.268196 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd44e7a-37d5-40d9-b2bf-dc2c5dd13b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:00.268196 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd44e7a-37d5-40d9-b2bf-dc2c5dd13b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:00.268196 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd44e7a-37d5-40d9-b2bf-dc2c5dd13b36 admin admin] PATH_INFO: `/v3/projects/23e761ea9f3d4030a0f3575d8197f0b5/users/d1c72df6f8ff4e258b680592d3e8b186/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:00.279676 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd44e7a-37d5-40d9-b2bf-dc2c5dd13b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e761ea9f3d4030a0f3575d8197f0b5, user_id=d1c72df6f8ff4e258b680592d3e8b186, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:00.282399 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd44e7a-37d5-40d9-b2bf-dc2c5dd13b36 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:00.296880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4e128677-4019-4f97-9173-29624ac47121 admin admin] The token cache is being invalidate because project d8dd4454620649c7a6f7fcc4ce07c857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:25:00.297888 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4e128677-4019-4f97-9173-29624ac47121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:00.298974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4e128677-4019-4f97-9173-29624ac47121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:00.302008 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1186/2318] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:24:59 2022] DELETE /identity/v3/projects/d8dd4454620649c7a6f7fcc4ce07c857 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:25:00.307725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e128677-4019-4f97-9173-29624ac47121 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:00.310533 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4e128677-4019-4f97-9173-29624ac47121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:00.333635 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e128677-4019-4f97-9173-29624ac47121 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:00.343338 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717eaac7-a55b-49de-8be5-28b72e75f6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:00.349384 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eaac7-a55b-49de-8be5-28b72e75f6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:00.349923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eaac7-a55b-49de-8be5-28b72e75f6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:00.361242 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eaac7-a55b-49de-8be5-28b72e75f6e1 admin admin] PATH_INFO: `/v3/users/83226c1034264629840e21e4f849c515` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:00.365108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1133/2319] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:25:00 2022] PUT /identity/v3/projects/23e761ea9f3d4030a0f3575d8197f0b5/users/d1c72df6f8ff4e258b680592d3e8b186/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:25:00.367073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717eaac7-a55b-49de-8be5-28b72e75f6e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83226c1034264629840e21e4f849c515)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:00.369037 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd44e7a-37d5-40d9-b2bf-dc2c5dd13b36 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:00.373156 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717eaac7-a55b-49de-8be5-28b72e75f6e1 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:00.374082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ccd44e7a-37d5-40d9-b2bf-dc2c5dd13b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:00.440832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:00.467675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd44e7a-37d5-40d9-b2bf-dc2c5dd13b36 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:00.479279 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da323ac2-a743-4780-a019-ccb5bf413c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:00.479911 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da323ac2-a743-4780-a019-ccb5bf413c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:00.480199 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da323ac2-a743-4780-a019-ccb5bf413c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:00.480479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da323ac2-a743-4780-a019-ccb5bf413c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:00.481245 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da323ac2-a743-4780-a019-ccb5bf413c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:00.482856 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da323ac2-a743-4780-a019-ccb5bf413c03 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:00.494881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1134/2320] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:25:00 2022] GET /identity/v3/roles => generated 1427 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:25:00.498917 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da323ac2-a743-4780-a019-ccb5bf413c03 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:00.511883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da323ac2-a743-4780-a019-ccb5bf413c03 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:00.516636 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e23a2-a1de-4fa2-8818-a221c88909fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:00.517338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e23a2-a1de-4fa2-8818-a221c88909fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:00.517620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e23a2-a1de-4fa2-8818-a221c88909fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:00.517896 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e23a2-a1de-4fa2-8818-a221c88909fa admin admin] PATH_INFO: `/v3/projects/23e761ea9f3d4030a0f3575d8197f0b5/users/d1c72df6f8ff4e258b680592d3e8b186/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:00.520699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e23a2-a1de-4fa2-8818-a221c88909fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e761ea9f3d4030a0f3575d8197f0b5, user_id=d1c72df6f8ff4e258b680592d3e8b186, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:00.523209 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e23a2-a1de-4fa2-8818-a221c88909fa admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:00.533458 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1135/2321] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:25:00 2022] PUT /identity/v3/projects/23e761ea9f3d4030a0f3575d8197f0b5/users/d1c72df6f8ff4e258b680592d3e8b186/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:25:00.569797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-717eaac7-a55b-49de-8be5-28b72e75f6e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83226c1034264629840e21e4f849c515'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:00.570539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-717eaac7-a55b-49de-8be5-28b72e75f6e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83226c1034264629840e21e4f849c515'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:00.680363 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-717eaac7-a55b-49de-8be5-28b72e75f6e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83226c1034264629840e21e4f849c515'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:00.693594 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-717eaac7-a55b-49de-8be5-28b72e75f6e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83226c1034264629840e21e4f849c515'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:00.694266 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-717eaac7-a55b-49de-8be5-28b72e75f6e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83226c1034264629840e21e4f849c515'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:00.706618 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1187/2322] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:25:00 2022] DELETE /identity/v3/users/83226c1034264629840e21e4f849c515 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:25:00.877083 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:01.126344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e23a2-a1de-4fa2-8818-a221c88909fa admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:01.131227 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-488e23a2-a1de-4fa2-8818-a221c88909fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:01.309257 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:01.346941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e23a2-a1de-4fa2-8818-a221c88909fa admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:01.489152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233fd7c-cc8a-49b5-a2ef-64992a898883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:01.489915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233fd7c-cc8a-49b5-a2ef-64992a898883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:01.490436 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233fd7c-cc8a-49b5-a2ef-64992a898883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:01.490713 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233fd7c-cc8a-49b5-a2ef-64992a898883 admin admin] PATH_INFO: `/v3/projects/bceb7fa7667343feacc6f3f450f7d82e` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:01.494419 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233fd7c-cc8a-49b5-a2ef-64992a898883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bceb7fa7667343feacc6f3f450f7d82e)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:01.496744 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233fd7c-cc8a-49b5-a2ef-64992a898883 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:01.709404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d233fd7c-cc8a-49b5-a2ef-64992a898883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bceb7fa7667343feacc6f3f450f7d82e', 'request_id': 'req-d233fd7c-cc8a-49b5-a2ef-64992a898883'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:01.716106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d233fd7c-cc8a-49b5-a2ef-64992a898883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bceb7fa7667343feacc6f3f450f7d82e', 'request_id': 'req-d233fd7c-cc8a-49b5-a2ef-64992a898883'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:01.721797 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d233fd7c-cc8a-49b5-a2ef-64992a898883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bceb7fa7667343feacc6f3f450f7d82e', 'request_id': 'req-d233fd7c-cc8a-49b5-a2ef-64992a898883'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:01.815735 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d233fd7c-cc8a-49b5-a2ef-64992a898883 admin admin] The token cache is being invalidate because project bceb7fa7667343feacc6f3f450f7d82e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:25:01.816271 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d233fd7c-cc8a-49b5-a2ef-64992a898883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:01.816974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d233fd7c-cc8a-49b5-a2ef-64992a898883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:01.818507 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1136/2323] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:25:01 2022] DELETE /identity/v3/projects/bceb7fa7667343feacc6f3f450f7d82e => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:25:01.822690 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717eaac7-a55b-49de-8be5-28b72e75f6e1 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:01.834400 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717eaac7-a55b-49de-8be5-28b72e75f6e1 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:01.895856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34b18d-e305-4fc8-a3b4-17f6628e4d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:01.896439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34b18d-e305-4fc8-a3b4-17f6628e4d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:01.896754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34b18d-e305-4fc8-a3b4-17f6628e4d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:01.897034 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34b18d-e305-4fc8-a3b4-17f6628e4d9b admin admin] PATH_INFO: `/v3/users/e0f2e8b3f1dc48d68acb43d0b4f88446` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:01.898539 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34b18d-e305-4fc8-a3b4-17f6628e4d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f2e8b3f1dc48d68acb43d0b4f88446)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:01.900521 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34b18d-e305-4fc8-a3b4-17f6628e4d9b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:02.066029 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:02.079737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5d34b18d-e305-4fc8-a3b4-17f6628e4d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f2e8b3f1dc48d68acb43d0b4f88446'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:02.080392 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5d34b18d-e305-4fc8-a3b4-17f6628e4d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f2e8b3f1dc48d68acb43d0b4f88446'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:02.141427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379c348-a993-4620-ab50-d03b551d4048 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:02.141948 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379c348-a993-4620-ab50-d03b551d4048 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:02.142112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379c348-a993-4620-ab50-d03b551d4048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:02.164726 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5d34b18d-e305-4fc8-a3b4-17f6628e4d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f2e8b3f1dc48d68acb43d0b4f88446'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:02.176002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-4379c348-a993-4620-ab50-d03b551d4048 None None] MFA Rules not processed for user `d1c72df6f8ff4e258b680592d3e8b186`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:02.177382 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4379c348-a993-4620-ab50-d03b551d4048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:02.181961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5d34b18d-e305-4fc8-a3b4-17f6628e4d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f2e8b3f1dc48d68acb43d0b4f88446'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:02.182787 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5d34b18d-e305-4fc8-a3b4-17f6628e4d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f2e8b3f1dc48d68acb43d0b4f88446'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:02.196160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1188/2324] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:25:01 2022] DELETE /identity/v3/users/e0f2e8b3f1dc48d68acb43d0b4f88446 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:25:02.260286 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1137/2325] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:25:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:02.272919 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad302584-734d-4878-8f09-560ca5cf7422 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:02.273215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad302584-734d-4878-8f09-560ca5cf7422 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:02.273501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad302584-734d-4878-8f09-560ca5cf7422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:02.294455 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-ad302584-734d-4878-8f09-560ca5cf7422 None None] MFA Rules not processed for user `b19e0e76e9844195b3baad3b59f34774`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:02.297142 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ad302584-734d-4878-8f09-560ca5cf7422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:02.356706 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1189/2326] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:25:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:02.369503 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379c348-a993-4620-ab50-d03b551d4048 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:02.371069 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4379c348-a993-4620-ab50-d03b551d4048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:02.450813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379c348-a993-4620-ab50-d03b551d4048 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:02.555071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a5281-06d0-4e19-acbe-765bcf1a4927 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:02.555720 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a5281-06d0-4e19-acbe-765bcf1a4927 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:02.556107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a5281-06d0-4e19-acbe-765bcf1a4927 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:02.556282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a5281-06d0-4e19-acbe-765bcf1a4927 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:02.558059 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-031a5281-06d0-4e19-acbe-765bcf1a4927 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:02.569561 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a5281-06d0-4e19-acbe-765bcf1a4927 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:02.571496 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a5281-06d0-4e19-acbe-765bcf1a4927 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:02.582212 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1138/2327] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:25:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:25:02.639443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:02.674929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4e761-9624-41af-80f8-6ff5313d4c40 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:02.675220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4e761-9624-41af-80f8-6ff5313d4c40 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:02.675505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4e761-9624-41af-80f8-6ff5313d4c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:02.708581 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-3db4e761-9624-41af-80f8-6ff5313d4c40 None None] MFA Rules not processed for user `0ab7a9d2b4f44d4e91a3c198f945f980`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:02.710763 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3db4e761-9624-41af-80f8-6ff5313d4c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:02.773968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1190/2328] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:25:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:02.812684 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a5281-06d0-4e19-acbe-765bcf1a4927 service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:02.814161 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-031a5281-06d0-4e19-acbe-765bcf1a4927 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:02.908161 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a5281-06d0-4e19-acbe-765bcf1a4927 service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:02.913570 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963b818-0d36-44d5-8102-7930b0a9eb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:02.914221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963b818-0d36-44d5-8102-7930b0a9eb06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:02.914505 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963b818-0d36-44d5-8102-7930b0a9eb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:02.914781 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963b818-0d36-44d5-8102-7930b0a9eb06 admin admin] PATH_INFO: `/v3/projects/f7e07086367742c78b6da3138c416fc9` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:02.915950 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963b818-0d36-44d5-8102-7930b0a9eb06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7e07086367742c78b6da3138c416fc9)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:02.918420 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963b818-0d36-44d5-8102-7930b0a9eb06 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:03.082099 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c963b818-0d36-44d5-8102-7930b0a9eb06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7e07086367742c78b6da3138c416fc9', 'request_id': 'req-c963b818-0d36-44d5-8102-7930b0a9eb06'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:03.090358 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c963b818-0d36-44d5-8102-7930b0a9eb06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7e07086367742c78b6da3138c416fc9', 'request_id': 'req-c963b818-0d36-44d5-8102-7930b0a9eb06'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:03.097646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c963b818-0d36-44d5-8102-7930b0a9eb06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7e07086367742c78b6da3138c416fc9', 'request_id': 'req-c963b818-0d36-44d5-8102-7930b0a9eb06'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:03.194582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c963b818-0d36-44d5-8102-7930b0a9eb06 admin admin] The token cache is being invalidate because project f7e07086367742c78b6da3138c416fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:25:03.195262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c963b818-0d36-44d5-8102-7930b0a9eb06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:03.195915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c963b818-0d36-44d5-8102-7930b0a9eb06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:03.197797 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1139/2329] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:25:02 2022] DELETE /identity/v3/projects/f7e07086367742c78b6da3138c416fc9 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:25:03.202798 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f0a01-59c4-440c-8ad1-1d4e57cce34f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:03.203630 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f0a01-59c4-440c-8ad1-1d4e57cce34f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:03.204175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f0a01-59c4-440c-8ad1-1d4e57cce34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:03.230580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f11f0a01-59c4-440c-8ad1-1d4e57cce34f None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:03.231807 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f11f0a01-59c4-440c-8ad1-1d4e57cce34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:03.335585 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1191/2330] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:03.400653 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d823a2-78fa-4088-9d15-73f4d9a0d8d8 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:03.401178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d823a2-78fa-4088-9d15-73f4d9a0d8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:03.401463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d823a2-78fa-4088-9d15-73f4d9a0d8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:03.426909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-30d823a2-78fa-4088-9d15-73f4d9a0d8d8 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:03.428428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-30d823a2-78fa-4088-9d15-73f4d9a0d8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:03.465211 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1140/2331] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:03.469404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f0a01-59c4-440c-8ad1-1d4e57cce34f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:03.483847 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f0a01-59c4-440c-8ad1-1d4e57cce34f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:03.491649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd837a-17fb-4fcc-8e06-45481a35fcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:03.492290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd837a-17fb-4fcc-8e06-45481a35fcbd admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:03.493146 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd837a-17fb-4fcc-8e06-45481a35fcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:03.493471 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd837a-17fb-4fcc-8e06-45481a35fcbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:03.494612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd837a-17fb-4fcc-8e06-45481a35fcbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:25:03.494939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd837a-17fb-4fcc-8e06-45481a35fcbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:03.497220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd837a-17fb-4fcc-8e06-45481a35fcbd admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:03.513266 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1192/2332] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:25:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:25:03.517517 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d823a2-78fa-4088-9d15-73f4d9a0d8d8 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:03.530238 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d823a2-78fa-4088-9d15-73f4d9a0d8d8 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:03.556509 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061834b-f5ce-4f0d-9db6-c4047bbe309e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:03.557315 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061834b-f5ce-4f0d-9db6-c4047bbe309e admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:03.557744 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061834b-f5ce-4f0d-9db6-c4047bbe309e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:03.558322 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061834b-f5ce-4f0d-9db6-c4047bbe309e admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:03.559289 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061834b-f5ce-4f0d-9db6-c4047bbe309e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:03.564907 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061834b-f5ce-4f0d-9db6-c4047bbe309e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:03.643823 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:03.688843 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1141/2333] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:25:03 2022] POST /identity/v3/projects => generated 374 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:25:03.702372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd837a-17fb-4fcc-8e06-45481a35fcbd admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:03.716991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd837a-17fb-4fcc-8e06-45481a35fcbd admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:03.832518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf5a75-9892-4048-b68f-e0b4a3dd5fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:03.833237 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf5a75-9892-4048-b68f-e0b4a3dd5fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:03.833595 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf5a75-9892-4048-b68f-e0b4a3dd5fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:03.834040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf5a75-9892-4048-b68f-e0b4a3dd5fe5 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:03.834886 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf5a75-9892-4048-b68f-e0b4a3dd5fe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:03.837299 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf5a75-9892-4048-b68f-e0b4a3dd5fe5 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:03.960716 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1193/2334] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:25:03 2022] POST /identity/v3/users => generated 288 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:25:03.965208 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061834b-f5ce-4f0d-9db6-c4047bbe309e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:03.992762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061834b-f5ce-4f0d-9db6-c4047bbe309e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:03.998058 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fa989-c387-40ab-b719-63dcfd13665e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:03.999108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fa989-c387-40ab-b719-63dcfd13665e admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:03.999597 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fa989-c387-40ab-b719-63dcfd13665e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:04.000561 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fa989-c387-40ab-b719-63dcfd13665e admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:04.001469 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fa989-c387-40ab-b719-63dcfd13665e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:04.003357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fa989-c387-40ab-b719-63dcfd13665e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:04.020043 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf5a75-9892-4048-b68f-e0b4a3dd5fe5 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:04.020728 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1142/2335] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:25:03 2022] GET /identity/v3/roles => generated 1427 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:25:04.032229 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf5a75-9892-4048-b68f-e0b4a3dd5fe5 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:04.037360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662305f-627b-4311-84bd-a822a94ad1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:04.039693 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662305f-627b-4311-84bd-a822a94ad1fb admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:04.039693 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662305f-627b-4311-84bd-a822a94ad1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:04.039693 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662305f-627b-4311-84bd-a822a94ad1fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:04.039693 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662305f-627b-4311-84bd-a822a94ad1fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:04.040921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662305f-627b-4311-84bd-a822a94ad1fb admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:04.053749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1194/2336] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:25:04 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:25:04.057818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fa989-c387-40ab-b719-63dcfd13665e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:04.069381 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fa989-c387-40ab-b719-63dcfd13665e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:04.074164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86932e50-1a39-4c59-8384-3ca50e05c717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:04.074886 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86932e50-1a39-4c59-8384-3ca50e05c717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:04.075245 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86932e50-1a39-4c59-8384-3ca50e05c717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:04.075444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86932e50-1a39-4c59-8384-3ca50e05c717 admin admin] PATH_INFO: `/v3/projects/5515fa5dd2734bd99ed543c2455b118d/users/018b11e1436c45978eb09bd48a1c4df3/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:04.098849 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86932e50-1a39-4c59-8384-3ca50e05c717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5515fa5dd2734bd99ed543c2455b118d, user_id=018b11e1436c45978eb09bd48a1c4df3, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:04.103269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86932e50-1a39-4c59-8384-3ca50e05c717 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:04.245528 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1143/2337] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:25:04 2022] PUT /identity/v3/projects/5515fa5dd2734bd99ed543c2455b118d/users/018b11e1436c45978eb09bd48a1c4df3/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:25:04.256038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a2e82-b8ba-4890-b633-0b696845e15e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:04.257147 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a2e82-b8ba-4890-b633-0b696845e15e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:04.257582 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a2e82-b8ba-4890-b633-0b696845e15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:04.289592 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-552a2e82-b8ba-4890-b633-0b696845e15e None None] MFA Rules not processed for user `018b11e1436c45978eb09bd48a1c4df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:04.290816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-552a2e82-b8ba-4890-b633-0b696845e15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:04.357720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1195/2338] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:04.369905 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86932e50-1a39-4c59-8384-3ca50e05c717 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:04.372242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-86932e50-1a39-4c59-8384-3ca50e05c717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:04.430432 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86932e50-1a39-4c59-8384-3ca50e05c717 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:04.434111 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adebe3-aca1-4749-b242-fb46c7089224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:04.434726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adebe3-aca1-4749-b242-fb46c7089224 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:04.435005 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adebe3-aca1-4749-b242-fb46c7089224 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:04.435282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adebe3-aca1-4749-b242-fb46c7089224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:04.443449 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adebe3-aca1-4749-b242-fb46c7089224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:04.444922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adebe3-aca1-4749-b242-fb46c7089224 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:04.454374 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1144/2339] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:25:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:25:04.479303 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a2e82-b8ba-4890-b633-0b696845e15e None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:04.541196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a2e82-b8ba-4890-b633-0b696845e15e None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:04.546087 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cb301-fe01-4bed-b443-c0433da11a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:04.546715 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cb301-fe01-4bed-b443-c0433da11a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:04.546999 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cb301-fe01-4bed-b443-c0433da11a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:04.547302 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cb301-fe01-4bed-b443-c0433da11a90 admin admin] PATH_INFO: `/v3/users/018b11e1436c45978eb09bd48a1c4df3` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:04.548489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9cb301-fe01-4bed-b443-c0433da11a90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=018b11e1436c45978eb09bd48a1c4df3)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:04.550443 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9cb301-fe01-4bed-b443-c0433da11a90 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:04.752835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-db9cb301-fe01-4bed-b443-c0433da11a90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '018b11e1436c45978eb09bd48a1c4df3'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:04.753271 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-db9cb301-fe01-4bed-b443-c0433da11a90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '018b11e1436c45978eb09bd48a1c4df3'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:04.834782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-db9cb301-fe01-4bed-b443-c0433da11a90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '018b11e1436c45978eb09bd48a1c4df3'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:04.850659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-db9cb301-fe01-4bed-b443-c0433da11a90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '018b11e1436c45978eb09bd48a1c4df3'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:04.851334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-db9cb301-fe01-4bed-b443-c0433da11a90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '018b11e1436c45978eb09bd48a1c4df3'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:04.864516 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1196/2340] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:25:04 2022] DELETE /identity/v3/users/018b11e1436c45978eb09bd48a1c4df3 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:25:04.870121 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae2b67-e09f-4fea-8cd3-f7542e2057ee None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:04.870412 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae2b67-e09f-4fea-8cd3-f7542e2057ee None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:04.870717 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae2b67-e09f-4fea-8cd3-f7542e2057ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:04.893193 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-48ae2b67-e09f-4fea-8cd3-f7542e2057ee None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:04.894413 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-48ae2b67-e09f-4fea-8cd3-f7542e2057ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:04.958432 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1145/2341] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:04.969399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cb301-fe01-4bed-b443-c0433da11a90 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:04.971007 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-db9cb301-fe01-4bed-b443-c0433da11a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:05.029618 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cb301-fe01-4bed-b443-c0433da11a90 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:05.033640 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15135bd-812e-4ac9-91d4-ff39278b08d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:05.034261 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15135bd-812e-4ac9-91d4-ff39278b08d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:05.034544 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15135bd-812e-4ac9-91d4-ff39278b08d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:05.034817 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15135bd-812e-4ac9-91d4-ff39278b08d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:05.044822 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15135bd-812e-4ac9-91d4-ff39278b08d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:05.046515 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15135bd-812e-4ac9-91d4-ff39278b08d7 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:05.057585 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1197/2342] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:25:05.753596 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae2b67-e09f-4fea-8cd3-f7542e2057ee None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:05.756815 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-48ae2b67-e09f-4fea-8cd3-f7542e2057ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:05.788690 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae2b67-e09f-4fea-8cd3-f7542e2057ee None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:05.797542 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c9daf-7130-46e1-a350-d9719366cd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:05.799477 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c9daf-7130-46e1-a350-d9719366cd31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:05.800226 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c9daf-7130-46e1-a350-d9719366cd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:05.800226 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c9daf-7130-46e1-a350-d9719366cd31 admin admin] PATH_INFO: `/v3/projects/5515fa5dd2734bd99ed543c2455b118d` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:05.802359 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c9daf-7130-46e1-a350-d9719366cd31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5515fa5dd2734bd99ed543c2455b118d)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:05.804314 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c9daf-7130-46e1-a350-d9719366cd31 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:05.962129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e30c9daf-7130-46e1-a350-d9719366cd31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5515fa5dd2734bd99ed543c2455b118d', 'request_id': 'req-e30c9daf-7130-46e1-a350-d9719366cd31'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:05.969391 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e30c9daf-7130-46e1-a350-d9719366cd31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5515fa5dd2734bd99ed543c2455b118d', 'request_id': 'req-e30c9daf-7130-46e1-a350-d9719366cd31'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:05.977158 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e30c9daf-7130-46e1-a350-d9719366cd31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5515fa5dd2734bd99ed543c2455b118d', 'request_id': 'req-e30c9daf-7130-46e1-a350-d9719366cd31'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:06.082424 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e30c9daf-7130-46e1-a350-d9719366cd31 admin admin] The token cache is being invalidate because project 5515fa5dd2734bd99ed543c2455b118d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:25:06.083278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e30c9daf-7130-46e1-a350-d9719366cd31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:06.083904 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e30c9daf-7130-46e1-a350-d9719366cd31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:06.085562 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1146/2343] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:25:05 2022] DELETE /identity/v3/projects/5515fa5dd2734bd99ed543c2455b118d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:25:06.385904 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:07.243292 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:07.660351 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:08.736541 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:08.866714 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:09.104020 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:09.690568 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:10.149256 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:10.888358 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:11.838207 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:11.922965 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:13.037573 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:13.157117 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:13.571594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:13.714792 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:14.526057 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:14.752507 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:15.665661 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:15.986019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:16.429259 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15135bd-812e-4ac9-91d4-ff39278b08d7 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:16.430668 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a15135bd-812e-4ac9-91d4-ff39278b08d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:16.443589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15135bd-812e-4ac9-91d4-ff39278b08d7 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:16.504633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce61a42-2521-488f-8950-c5d1bd06e26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:16.505370 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce61a42-2521-488f-8950-c5d1bd06e26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:16.505650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce61a42-2521-488f-8950-c5d1bd06e26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:16.505925 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce61a42-2521-488f-8950-c5d1bd06e26d admin admin] PATH_INFO: `/v3/users/67cafe4f77e54be683a56074c5fda71f` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:16.507090 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce61a42-2521-488f-8950-c5d1bd06e26d admin admin] RBAC: Authorizing `identity:delete_user(user_id=67cafe4f77e54be683a56074c5fda71f)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:16.509055 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce61a42-2521-488f-8950-c5d1bd06e26d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:16.597543 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:16.747875 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3ce61a42-2521-488f-8950-c5d1bd06e26d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67cafe4f77e54be683a56074c5fda71f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:16.748995 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3ce61a42-2521-488f-8950-c5d1bd06e26d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67cafe4f77e54be683a56074c5fda71f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:16.828566 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3ce61a42-2521-488f-8950-c5d1bd06e26d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67cafe4f77e54be683a56074c5fda71f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:16.845251 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3ce61a42-2521-488f-8950-c5d1bd06e26d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67cafe4f77e54be683a56074c5fda71f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:16.846067 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3ce61a42-2521-488f-8950-c5d1bd06e26d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67cafe4f77e54be683a56074c5fda71f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:16.860916 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1198/2344] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:25:16 2022] DELETE /identity/v3/users/67cafe4f77e54be683a56074c5fda71f => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:25:16.865610 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7626fd-2c1b-448c-a8e3-067cde16cee2 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:16.866374 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7626fd-2c1b-448c-a8e3-067cde16cee2 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:16.866917 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7626fd-2c1b-448c-a8e3-067cde16cee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:16.907711 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-bd7626fd-2c1b-448c-a8e3-067cde16cee2 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:16.910018 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-bd7626fd-2c1b-448c-a8e3-067cde16cee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:17.026208 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1147/2345] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:17.038668 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce61a42-2521-488f-8950-c5d1bd06e26d admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:17.041148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3ce61a42-2521-488f-8950-c5d1bd06e26d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:17.116368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce61a42-2521-488f-8950-c5d1bd06e26d admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:17.121326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc7ee8-28a8-43af-84a0-19b6a905a9a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:17.122995 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc7ee8-28a8-43af-84a0-19b6a905a9a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:17.123350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc7ee8-28a8-43af-84a0-19b6a905a9a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:17.123695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc7ee8-28a8-43af-84a0-19b6a905a9a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:17.135677 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc7ee8-28a8-43af-84a0-19b6a905a9a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:17.137283 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc7ee8-28a8-43af-84a0-19b6a905a9a3 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:17.148947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1199/2346] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:25:17.192485 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:17.371711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:17.703559 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7626fd-2c1b-448c-a8e3-067cde16cee2 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:17.705493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-bd7626fd-2c1b-448c-a8e3-067cde16cee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:17.720799 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7626fd-2c1b-448c-a8e3-067cde16cee2 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:17.726918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98603720-e430-4f88-b940-25f199da8c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:17.727657 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98603720-e430-4f88-b940-25f199da8c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:17.728004 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98603720-e430-4f88-b940-25f199da8c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:17.728348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98603720-e430-4f88-b940-25f199da8c39 admin admin] PATH_INFO: `/v3/projects/50e4167880df4de19cc8d4862d43b158` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:17.730112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98603720-e430-4f88-b940-25f199da8c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50e4167880df4de19cc8d4862d43b158)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:17.733340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98603720-e430-4f88-b940-25f199da8c39 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:17.957740 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-98603720-e430-4f88-b940-25f199da8c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50e4167880df4de19cc8d4862d43b158', 'request_id': 'req-98603720-e430-4f88-b940-25f199da8c39'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:17.964000 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-98603720-e430-4f88-b940-25f199da8c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50e4167880df4de19cc8d4862d43b158', 'request_id': 'req-98603720-e430-4f88-b940-25f199da8c39'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:17.969571 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-98603720-e430-4f88-b940-25f199da8c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50e4167880df4de19cc8d4862d43b158', 'request_id': 'req-98603720-e430-4f88-b940-25f199da8c39'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:18.043893 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:18.085535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-98603720-e430-4f88-b940-25f199da8c39 admin admin] The token cache is being invalidate because project 50e4167880df4de19cc8d4862d43b158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:25:18.086104 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-98603720-e430-4f88-b940-25f199da8c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:18.086496 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-98603720-e430-4f88-b940-25f199da8c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:18.088312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1148/2347] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:25:17 2022] DELETE /identity/v3/projects/50e4167880df4de19cc8d4862d43b158 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:25:18.093559 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94838128-8794-44fe-83f6-e4f040837d44 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:18.093850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94838128-8794-44fe-83f6-e4f040837d44 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:18.094153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94838128-8794-44fe-83f6-e4f040837d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:18.121561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-94838128-8794-44fe-83f6-e4f040837d44 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:18.122943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-94838128-8794-44fe-83f6-e4f040837d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:18.204649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1200/2348] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:25:18.214463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be554-9bad-433a-957a-56c867f721c8 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:18.214848 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be554-9bad-433a-957a-56c867f721c8 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:18.215228 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be554-9bad-433a-957a-56c867f721c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:18.239319 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d61be554-9bad-433a-957a-56c867f721c8 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:18.240729 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d61be554-9bad-433a-957a-56c867f721c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:18.261246 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94838128-8794-44fe-83f6-e4f040837d44 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:18.271323 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1149/2349] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:18.276391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94838128-8794-44fe-83f6-e4f040837d44 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:18.282275 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9f9ff-35ed-4da7-b7dd-82f6b23f82ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:18.283198 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9f9ff-35ed-4da7-b7dd-82f6b23f82ce admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:18.283578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9f9ff-35ed-4da7-b7dd-82f6b23f82ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:18.283976 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9f9ff-35ed-4da7-b7dd-82f6b23f82ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:18.284929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9f9ff-35ed-4da7-b7dd-82f6b23f82ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:25:18.286359 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9f9ff-35ed-4da7-b7dd-82f6b23f82ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:18.288251 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9f9ff-35ed-4da7-b7dd-82f6b23f82ce admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:18.310766 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61be554-9bad-433a-957a-56c867f721c8 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:18.310985 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1201/2350] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:25:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:25:18.321293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61be554-9bad-433a-957a-56c867f721c8 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:18.326290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f335645-864d-464b-8a6f-66ac3f45bcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:18.326915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f335645-864d-464b-8a6f-66ac3f45bcda admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:18.327199 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f335645-864d-464b-8a6f-66ac3f45bcda admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:18.327479 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f335645-864d-464b-8a6f-66ac3f45bcda admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:18.328284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f335645-864d-464b-8a6f-66ac3f45bcda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:18.330348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f335645-864d-464b-8a6f-66ac3f45bcda admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:18.455990 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1150/2351] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:25:18 2022] POST /identity/v3/projects => generated 386 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:25:18.462393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9f9ff-35ed-4da7-b7dd-82f6b23f82ce admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:18.472939 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9f9ff-35ed-4da7-b7dd-82f6b23f82ce admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:18.533859 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d0df3-782f-4df6-81c5-81ab8a38e685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:18.534505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d0df3-782f-4df6-81c5-81ab8a38e685 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:18.534783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d0df3-782f-4df6-81c5-81ab8a38e685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:18.535087 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d0df3-782f-4df6-81c5-81ab8a38e685 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:18.535742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d0df3-782f-4df6-81c5-81ab8a38e685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:18.537694 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d0df3-782f-4df6-81c5-81ab8a38e685 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:18.656574 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1202/2352] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:25:18 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:25:18.660300 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f335645-864d-464b-8a6f-66ac3f45bcda admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:18.673469 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f335645-864d-464b-8a6f-66ac3f45bcda admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:18.678947 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307f3f1-3465-4fbd-b147-86696c173bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:18.679545 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307f3f1-3465-4fbd-b147-86696c173bce admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:18.679829 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307f3f1-3465-4fbd-b147-86696c173bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:18.680103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307f3f1-3465-4fbd-b147-86696c173bce admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:18.680849 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307f3f1-3465-4fbd-b147-86696c173bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:18.682545 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307f3f1-3465-4fbd-b147-86696c173bce admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:18.694038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1151/2353] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:25:18 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:25:18.699787 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d0df3-782f-4df6-81c5-81ab8a38e685 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:18.710726 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d0df3-782f-4df6-81c5-81ab8a38e685 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:18.715965 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac989571-2098-4e44-a7c2-2ca380779493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:18.716877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac989571-2098-4e44-a7c2-2ca380779493 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:18.717277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac989571-2098-4e44-a7c2-2ca380779493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:18.717562 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac989571-2098-4e44-a7c2-2ca380779493 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:18.718267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac989571-2098-4e44-a7c2-2ca380779493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:18.719875 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac989571-2098-4e44-a7c2-2ca380779493 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:18.731395 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1203/2354] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:25:18 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:25:18.735840 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307f3f1-3465-4fbd-b147-86696c173bce admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:18.747649 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307f3f1-3465-4fbd-b147-86696c173bce admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:18.753239 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1140717-8754-40d4-bb92-01d53ec3a249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:18.754452 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1140717-8754-40d4-bb92-01d53ec3a249 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:18.754752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1140717-8754-40d4-bb92-01d53ec3a249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:18.755028 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1140717-8754-40d4-bb92-01d53ec3a249 admin admin] PATH_INFO: `/v3/projects/ee5227e391644b448e93ca5a2c411cb2/users/00aa32a5a3b34289886cb210a6e28793/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:18.772568 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1140717-8754-40d4-bb92-01d53ec3a249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5227e391644b448e93ca5a2c411cb2, user_id=00aa32a5a3b34289886cb210a6e28793, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:18.775446 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1140717-8754-40d4-bb92-01d53ec3a249 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:18.849216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:18.868249 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1152/2355] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:25:18 2022] PUT /identity/v3/projects/ee5227e391644b448e93ca5a2c411cb2/users/00aa32a5a3b34289886cb210a6e28793/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:25:18.870424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d7d67-4700-4c48-9230-fe661265a9cb None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:18.870956 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d7d67-4700-4c48-9230-fe661265a9cb None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:18.871249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d7d67-4700-4c48-9230-fe661265a9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:18.900284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-145d7d67-4700-4c48-9230-fe661265a9cb None None] MFA Rules not processed for user `00aa32a5a3b34289886cb210a6e28793`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:18.901734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-145d7d67-4700-4c48-9230-fe661265a9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:18.984472 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1204/2356] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:25:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:18.994818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53aa9e-ecf9-4cf6-865a-4e03545ae6f5 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:18.995109 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53aa9e-ecf9-4cf6-865a-4e03545ae6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:18.995478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53aa9e-ecf9-4cf6-865a-4e03545ae6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:18.999627 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d7d67-4700-4c48-9230-fe661265a9cb None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:19.001130 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-145d7d67-4700-4c48-9230-fe661265a9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:19.015727 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-bc53aa9e-ecf9-4cf6-865a-4e03545ae6f5 None None] MFA Rules not processed for user `b867401639e74527adb079981496b19f`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:19.017125 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-bc53aa9e-ecf9-4cf6-865a-4e03545ae6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:19.063194 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d7d67-4700-4c48-9230-fe661265a9cb None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:19.067921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa8072-f437-488f-bf45-5c5767e5c7de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:19.068567 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa8072-f437-488f-bf45-5c5767e5c7de service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:19.068960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa8072-f437-488f-bf45-5c5767e5c7de service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:19.069236 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa8072-f437-488f-bf45-5c5767e5c7de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:19.079114 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa8072-f437-488f-bf45-5c5767e5c7de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:19.080595 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa8072-f437-488f-bf45-5c5767e5c7de service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:19.080940 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1153/2357] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:25:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:19.090141 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1205/2358] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:25:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:25:19.212336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:20.894538 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:20.981845 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:22.781851 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:22.809730 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53aa9e-ecf9-4cf6-865a-4e03545ae6f5 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:22.888100 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53aa9e-ecf9-4cf6-865a-4e03545ae6f5 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:22.890077 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:22.895591 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ef1d7-755e-471d-945d-f5f26fd4f13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:22.896403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ef1d7-755e-471d-945d-f5f26fd4f13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:22.898339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ef1d7-755e-471d-945d-f5f26fd4f13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:22.898339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ef1d7-755e-471d-945d-f5f26fd4f13d admin admin] PATH_INFO: `/v3/users/00aa32a5a3b34289886cb210a6e28793` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:22.899074 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ef1d7-755e-471d-945d-f5f26fd4f13d admin admin] RBAC: Authorizing `identity:delete_user(user_id=00aa32a5a3b34289886cb210a6e28793)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:22.901960 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ef1d7-755e-471d-945d-f5f26fd4f13d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:23.108561 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ed4ef1d7-755e-471d-945d-f5f26fd4f13d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00aa32a5a3b34289886cb210a6e28793'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:23.109252 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ed4ef1d7-755e-471d-945d-f5f26fd4f13d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00aa32a5a3b34289886cb210a6e28793'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:23.121278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ed4ef1d7-755e-471d-945d-f5f26fd4f13d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00aa32a5a3b34289886cb210a6e28793'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:23.127946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ed4ef1d7-755e-471d-945d-f5f26fd4f13d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00aa32a5a3b34289886cb210a6e28793'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:23.258741 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:23.317796 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ed4ef1d7-755e-471d-945d-f5f26fd4f13d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00aa32a5a3b34289886cb210a6e28793'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:23.324452 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1154/2359] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:25:22 2022] DELETE /identity/v3/users/00aa32a5a3b34289886cb210a6e28793 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:25:23.329075 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2f47c-1aca-414f-bcf3-d7fb5b6a3401 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:23.329365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2f47c-1aca-414f-bcf3-d7fb5b6a3401 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:23.329679 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2f47c-1aca-414f-bcf3-d7fb5b6a3401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:23.353347 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-9da2f47c-1aca-414f-bcf3-d7fb5b6a3401 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:23.354648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9da2f47c-1aca-414f-bcf3-d7fb5b6a3401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:23.453074 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1206/2360] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:23.464099 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ef1d7-755e-471d-945d-f5f26fd4f13d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:23.464333 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ed4ef1d7-755e-471d-945d-f5f26fd4f13d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:23.546839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ef1d7-755e-471d-945d-f5f26fd4f13d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:23.552433 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e1677-4740-4d10-8a3e-346fa94bcb4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:23.555780 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e1677-4740-4d10-8a3e-346fa94bcb4b service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:23.555780 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e1677-4740-4d10-8a3e-346fa94bcb4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:23.555780 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e1677-4740-4d10-8a3e-346fa94bcb4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:23.582207 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e1677-4740-4d10-8a3e-346fa94bcb4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:23.587399 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e1677-4740-4d10-8a3e-346fa94bcb4b service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:23.616412 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1155/2361] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:25:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:25:23.846768 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:24.106467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:24.317882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2f47c-1aca-414f-bcf3-d7fb5b6a3401 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:24.321291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9da2f47c-1aca-414f-bcf3-d7fb5b6a3401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:24.353096 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2f47c-1aca-414f-bcf3-d7fb5b6a3401 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:24.365860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ad0c0-2d7a-443c-9670-188e554f6dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:24.366545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ad0c0-2d7a-443c-9670-188e554f6dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:24.366804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ad0c0-2d7a-443c-9670-188e554f6dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:24.367244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ad0c0-2d7a-443c-9670-188e554f6dae admin admin] PATH_INFO: `/v3/projects/ee5227e391644b448e93ca5a2c411cb2` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:24.369247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ad0c0-2d7a-443c-9670-188e554f6dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee5227e391644b448e93ca5a2c411cb2)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:24.371999 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ad0c0-2d7a-443c-9670-188e554f6dae admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:24.505880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-096ad0c0-2d7a-443c-9670-188e554f6dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee5227e391644b448e93ca5a2c411cb2', 'request_id': 'req-096ad0c0-2d7a-443c-9670-188e554f6dae'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:24.512067 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-096ad0c0-2d7a-443c-9670-188e554f6dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee5227e391644b448e93ca5a2c411cb2', 'request_id': 'req-096ad0c0-2d7a-443c-9670-188e554f6dae'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:24.518041 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-096ad0c0-2d7a-443c-9670-188e554f6dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee5227e391644b448e93ca5a2c411cb2', 'request_id': 'req-096ad0c0-2d7a-443c-9670-188e554f6dae'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:24.606446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-096ad0c0-2d7a-443c-9670-188e554f6dae admin admin] The token cache is being invalidate because project ee5227e391644b448e93ca5a2c411cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:25:24.607135 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-096ad0c0-2d7a-443c-9670-188e554f6dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:24.608000 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-096ad0c0-2d7a-443c-9670-188e554f6dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:24.609954 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1207/2362] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:25:24 2022] DELETE /identity/v3/projects/ee5227e391644b448e93ca5a2c411cb2 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:25:24.615087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd51e1-5aeb-4e69-9369-3d1ebf116cf0 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:24.615591 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd51e1-5aeb-4e69-9369-3d1ebf116cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:24.616024 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd51e1-5aeb-4e69-9369-3d1ebf116cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:24.636406 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-80bd51e1-5aeb-4e69-9369-3d1ebf116cf0 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:24.637710 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-80bd51e1-5aeb-4e69-9369-3d1ebf116cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:24.700111 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1156/2363] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:25:24.708774 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6406988-d172-447f-b783-f85a414301c6 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:24.718509 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6406988-d172-447f-b783-f85a414301c6 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:24.718509 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6406988-d172-447f-b783-f85a414301c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:24.730783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d6406988-d172-447f-b783-f85a414301c6 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:24.732092 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d6406988-d172-447f-b783-f85a414301c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:24.740878 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1208/2364] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:24.744869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd51e1-5aeb-4e69-9369-3d1ebf116cf0 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:24.755346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd51e1-5aeb-4e69-9369-3d1ebf116cf0 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:24.761162 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abfaee-538e-4292-81e5-ef28198d8883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:24.761162 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abfaee-538e-4292-81e5-ef28198d8883 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:24.761162 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abfaee-538e-4292-81e5-ef28198d8883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:24.761503 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abfaee-538e-4292-81e5-ef28198d8883 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:24.762328 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abfaee-538e-4292-81e5-ef28198d8883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:25:24.762452 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abfaee-538e-4292-81e5-ef28198d8883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:24.764985 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abfaee-538e-4292-81e5-ef28198d8883 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:24.779099 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:24.781744 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1157/2365] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:25:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:25:24.786291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6406988-d172-447f-b783-f85a414301c6 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:24.799050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6406988-d172-447f-b783-f85a414301c6 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:24.818347 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f53e17-4c5d-4e9b-bbf1-6a4492c48acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:24.818986 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f53e17-4c5d-4e9b-bbf1-6a4492c48acd admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:24.819269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f53e17-4c5d-4e9b-bbf1-6a4492c48acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:24.819542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f53e17-4c5d-4e9b-bbf1-6a4492c48acd admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:24.820222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f53e17-4c5d-4e9b-bbf1-6a4492c48acd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:24.822297 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f53e17-4c5d-4e9b-bbf1-6a4492c48acd admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:24.928255 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:24.946573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1209/2366] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:25:24 2022] POST /identity/v3/projects => generated 390 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:25:24.950748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abfaee-538e-4292-81e5-ef28198d8883 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:24.961379 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abfaee-538e-4292-81e5-ef28198d8883 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:25.024869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa64add-0e1a-4008-8d0b-79b65b163c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:25.026306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa64add-0e1a-4008-8d0b-79b65b163c0c admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:25.026306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa64add-0e1a-4008-8d0b-79b65b163c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:25.026306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa64add-0e1a-4008-8d0b-79b65b163c0c admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:25.027178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa64add-0e1a-4008-8d0b-79b65b163c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:25.028686 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa64add-0e1a-4008-8d0b-79b65b163c0c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:25.116493 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee5daf-e0a7-4011-ad92-fc39be9dcc85 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:25.121536 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee5daf-e0a7-4011-ad92-fc39be9dcc85 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:25.121536 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee5daf-e0a7-4011-ad92-fc39be9dcc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:25.137363 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-81ee5daf-e0a7-4011-ad92-fc39be9dcc85 None None] MFA Rules not processed for user `02af03095e48472d96a995a530e78035`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:25.138660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-81ee5daf-e0a7-4011-ad92-fc39be9dcc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:25.151045 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1158/2367] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:25:24 2022] POST /identity/v3/users => generated 296 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:25:25.153436 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa64add-0e1a-4008-8d0b-79b65b163c0c admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:25.164028 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa64add-0e1a-4008-8d0b-79b65b163c0c admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:25.170737 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8876a-8ceb-4a13-aefb-11dadb3d87ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:25.171375 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8876a-8ceb-4a13-aefb-11dadb3d87ec admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:25.171717 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8876a-8ceb-4a13-aefb-11dadb3d87ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:25.171996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8876a-8ceb-4a13-aefb-11dadb3d87ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:25.172769 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8876a-8ceb-4a13-aefb-11dadb3d87ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:25.174382 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8876a-8ceb-4a13-aefb-11dadb3d87ec admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:25.192390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1159/2368] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:25:25 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:25:25.193835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8876a-8ceb-4a13-aefb-11dadb3d87ec admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:25.207771 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8876a-8ceb-4a13-aefb-11dadb3d87ec admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:25.214450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed65c3-184d-4c9b-adc5-1bf1f098f6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:25.215154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed65c3-184d-4c9b-adc5-1bf1f098f6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:25.215509 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed65c3-184d-4c9b-adc5-1bf1f098f6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:25.215854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed65c3-184d-4c9b-adc5-1bf1f098f6f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:25.216813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed65c3-184d-4c9b-adc5-1bf1f098f6f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:25.233416 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed65c3-184d-4c9b-adc5-1bf1f098f6f2 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:25.233703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1210/2369] 10.222.0.141 () {58 vars in 1014 bytes} [Tue Jul 26 16:25:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:25:25.233792 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1160/2370] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:25:25 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:25:25.236409 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee5daf-e0a7-4011-ad92-fc39be9dcc85 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:25.257358 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee5daf-e0a7-4011-ad92-fc39be9dcc85 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:25.269290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa83ba0-7cd0-4f3c-86f0-c606422c369d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:25.272768 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa83ba0-7cd0-4f3c-86f0-c606422c369d admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:25.273066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa83ba0-7cd0-4f3c-86f0-c606422c369d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:25.273353 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa83ba0-7cd0-4f3c-86f0-c606422c369d admin admin] PATH_INFO: `/v3/projects/478b857d8be5465cb9b1bd1f8fcbc17d/users/4d323af44503493e857263611f787d58/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:25.296588 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa83ba0-7cd0-4f3c-86f0-c606422c369d admin admin] RBAC: Authorizing `identity:create_grant(project_id=478b857d8be5465cb9b1bd1f8fcbc17d, user_id=4d323af44503493e857263611f787d58, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:25.297161 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed65c3-184d-4c9b-adc5-1bf1f098f6f2 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:25.298377 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa83ba0-7cd0-4f3c-86f0-c606422c369d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:25.299122 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-01ed65c3-184d-4c9b-adc5-1bf1f098f6f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:25.412493 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1211/2371] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:25:25 2022] PUT /identity/v3/projects/478b857d8be5465cb9b1bd1f8fcbc17d/users/4d323af44503493e857263611f787d58/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:25:25.428575 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748bcdd-3c58-4bd0-b6b3-a7734a36dd94 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:25.429251 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748bcdd-3c58-4bd0-b6b3-a7734a36dd94 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:25.429713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748bcdd-3c58-4bd0-b6b3-a7734a36dd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:25.528025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-9748bcdd-3c58-4bd0-b6b3-a7734a36dd94 None None] MFA Rules not processed for user `4d323af44503493e857263611f787d58`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:25.530723 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9748bcdd-3c58-4bd0-b6b3-a7734a36dd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:25.589475 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed65c3-184d-4c9b-adc5-1bf1f098f6f2 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:25.660969 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1212/2372] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:25:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:25.685794 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12cf6c-da55-4772-8573-a5a6de5dc52f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c5f92f21868436a99a5c7aaa1fc40b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:25.686735 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12cf6c-da55-4772-8573-a5a6de5dc52f service swift] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:25.687216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12cf6c-da55-4772-8573-a5a6de5dc52f service swift] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:25.687704 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12cf6c-da55-4772-8573-a5a6de5dc52f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:25.752821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12cf6c-da55-4772-8573-a5a6de5dc52f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:25.755004 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12cf6c-da55-4772-8573-a5a6de5dc52f service swift] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:25.770806 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:25.772193 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1161/2373] 10.222.0.141 () {60 vars in 1389 bytes} [Tue Jul 26 16:25:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 16:25:26.012622 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748bcdd-3c58-4bd0-b6b3-a7734a36dd94 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:26.014379 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9748bcdd-3c58-4bd0-b6b3-a7734a36dd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:26.108691 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748bcdd-3c58-4bd0-b6b3-a7734a36dd94 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:26.118538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1d9c4-b29c-4734-bd2a-ffea9f938019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:26.118538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1d9c4-b29c-4734-bd2a-ffea9f938019 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:26.118538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1d9c4-b29c-4734-bd2a-ffea9f938019 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:26.118538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1d9c4-b29c-4734-bd2a-ffea9f938019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:26.129499 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1d9c4-b29c-4734-bd2a-ffea9f938019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:26.131814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1d9c4-b29c-4734-bd2a-ffea9f938019 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:26.164740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1213/2374] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:25:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:25:26.167275 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:27.038414 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:27.273130 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12cf6c-da55-4772-8573-a5a6de5dc52f service swift] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:27.274222 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0b12cf6c-da55-4772-8573-a5a6de5dc52f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:27.314990 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12cf6c-da55-4772-8573-a5a6de5dc52f service swift] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:27.327570 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427a361-5c9c-4303-9a8f-2eff1005a75d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:27.328238 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427a361-5c9c-4303-9a8f-2eff1005a75d service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:27.328724 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427a361-5c9c-4303-9a8f-2eff1005a75d service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:27.329017 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427a361-5c9c-4303-9a8f-2eff1005a75d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:27.333259 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0427a361-5c9c-4303-9a8f-2eff1005a75d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:27.568043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427a361-5c9c-4303-9a8f-2eff1005a75d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:27.585773 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427a361-5c9c-4303-9a8f-2eff1005a75d service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:27.622700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1162/2375] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:25:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:25:27.946726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:28.400301 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:28.654790 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:28.863619 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:29.259045 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:29.989712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:30.414654 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:31.427186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:31.864221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:33.691683 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:33.767490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:34.208460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:34.231651 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:34.346897 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:34.955478 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:35.728743 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:35.886469 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:36.745897 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:37.432500 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:38.369433 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:38.577984 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dd432-420b-4fef-8375-ca860f20f08d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:38.578266 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dd432-420b-4fef-8375-ca860f20f08d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:38.578548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dd432-420b-4fef-8375-ca860f20f08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:38.598582 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6c8dd432-420b-4fef-8375-ca860f20f08d None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:38.600337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6c8dd432-420b-4fef-8375-ca860f20f08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:38.673348 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1214/2376] 10.222.0.39 () {58 vars in 1020 bytes} [Tue Jul 26 16:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:38.691524 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427a361-5c9c-4303-9a8f-2eff1005a75d service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:38.693123 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0427a361-5c9c-4303-9a8f-2eff1005a75d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:38.772574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427a361-5c9c-4303-9a8f-2eff1005a75d service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:38.778104 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b71dae-9f24-4aa7-8265-7079dca8c316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:38.779471 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b71dae-9f24-4aa7-8265-7079dca8c316 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:38.779749 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b71dae-9f24-4aa7-8265-7079dca8c316 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:38.780023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b71dae-9f24-4aa7-8265-7079dca8c316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:38.790935 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b71dae-9f24-4aa7-8265-7079dca8c316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:38.791698 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b71dae-9f24-4aa7-8265-7079dca8c316 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:38.804267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1163/2377] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:25:38.884351 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:39.028823 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:39.260174 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:39.331643 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:39.457475 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65a7b2-fdb4-4884-9c56-3b32d1c2d984 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:39.457959 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65a7b2-fdb4-4884-9c56-3b32d1c2d984 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:39.458050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65a7b2-fdb4-4884-9c56-3b32d1c2d984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:39.477568 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-3e65a7b2-fdb4-4884-9c56-3b32d1c2d984 None None] MFA Rules not processed for user `02af03095e48472d96a995a530e78035`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:39.480801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3e65a7b2-fdb4-4884-9c56-3b32d1c2d984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:39.486411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1215/2378] 10.222.0.141 () {58 vars in 1014 bytes} [Tue Jul 26 16:25:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:39.499895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b71dae-9f24-4aa7-8265-7079dca8c316 service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:39.513612 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b71dae-9f24-4aa7-8265-7079dca8c316 service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:39.519178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89d641-1151-44c0-8e01-4f19a56c9613 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c5f92f21868436a99a5c7aaa1fc40b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:39.519801 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89d641-1151-44c0-8e01-4f19a56c9613 service swift] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:39.520077 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89d641-1151-44c0-8e01-4f19a56c9613 service swift] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:39.520352 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89d641-1151-44c0-8e01-4f19a56c9613 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:39.529626 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89d641-1151-44c0-8e01-4f19a56c9613 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:39.536443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89d641-1151-44c0-8e01-4f19a56c9613 service swift] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:39.541016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1164/2379] 10.222.0.141 () {60 vars in 1389 bytes} [Tue Jul 26 16:25:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 16:25:39.743862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:39.886495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:40.074634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65a7b2-fdb4-4884-9c56-3b32d1c2d984 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:40.091625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65a7b2-fdb4-4884-9c56-3b32d1c2d984 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:40.102814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64367f02-517f-429d-a12a-aec913f04306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:40.105982 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64367f02-517f-429d-a12a-aec913f04306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:40.105982 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64367f02-517f-429d-a12a-aec913f04306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:40.105982 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64367f02-517f-429d-a12a-aec913f04306 admin admin] PATH_INFO: `/v3/users/4d323af44503493e857263611f787d58` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:40.109070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64367f02-517f-429d-a12a-aec913f04306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d323af44503493e857263611f787d58)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:40.112902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64367f02-517f-429d-a12a-aec913f04306 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:40.389476 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:40.401541 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-64367f02-517f-429d-a12a-aec913f04306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d323af44503493e857263611f787d58'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:40.402218 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-64367f02-517f-429d-a12a-aec913f04306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d323af44503493e857263611f787d58'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:40.491428 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-64367f02-517f-429d-a12a-aec913f04306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d323af44503493e857263611f787d58'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:40.508389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-64367f02-517f-429d-a12a-aec913f04306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d323af44503493e857263611f787d58'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:40.509737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-64367f02-517f-429d-a12a-aec913f04306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d323af44503493e857263611f787d58'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:40.528819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1216/2380] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:25:40 2022] DELETE /identity/v3/users/4d323af44503493e857263611f787d58 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:25:40.533110 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d8903-c395-4392-8b4b-09de47b0e6b0 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:40.533700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d8903-c395-4392-8b4b-09de47b0e6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:40.534184 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d8903-c395-4392-8b4b-09de47b0e6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:40.557368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-dd4d8903-c395-4392-8b4b-09de47b0e6b0 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:40.560591 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-dd4d8903-c395-4392-8b4b-09de47b0e6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:40.618407 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:40.628968 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1165/2381] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:40.641929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64367f02-517f-429d-a12a-aec913f04306 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:40.644445 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-64367f02-517f-429d-a12a-aec913f04306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:40.705994 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:40.711890 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64367f02-517f-429d-a12a-aec913f04306 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:40.716717 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2db9d-6c96-4a64-b922-03b13eec7c76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:40.717545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2db9d-6c96-4a64-b922-03b13eec7c76 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:40.718151 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2db9d-6c96-4a64-b922-03b13eec7c76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:40.718765 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2db9d-6c96-4a64-b922-03b13eec7c76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:40.729253 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2db9d-6c96-4a64-b922-03b13eec7c76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:40.730783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2db9d-6c96-4a64-b922-03b13eec7c76 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:40.741114 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1217/2382] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:25:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:25:41.145550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:41.189204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:41.520921 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d8903-c395-4392-8b4b-09de47b0e6b0 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:41.523440 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-dd4d8903-c395-4392-8b4b-09de47b0e6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:41.555555 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:41.562206 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d8903-c395-4392-8b4b-09de47b0e6b0 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:41.570347 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62b791-91be-489f-b08b-94c9b9fb9c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:41.571351 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62b791-91be-489f-b08b-94c9b9fb9c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:41.572074 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62b791-91be-489f-b08b-94c9b9fb9c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:41.572649 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62b791-91be-489f-b08b-94c9b9fb9c1b admin admin] PATH_INFO: `/v3/projects/478b857d8be5465cb9b1bd1f8fcbc17d` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:41.574097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62b791-91be-489f-b08b-94c9b9fb9c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=478b857d8be5465cb9b1bd1f8fcbc17d)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:41.577898 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62b791-91be-489f-b08b-94c9b9fb9c1b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:41.628920 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:41.695986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2b62b791-91be-489f-b08b-94c9b9fb9c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '478b857d8be5465cb9b1bd1f8fcbc17d', 'request_id': 'req-2b62b791-91be-489f-b08b-94c9b9fb9c1b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:41.705074 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2b62b791-91be-489f-b08b-94c9b9fb9c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '478b857d8be5465cb9b1bd1f8fcbc17d', 'request_id': 'req-2b62b791-91be-489f-b08b-94c9b9fb9c1b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:41.714108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2b62b791-91be-489f-b08b-94c9b9fb9c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '478b857d8be5465cb9b1bd1f8fcbc17d', 'request_id': 'req-2b62b791-91be-489f-b08b-94c9b9fb9c1b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:41.798523 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2b62b791-91be-489f-b08b-94c9b9fb9c1b admin admin] The token cache is being invalidate because project 478b857d8be5465cb9b1bd1f8fcbc17d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:25:41.799109 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2b62b791-91be-489f-b08b-94c9b9fb9c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:41.805220 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2b62b791-91be-489f-b08b-94c9b9fb9c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:41.805220 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1166/2383] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:25:41 2022] DELETE /identity/v3/projects/478b857d8be5465cb9b1bd1f8fcbc17d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:25:41.878965 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:41.970027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:42.289674 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:42.448870 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:42.497774 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:42.659423 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:42.685780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:42.853498 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:42.885659 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:43.346334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:43.453090 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:43.813251 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:44.549769 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:44.715333 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:45.222199 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b508df1-a3be-43f2-aaed-4f1281dfdb55 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:45.222867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b508df1-a3be-43f2-aaed-4f1281dfdb55 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:45.223087 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b508df1-a3be-43f2-aaed-4f1281dfdb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:45.260973 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-3b508df1-a3be-43f2-aaed-4f1281dfdb55 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:45.262615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3b508df1-a3be-43f2-aaed-4f1281dfdb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:45.353772 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1218/2384] 10.222.0.39 () {58 vars in 1020 bytes} [Tue Jul 26 16:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:25:45.374939 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62b791-91be-489f-b08b-94c9b9fb9c1b admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:45.376752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2b62b791-91be-489f-b08b-94c9b9fb9c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:45.484565 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62b791-91be-489f-b08b-94c9b9fb9c1b admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:45.491924 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d32fad-1cfd-4691-b81d-4318c834e944 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:45.493317 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d32fad-1cfd-4691-b81d-4318c834e944 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:45.493708 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d32fad-1cfd-4691-b81d-4318c834e944 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:45.494074 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d32fad-1cfd-4691-b81d-4318c834e944 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:45.504470 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d32fad-1cfd-4691-b81d-4318c834e944 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:45.506747 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d32fad-1cfd-4691-b81d-4318c834e944 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:45.518507 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1167/2385] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:25:45.597776 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:45.915211 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:46.108678 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:46.282908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:46.499821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:47.527204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98735bb-a9c0-4153-98bf-fd43757bcd79 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:47.527799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98735bb-a9c0-4153-98bf-fd43757bcd79 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:47.527799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98735bb-a9c0-4153-98bf-fd43757bcd79 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:47.529130 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1219/2386] 10.222.0.141 () {54 vars in 926 bytes} [Tue Jul 26 16:25:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:25:47.536085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1610da2-81fe-4bc0-9fb1-f8e7b38bd271 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:47.536533 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1610da2-81fe-4bc0-9fb1-f8e7b38bd271 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:47.536900 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1610da2-81fe-4bc0-9fb1-f8e7b38bd271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:47.560985 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b1610da2-81fe-4bc0-9fb1-f8e7b38bd271 None None] MFA Rules not processed for user `f7eac931cabf4921b6dbd42f63b9300f`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:47.563022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b1610da2-81fe-4bc0-9fb1-f8e7b38bd271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:47.575715 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1168/2387] 10.222.0.141 () {58 vars in 1023 bytes} [Tue Jul 26 16:25:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:47.591858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98735bb-a9c0-4153-98bf-fd43757bcd79 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:47.596139 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a98735bb-a9c0-4153-98bf-fd43757bcd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:47.683318 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:47.697450 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98735bb-a9c0-4153-98bf-fd43757bcd79 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:47.702095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607dd27-e3e8-4633-8fe4-e6c223307ece service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d25aebc2bbc47b5adb7200275c98d90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:47.707912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607dd27-e3e8-4633-8fe4-e6c223307ece service glance] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:47.707912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607dd27-e3e8-4633-8fe4-e6c223307ece service glance] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:47.707912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607dd27-e3e8-4633-8fe4-e6c223307ece service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:47.735681 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607dd27-e3e8-4633-8fe4-e6c223307ece service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:47.742006 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607dd27-e3e8-4633-8fe4-e6c223307ece service glance] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:47.753438 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1220/2388] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:25:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:25:48.011846 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347dd02-f2a6-4fa3-991d-cd106d2a88d2 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:48.013300 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347dd02-f2a6-4fa3-991d-cd106d2a88d2 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:48.013844 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347dd02-f2a6-4fa3-991d-cd106d2a88d2 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:48.015836 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1169/2389] 10.222.0.141 () {54 vars in 926 bytes} [Tue Jul 26 16:25:48 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:25:48.021936 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97f634-ec74-4bc9-b4c5-0c96c63aeca5 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:48.022218 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97f634-ec74-4bc9-b4c5-0c96c63aeca5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:48.022699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97f634-ec74-4bc9-b4c5-0c96c63aeca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:48.045028 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-4f97f634-ec74-4bc9-b4c5-0c96c63aeca5 None None] MFA Rules not processed for user `d1a99faad91b4357973f4bbb6632c724`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:48.046258 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4f97f634-ec74-4bc9-b4c5-0c96c63aeca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:48.119570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1221/2390] 10.222.0.141 () {58 vars in 1023 bytes} [Tue Jul 26 16:25:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:48.134863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347dd02-f2a6-4fa3-991d-cd106d2a88d2 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:48.136223 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2347dd02-f2a6-4fa3-991d-cd106d2a88d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:48.156234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347dd02-f2a6-4fa3-991d-cd106d2a88d2 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:48.160066 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01733a1-b7d8-4c46-af19-a790dc1fe028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:48.160709 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01733a1-b7d8-4c46-af19-a790dc1fe028 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:48.161093 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01733a1-b7d8-4c46-af19-a790dc1fe028 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:48.161365 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01733a1-b7d8-4c46-af19-a790dc1fe028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:48.171055 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01733a1-b7d8-4c46-af19-a790dc1fe028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:48.172697 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01733a1-b7d8-4c46-af19-a790dc1fe028 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:48.181452 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1170/2391] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:25:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:25:48.280538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f40325-b6a0-4c69-9218-7248c5d2887b None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:48.280959 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f40325-b6a0-4c69-9218-7248c5d2887b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:48.285360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f40325-b6a0-4c69-9218-7248c5d2887b None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:48.285360 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1222/2392] 10.222.0.141 () {54 vars in 926 bytes} [Tue Jul 26 16:25:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:25:48.290731 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cbc1b-5ed4-4860-bce3-0ac4db60cf73 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:48.291115 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cbc1b-5ed4-4860-bce3-0ac4db60cf73 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:48.291457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cbc1b-5ed4-4860-bce3-0ac4db60cf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:48.319748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-4b5cbc1b-5ed4-4860-bce3-0ac4db60cf73 None None] MFA Rules not processed for user `f7eac931cabf4921b6dbd42f63b9300f`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:48.321540 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4b5cbc1b-5ed4-4860-bce3-0ac4db60cf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:48.333358 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1171/2393] 10.222.0.141 () {58 vars in 1023 bytes} [Tue Jul 26 16:25:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:48.345671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f40325-b6a0-4c69-9218-7248c5d2887b None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:48.347677 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-85f40325-b6a0-4c69-9218-7248c5d2887b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:48.365979 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f40325-b6a0-4c69-9218-7248c5d2887b None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:48.370880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa56810-efed-49f2-94b1-34188f070624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:48.371914 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa56810-efed-49f2-94b1-34188f070624 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:48.372365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa56810-efed-49f2-94b1-34188f070624 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:48.372876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa56810-efed-49f2-94b1-34188f070624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:48.385811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa56810-efed-49f2-94b1-34188f070624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:48.387463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa56810-efed-49f2-94b1-34188f070624 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:48.400070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1223/2394] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:25:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:25:51.163746 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58752d34-e355-41d0-88d8-c85d026c8546 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:51.164771 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58752d34-e355-41d0-88d8-c85d026c8546 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:51.165341 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58752d34-e355-41d0-88d8-c85d026c8546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:51.175531 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:51.190121 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-58752d34-e355-41d0-88d8-c85d026c8546 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:51.191702 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-58752d34-e355-41d0-88d8-c85d026c8546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:51.202220 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1172/2395] 10.222.0.39 () {58 vars in 1020 bytes} [Tue Jul 26 16:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:51.218547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa56810-efed-49f2-94b1-34188f070624 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:51.232200 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa56810-efed-49f2-94b1-34188f070624 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:51.238915 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e12915-a2d2-4d00-b649-ea4371779dc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:51.240453 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e12915-a2d2-4d00-b649-ea4371779dc4 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:51.240982 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e12915-a2d2-4d00-b649-ea4371779dc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:51.241464 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e12915-a2d2-4d00-b649-ea4371779dc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:51.252854 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e12915-a2d2-4d00-b649-ea4371779dc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:51.254964 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e12915-a2d2-4d00-b649-ea4371779dc4 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:51.270486 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1224/2396] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:25:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:25:53.912313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68125663-48f9-4ec5-a92b-04950bcc0636 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:53.912849 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68125663-48f9-4ec5-a92b-04950bcc0636 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:53.912947 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68125663-48f9-4ec5-a92b-04950bcc0636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:53.938194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-68125663-48f9-4ec5-a92b-04950bcc0636 None None] MFA Rules not processed for user `02af03095e48472d96a995a530e78035`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:53.939835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-68125663-48f9-4ec5-a92b-04950bcc0636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:54.021590 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1173/2397] 10.222.0.141 () {58 vars in 1014 bytes} [Tue Jul 26 16:25:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:54.041144 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e12915-a2d2-4d00-b649-ea4371779dc4 service nova] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:54.042690 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c4e12915-a2d2-4d00-b649-ea4371779dc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:54.121168 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e12915-a2d2-4d00-b649-ea4371779dc4 service nova] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:54.126881 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5236a-b606-4425-9fb0-58228e47c2ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c5f92f21868436a99a5c7aaa1fc40b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:54.127867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5236a-b606-4425-9fb0-58228e47c2ee service swift] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:54.128367 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5236a-b606-4425-9fb0-58228e47c2ee service swift] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:54.128548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5236a-b606-4425-9fb0-58228e47c2ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:54.137298 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5236a-b606-4425-9fb0-58228e47c2ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:54.139003 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5236a-b606-4425-9fb0-58228e47c2ee service swift] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:54.148682 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1225/2398] 10.222.0.141 () {60 vars in 1389 bytes} [Tue Jul 26 16:25:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 16:25:55.156197 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d31de9-7eba-4e63-bf0f-b7c8ac724801 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:55.157700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d31de9-7eba-4e63-bf0f-b7c8ac724801 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:55.158124 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d31de9-7eba-4e63-bf0f-b7c8ac724801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:55.231757 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d0d31de9-7eba-4e63-bf0f-b7c8ac724801 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:55.233835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d0d31de9-7eba-4e63-bf0f-b7c8ac724801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:55.263507 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1174/2399] 10.222.0.39 () {58 vars in 1020 bytes} [Tue Jul 26 16:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:55.284480 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5236a-b606-4425-9fb0-58228e47c2ee service swift] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:55.311287 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5236a-b606-4425-9fb0-58228e47c2ee service swift] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:55.329345 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477514c6-6a0c-4453-bc1f-fa6e09beacdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:55.335974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477514c6-6a0c-4453-bc1f-fa6e09beacdb service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:55.336262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477514c6-6a0c-4453-bc1f-fa6e09beacdb service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:55.336544 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477514c6-6a0c-4453-bc1f-fa6e09beacdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:55.347606 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477514c6-6a0c-4453-bc1f-fa6e09beacdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:55.349623 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477514c6-6a0c-4453-bc1f-fa6e09beacdb service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:55.390388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1226/2400] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:25:57.674724 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d31de9-7eba-4e63-bf0f-b7c8ac724801 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:57.676267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d0d31de9-7eba-4e63-bf0f-b7c8ac724801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:57.695734 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d31de9-7eba-4e63-bf0f-b7c8ac724801 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:57.701127 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d7a48-e7c3-4479-a31d-ad333b7e04bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:57.701754 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d7a48-e7c3-4479-a31d-ad333b7e04bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:57.702117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d7a48-e7c3-4479-a31d-ad333b7e04bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:57.702391 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d7a48-e7c3-4479-a31d-ad333b7e04bb admin admin] PATH_INFO: `/v3/users/b19e0e76e9844195b3baad3b59f34774` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:57.703614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d7a48-e7c3-4479-a31d-ad333b7e04bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b19e0e76e9844195b3baad3b59f34774)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:57.705902 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d7a48-e7c3-4479-a31d-ad333b7e04bb admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:57.951185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-864d7a48-e7c3-4479-a31d-ad333b7e04bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b19e0e76e9844195b3baad3b59f34774'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:57.951848 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-864d7a48-e7c3-4479-a31d-ad333b7e04bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b19e0e76e9844195b3baad3b59f34774'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:57.968418 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-864d7a48-e7c3-4479-a31d-ad333b7e04bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b19e0e76e9844195b3baad3b59f34774'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:57.976392 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-864d7a48-e7c3-4479-a31d-ad333b7e04bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b19e0e76e9844195b3baad3b59f34774'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:58.042504 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-864d7a48-e7c3-4479-a31d-ad333b7e04bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b19e0e76e9844195b3baad3b59f34774'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:58.053276 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1175/2401] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:25:57 2022] DELETE /identity/v3/users/b19e0e76e9844195b3baad3b59f34774 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:25:58.372256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477514c6-6a0c-4453-bc1f-fa6e09beacdb service nova] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:58.382634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477514c6-6a0c-4453-bc1f-fa6e09beacdb service nova] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:58.437234 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:58.452610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6b7b5-b5b8-44c2-9eb9-cd12556d26f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:58.453293 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6b7b5-b5b8-44c2-9eb9-cd12556d26f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:58.453578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6b7b5-b5b8-44c2-9eb9-cd12556d26f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:58.453854 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6b7b5-b5b8-44c2-9eb9-cd12556d26f7 admin admin] PATH_INFO: `/v3/projects/2ed990b2222841ff8040bb6f076ee50c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:58.455032 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6b7b5-b5b8-44c2-9eb9-cd12556d26f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed990b2222841ff8040bb6f076ee50c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:58.457016 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6b7b5-b5b8-44c2-9eb9-cd12556d26f7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:58.595205 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c6d6b7b5-b5b8-44c2-9eb9-cd12556d26f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed990b2222841ff8040bb6f076ee50c', 'request_id': 'req-c6d6b7b5-b5b8-44c2-9eb9-cd12556d26f7'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:58.601670 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c6d6b7b5-b5b8-44c2-9eb9-cd12556d26f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed990b2222841ff8040bb6f076ee50c', 'request_id': 'req-c6d6b7b5-b5b8-44c2-9eb9-cd12556d26f7'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:58.607426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c6d6b7b5-b5b8-44c2-9eb9-cd12556d26f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed990b2222841ff8040bb6f076ee50c', 'request_id': 'req-c6d6b7b5-b5b8-44c2-9eb9-cd12556d26f7'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:58.702767 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c6d6b7b5-b5b8-44c2-9eb9-cd12556d26f7 admin admin] The token cache is being invalidate because project 2ed990b2222841ff8040bb6f076ee50c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:25:58.702986 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c6d6b7b5-b5b8-44c2-9eb9-cd12556d26f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:58.703678 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c6d6b7b5-b5b8-44c2-9eb9-cd12556d26f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:58.705404 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1227/2402] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:25:58 2022] DELETE /identity/v3/projects/2ed990b2222841ff8040bb6f076ee50c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:25:58.709426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d7a48-e7c3-4479-a31d-ad333b7e04bb admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:58.710949 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-864d7a48-e7c3-4479-a31d-ad333b7e04bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:58.725518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d7a48-e7c3-4479-a31d-ad333b7e04bb admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:58.795375 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a2eba-5f61-409b-80db-095313895878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:58.797017 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a2eba-5f61-409b-80db-095313895878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:58.797487 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a2eba-5f61-409b-80db-095313895878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:58.798109 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a2eba-5f61-409b-80db-095313895878 admin admin] PATH_INFO: `/v3/users/d1c72df6f8ff4e258b680592d3e8b186` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:58.799544 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a2eba-5f61-409b-80db-095313895878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c72df6f8ff4e258b680592d3e8b186)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:58.801982 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a2eba-5f61-409b-80db-095313895878 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:58.814147 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:59.029624 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5f5a2eba-5f61-409b-80db-095313895878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c72df6f8ff4e258b680592d3e8b186'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:59.030373 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5f5a2eba-5f61-409b-80db-095313895878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c72df6f8ff4e258b680592d3e8b186'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:59.044371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5f5a2eba-5f61-409b-80db-095313895878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c72df6f8ff4e258b680592d3e8b186'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:59.051426 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5f5a2eba-5f61-409b-80db-095313895878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c72df6f8ff4e258b680592d3e8b186'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:59.150706 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5f5a2eba-5f61-409b-80db-095313895878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c72df6f8ff4e258b680592d3e8b186'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:59.157226 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1176/2403] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:25:58 2022] DELETE /identity/v3/users/d1c72df6f8ff4e258b680592d3e8b186 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:25:59.369339 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85656c3d-d560-4359-aa89-c8883e779043 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:59.370020 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85656c3d-d560-4359-aa89-c8883e779043 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:59.370305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85656c3d-d560-4359-aa89-c8883e779043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:59.391916 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-85656c3d-d560-4359-aa89-c8883e779043 None None] MFA Rules not processed for user `02af03095e48472d96a995a530e78035`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:59.393265 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-85656c3d-d560-4359-aa89-c8883e779043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:59.455220 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1228/2404] 10.222.0.141 () {58 vars in 972 bytes} [Tue Jul 26 16:25:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:59.469958 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a2eba-5f61-409b-80db-095313895878 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:59.471434 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5f5a2eba-5f61-409b-80db-095313895878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:59.507054 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85656c3d-d560-4359-aa89-c8883e779043 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:25:59.508484 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-85656c3d-d560-4359-aa89-c8883e779043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:59.571163 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a2eba-5f61-409b-80db-095313895878 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:59.578212 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c20ea-23c6-4471-af57-f04c89022cde service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c5f92f21868436a99a5c7aaa1fc40b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:59.582306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c20ea-23c6-4471-af57-f04c89022cde service swift] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:59.582306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c20ea-23c6-4471-af57-f04c89022cde service swift] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:59.582306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c20ea-23c6-4471-af57-f04c89022cde service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:59.591496 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c20ea-23c6-4471-af57-f04c89022cde service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:59.593775 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c20ea-23c6-4471-af57-f04c89022cde service swift] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:59.606163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85656c3d-d560-4359-aa89-c8883e779043 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:25:59.617535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3656b-fabb-46b8-a852-60373e2cb70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:25:59.617973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1177/2405] 10.222.0.141 () {60 vars in 1389 bytes} [Tue Jul 26 16:25:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 16:25:59.618570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3656b-fabb-46b8-a852-60373e2cb70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:59.618570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3656b-fabb-46b8-a852-60373e2cb70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:59.618570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3656b-fabb-46b8-a852-60373e2cb70b admin admin] PATH_INFO: `/v3/projects/23e761ea9f3d4030a0f3575d8197f0b5` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:59.618570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3656b-fabb-46b8-a852-60373e2cb70b admin admin] RBAC: Authorizing `identity:delete_project(project_id=23e761ea9f3d4030a0f3575d8197f0b5)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:25:59.618570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3656b-fabb-46b8-a852-60373e2cb70b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:25:59.643560 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:59.751393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4ce3656b-fabb-46b8-a852-60373e2cb70b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e761ea9f3d4030a0f3575d8197f0b5', 'request_id': 'req-4ce3656b-fabb-46b8-a852-60373e2cb70b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:59.758488 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4ce3656b-fabb-46b8-a852-60373e2cb70b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e761ea9f3d4030a0f3575d8197f0b5', 'request_id': 'req-4ce3656b-fabb-46b8-a852-60373e2cb70b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:59.764988 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4ce3656b-fabb-46b8-a852-60373e2cb70b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e761ea9f3d4030a0f3575d8197f0b5', 'request_id': 'req-4ce3656b-fabb-46b8-a852-60373e2cb70b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:59.853446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4ce3656b-fabb-46b8-a852-60373e2cb70b admin admin] The token cache is being invalidate because project 23e761ea9f3d4030a0f3575d8197f0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:25:59.853735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4ce3656b-fabb-46b8-a852-60373e2cb70b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:59.854380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4ce3656b-fabb-46b8-a852-60373e2cb70b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:25:59.855921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1229/2406] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:25:59 2022] DELETE /identity/v3/projects/23e761ea9f3d4030a0f3575d8197f0b5 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:25:59.864065 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ea05d-74a6-4a13-8878-73db2fe4d13b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:59.864909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ea05d-74a6-4a13-8878-73db2fe4d13b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:59.864909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ea05d-74a6-4a13-8878-73db2fe4d13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:59.884772 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-f53ea05d-74a6-4a13-8878-73db2fe4d13b None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:59.885997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f53ea05d-74a6-4a13-8878-73db2fe4d13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:59.957496 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1178/2407] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:25:59.965854 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c93597-9ce2-4108-ae49-02dbd7c002e1 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:25:59.966141 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c93597-9ce2-4108-ae49-02dbd7c002e1 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:25:59.966416 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c93597-9ce2-4108-ae49-02dbd7c002e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:25:59.988229 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-83c93597-9ce2-4108-ae49-02dbd7c002e1 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:25:59.990158 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-83c93597-9ce2-4108-ae49-02dbd7c002e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:25:59.999050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1230/2408] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:26:00.003973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ea05d-74a6-4a13-8878-73db2fe4d13b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:00.018563 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ea05d-74a6-4a13-8878-73db2fe4d13b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:00.024288 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a64aad-a8a1-4f3e-9d24-ca45685707bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:00.025029 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a64aad-a8a1-4f3e-9d24-ca45685707bc admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:00.025380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a64aad-a8a1-4f3e-9d24-ca45685707bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:00.025705 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a64aad-a8a1-4f3e-9d24-ca45685707bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:00.026462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a64aad-a8a1-4f3e-9d24-ca45685707bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:26:00.026825 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a64aad-a8a1-4f3e-9d24-ca45685707bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:00.028414 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a64aad-a8a1-4f3e-9d24-ca45685707bc admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:00.047254 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1179/2409] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:26:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:26:00.054811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c93597-9ce2-4108-ae49-02dbd7c002e1 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:00.066241 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c93597-9ce2-4108-ae49-02dbd7c002e1 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:00.071696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2b609-9132-46ab-99c8-dbd6b6cce8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:00.072411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2b609-9132-46ab-99c8-dbd6b6cce8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:00.072749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2b609-9132-46ab-99c8-dbd6b6cce8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:00.073019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2b609-9132-46ab-99c8-dbd6b6cce8e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:00.073757 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb2b609-9132-46ab-99c8-dbd6b6cce8e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:00.075844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb2b609-9132-46ab-99c8-dbd6b6cce8e6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:00.198163 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1231/2410] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:26:00 2022] POST /identity/v3/projects => generated 374 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:26:00.205639 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a64aad-a8a1-4f3e-9d24-ca45685707bc admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:00.212092 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:26:00.222088 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a64aad-a8a1-4f3e-9d24-ca45685707bc admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:00.363848 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b95e6a-7a60-43af-8289-1cb495dea7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:00.363848 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b95e6a-7a60-43af-8289-1cb495dea7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:00.363848 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b95e6a-7a60-43af-8289-1cb495dea7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:00.363848 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b95e6a-7a60-43af-8289-1cb495dea7e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:00.365703 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b95e6a-7a60-43af-8289-1cb495dea7e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:00.374722 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b95e6a-7a60-43af-8289-1cb495dea7e1 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:00.460338 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1180/2411] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:26:00 2022] POST /identity/v3/users => generated 288 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:26:00.461720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2b609-9132-46ab-99c8-dbd6b6cce8e6 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:00.472516 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2b609-9132-46ab-99c8-dbd6b6cce8e6 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:00.477777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fcdad-a753-45a1-b435-ec3d5485e732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:00.478397 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fcdad-a753-45a1-b435-ec3d5485e732 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:00.478803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fcdad-a753-45a1-b435-ec3d5485e732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:00.478957 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fcdad-a753-45a1-b435-ec3d5485e732 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:00.479648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8fcdad-a753-45a1-b435-ec3d5485e732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:00.481327 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8fcdad-a753-45a1-b435-ec3d5485e732 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:00.496536 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1232/2412] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:26:00 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:26:00.497887 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b95e6a-7a60-43af-8289-1cb495dea7e1 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:00.520193 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b95e6a-7a60-43af-8289-1cb495dea7e1 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:00.526581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdee819-dd87-43ad-8626-ace6a0a5f713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:00.527344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdee819-dd87-43ad-8626-ace6a0a5f713 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:00.527842 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdee819-dd87-43ad-8626-ace6a0a5f713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:00.528215 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdee819-dd87-43ad-8626-ace6a0a5f713 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:00.529100 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdee819-dd87-43ad-8626-ace6a0a5f713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:00.530929 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdee819-dd87-43ad-8626-ace6a0a5f713 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:00.545934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1181/2413] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:26:00 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:26:00.550256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fcdad-a753-45a1-b435-ec3d5485e732 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:00.561373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fcdad-a753-45a1-b435-ec3d5485e732 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:00.571883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abd5af-db15-4d52-8e32-6ca199168343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:00.572713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abd5af-db15-4d52-8e32-6ca199168343 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:00.572996 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abd5af-db15-4d52-8e32-6ca199168343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:00.573276 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abd5af-db15-4d52-8e32-6ca199168343 admin admin] PATH_INFO: `/v3/projects/5eb1965cbb2b4ee9be24e03e67e04d36/users/21bec37f664d40239aefc31e279d97d7/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:00.591971 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abd5af-db15-4d52-8e32-6ca199168343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb1965cbb2b4ee9be24e03e67e04d36, user_id=21bec37f664d40239aefc31e279d97d7, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:00.595035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abd5af-db15-4d52-8e32-6ca199168343 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:00.668848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1233/2414] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:26:00 2022] PUT /identity/v3/projects/5eb1965cbb2b4ee9be24e03e67e04d36/users/21bec37f664d40239aefc31e279d97d7/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:26:00.739039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb91f1-ef3c-49df-b931-57cd37018648 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:00.739329 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb91f1-ef3c-49df-b931-57cd37018648 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:00.740091 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb91f1-ef3c-49df-b931-57cd37018648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:00.770510 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-eabb91f1-ef3c-49df-b931-57cd37018648 None None] MFA Rules not processed for user `21bec37f664d40239aefc31e279d97d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:00.772026 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-eabb91f1-ef3c-49df-b931-57cd37018648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:00.839529 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1182/2415] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:26:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:26:00.850781 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abd5af-db15-4d52-8e32-6ca199168343 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:00.852724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c6abd5af-db15-4d52-8e32-6ca199168343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:00.946340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abd5af-db15-4d52-8e32-6ca199168343 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:00.950252 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd465086-0f0e-42ca-8080-35e43801e55d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:00.952019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd465086-0f0e-42ca-8080-35e43801e55d service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:00.952019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd465086-0f0e-42ca-8080-35e43801e55d service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:00.952019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd465086-0f0e-42ca-8080-35e43801e55d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:00.961227 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd465086-0f0e-42ca-8080-35e43801e55d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:00.962852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd465086-0f0e-42ca-8080-35e43801e55d service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:00.973352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1234/2416] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:26:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:26:03.671862 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafe855-35aa-4b72-9179-6e7df7c3a8e0 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:03.672474 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafe855-35aa-4b72-9179-6e7df7c3a8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:03.672578 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafe855-35aa-4b72-9179-6e7df7c3a8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:03.694354 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-baafe855-35aa-4b72-9179-6e7df7c3a8e0 None None] MFA Rules not processed for user `21bec37f664d40239aefc31e279d97d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:03.695630 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-baafe855-35aa-4b72-9179-6e7df7c3a8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:03.703801 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1183/2417] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:26:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:26:04.878388 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd465086-0f0e-42ca-8080-35e43801e55d service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:04.879838 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dd465086-0f0e-42ca-8080-35e43801e55d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:04.933384 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:26:04.949066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd465086-0f0e-42ca-8080-35e43801e55d service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:04.953524 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb9d72-4ad9-4ae8-b4cf-f5632cc6bc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:04.954164 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb9d72-4ad9-4ae8-b4cf-f5632cc6bc3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:04.954445 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb9d72-4ad9-4ae8-b4cf-f5632cc6bc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:04.954741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb9d72-4ad9-4ae8-b4cf-f5632cc6bc3c admin admin] PATH_INFO: `/v3/users/0ab7a9d2b4f44d4e91a3c198f945f980` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:04.955907 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb9d72-4ad9-4ae8-b4cf-f5632cc6bc3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab7a9d2b4f44d4e91a3c198f945f980)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:04.957892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb9d72-4ad9-4ae8-b4cf-f5632cc6bc3c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:05.179719 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-02bb9d72-4ad9-4ae8-b4cf-f5632cc6bc3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab7a9d2b4f44d4e91a3c198f945f980'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:05.181162 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-02bb9d72-4ad9-4ae8-b4cf-f5632cc6bc3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab7a9d2b4f44d4e91a3c198f945f980'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:05.267810 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-02bb9d72-4ad9-4ae8-b4cf-f5632cc6bc3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab7a9d2b4f44d4e91a3c198f945f980'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:05.281570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-02bb9d72-4ad9-4ae8-b4cf-f5632cc6bc3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab7a9d2b4f44d4e91a3c198f945f980'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:05.285608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-02bb9d72-4ad9-4ae8-b4cf-f5632cc6bc3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab7a9d2b4f44d4e91a3c198f945f980'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:05.295858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1235/2418] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:26:04 2022] DELETE /identity/v3/users/0ab7a9d2b4f44d4e91a3c198f945f980 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:26:05.583951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafe855-35aa-4b72-9179-6e7df7c3a8e0 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:05.595074 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafe855-35aa-4b72-9179-6e7df7c3a8e0 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:05.653694 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0205a-4577-47a2-bbe3-c7b88d205b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:05.654242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0205a-4577-47a2-bbe3-c7b88d205b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:05.654522 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0205a-4577-47a2-bbe3-c7b88d205b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:05.654798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0205a-4577-47a2-bbe3-c7b88d205b3a admin admin] PATH_INFO: `/v3/projects/3b9d338044bc4fa4a603685ea9423828` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:05.655941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0205a-4577-47a2-bbe3-c7b88d205b3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9d338044bc4fa4a603685ea9423828)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:05.657883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0205a-4577-47a2-bbe3-c7b88d205b3a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:05.663986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:26:05.771815 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-03a0205a-4577-47a2-bbe3-c7b88d205b3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9d338044bc4fa4a603685ea9423828', 'request_id': 'req-03a0205a-4577-47a2-bbe3-c7b88d205b3a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:05.777922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-03a0205a-4577-47a2-bbe3-c7b88d205b3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9d338044bc4fa4a603685ea9423828', 'request_id': 'req-03a0205a-4577-47a2-bbe3-c7b88d205b3a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:05.783564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-03a0205a-4577-47a2-bbe3-c7b88d205b3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9d338044bc4fa4a603685ea9423828', 'request_id': 'req-03a0205a-4577-47a2-bbe3-c7b88d205b3a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:05.871525 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-03a0205a-4577-47a2-bbe3-c7b88d205b3a admin admin] The token cache is being invalidate because project 3b9d338044bc4fa4a603685ea9423828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:26:05.871816 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-03a0205a-4577-47a2-bbe3-c7b88d205b3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:05.872555 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-03a0205a-4577-47a2-bbe3-c7b88d205b3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:05.874132 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1184/2419] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:26:05 2022] DELETE /identity/v3/projects/3b9d338044bc4fa4a603685ea9423828 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:26:05.879084 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034baa3f-60e4-4d66-b06a-c2aec3ef59be None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:05.879550 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034baa3f-60e4-4d66-b06a-c2aec3ef59be None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:05.879642 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034baa3f-60e4-4d66-b06a-c2aec3ef59be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:05.900784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-034baa3f-60e4-4d66-b06a-c2aec3ef59be None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:05.901989 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-034baa3f-60e4-4d66-b06a-c2aec3ef59be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:05.961382 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1236/2420] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:26:05.969427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcbf81-712b-4292-a574-af74e89a3d07 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:05.969714 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcbf81-712b-4292-a574-af74e89a3d07 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:05.969992 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcbf81-712b-4292-a574-af74e89a3d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:05.990163 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d6fcbf81-712b-4292-a574-af74e89a3d07 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:05.991352 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d6fcbf81-712b-4292-a574-af74e89a3d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:05.999241 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1185/2421] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:26:06.007948 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034baa3f-60e4-4d66-b06a-c2aec3ef59be None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:06.013791 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034baa3f-60e4-4d66-b06a-c2aec3ef59be None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:06.018420 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6fae5-4fd7-4006-83b2-9fbad381114d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:06.019028 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6fae5-4fd7-4006-83b2-9fbad381114d admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:06.019313 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6fae5-4fd7-4006-83b2-9fbad381114d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:06.019631 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6fae5-4fd7-4006-83b2-9fbad381114d admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:06.020352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6fae5-4fd7-4006-83b2-9fbad381114d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:26:06.020678 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6fae5-4fd7-4006-83b2-9fbad381114d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:06.022288 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6fae5-4fd7-4006-83b2-9fbad381114d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:06.033846 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1237/2422] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:26:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:26:06.038123 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcbf81-712b-4292-a574-af74e89a3d07 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:06.047634 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcbf81-712b-4292-a574-af74e89a3d07 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:06.052819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad11902-8dd0-48b3-a523-1060b7b4587c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:06.053423 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad11902-8dd0-48b3-a523-1060b7b4587c admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:06.053703 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad11902-8dd0-48b3-a523-1060b7b4587c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:06.053975 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad11902-8dd0-48b3-a523-1060b7b4587c admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:06.054643 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad11902-8dd0-48b3-a523-1060b7b4587c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:06.056536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad11902-8dd0-48b3-a523-1060b7b4587c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:06.153007 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1186/2423] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:26:06 2022] POST /identity/v3/projects => generated 370 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:26:06.157379 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6fae5-4fd7-4006-83b2-9fbad381114d admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:06.167624 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6fae5-4fd7-4006-83b2-9fbad381114d admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:06.217647 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:26:06.224872 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c280753-85d0-4480-b40b-2ae69d1d08d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:06.228116 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c280753-85d0-4480-b40b-2ae69d1d08d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:06.228116 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c280753-85d0-4480-b40b-2ae69d1d08d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:06.228116 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c280753-85d0-4480-b40b-2ae69d1d08d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:06.228116 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c280753-85d0-4480-b40b-2ae69d1d08d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:06.228726 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c280753-85d0-4480-b40b-2ae69d1d08d4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:06.454542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1238/2424] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:26:06 2022] POST /identity/v3/users => generated 286 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:26:06.455694 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad11902-8dd0-48b3-a523-1060b7b4587c admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:06.466129 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad11902-8dd0-48b3-a523-1060b7b4587c admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:06.474550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899424c-22fa-4f0b-8d24-b47dd4cb39f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:06.474550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899424c-22fa-4f0b-8d24-b47dd4cb39f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:06.474550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899424c-22fa-4f0b-8d24-b47dd4cb39f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:06.474550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899424c-22fa-4f0b-8d24-b47dd4cb39f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:06.474945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899424c-22fa-4f0b-8d24-b47dd4cb39f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:06.474945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899424c-22fa-4f0b-8d24-b47dd4cb39f5 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:06.484672 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1187/2425] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:26:06 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:26:06.488793 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c280753-85d0-4480-b40b-2ae69d1d08d4 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:06.499643 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c280753-85d0-4480-b40b-2ae69d1d08d4 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:06.504339 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41a1e4-7c9f-4320-9142-25f32c94cff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:06.504983 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41a1e4-7c9f-4320-9142-25f32c94cff8 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:06.505713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41a1e4-7c9f-4320-9142-25f32c94cff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:06.505713 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41a1e4-7c9f-4320-9142-25f32c94cff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:06.506232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41a1e4-7c9f-4320-9142-25f32c94cff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:06.507797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41a1e4-7c9f-4320-9142-25f32c94cff8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:06.525308 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1239/2426] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:26:06 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:26:06.533722 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899424c-22fa-4f0b-8d24-b47dd4cb39f5 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:06.549248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899424c-22fa-4f0b-8d24-b47dd4cb39f5 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:06.565296 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f268b78-4249-477c-91cc-513fc8a89ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:06.566070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f268b78-4249-477c-91cc-513fc8a89ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:06.566424 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f268b78-4249-477c-91cc-513fc8a89ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:06.566776 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f268b78-4249-477c-91cc-513fc8a89ae7 admin admin] PATH_INFO: `/v3/projects/5391105a303a415f9f06e60946bcbdc4/users/25999825df11437d8f28518734750a4b/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:06.584490 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f268b78-4249-477c-91cc-513fc8a89ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5391105a303a415f9f06e60946bcbdc4, user_id=25999825df11437d8f28518734750a4b, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:06.587705 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f268b78-4249-477c-91cc-513fc8a89ae7 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:06.665783 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1188/2427] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:26:06 2022] PUT /identity/v3/projects/5391105a303a415f9f06e60946bcbdc4/users/25999825df11437d8f28518734750a4b/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:26:06.676426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f453295-95fe-468e-8aa7-d2138c11cc36 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:06.676825 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f453295-95fe-468e-8aa7-d2138c11cc36 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:06.677209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f453295-95fe-468e-8aa7-d2138c11cc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:06.705673 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-8f453295-95fe-468e-8aa7-d2138c11cc36 None None] MFA Rules not processed for user `25999825df11437d8f28518734750a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:06.706928 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8f453295-95fe-468e-8aa7-d2138c11cc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:06.772608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1240/2428] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:26:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:26:06.784295 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f268b78-4249-477c-91cc-513fc8a89ae7 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:06.786020 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7f268b78-4249-477c-91cc-513fc8a89ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:06.844948 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f268b78-4249-477c-91cc-513fc8a89ae7 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:06.848890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020347b-c518-4b96-b104-0e1ca4465e36 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d25aebc2bbc47b5adb7200275c98d90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:06.849516 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020347b-c518-4b96-b104-0e1ca4465e36 service glance] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:06.849797 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020347b-c518-4b96-b104-0e1ca4465e36 service glance] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:06.850218 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020347b-c518-4b96-b104-0e1ca4465e36 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:06.861073 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020347b-c518-4b96-b104-0e1ca4465e36 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:06.862675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020347b-c518-4b96-b104-0e1ca4465e36 service glance] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:06.873285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1189/2429] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:26:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:26:10.118773 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656e063-fe53-411f-84f4-7658f3a24777 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:10.119833 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656e063-fe53-411f-84f4-7658f3a24777 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:10.120922 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656e063-fe53-411f-84f4-7658f3a24777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:10.160211 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5656e063-fe53-411f-84f4-7658f3a24777 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:10.170689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5656e063-fe53-411f-84f4-7658f3a24777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:10.280884 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1241/2430] 10.222.0.39 () {58 vars in 1020 bytes} [Tue Jul 26 16:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:26:10.328432 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020347b-c518-4b96-b104-0e1ca4465e36 service glance] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:10.329915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d020347b-c518-4b96-b104-0e1ca4465e36 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:10.398365 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:26:10.447002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020347b-c518-4b96-b104-0e1ca4465e36 service glance] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:10.459619 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf990b-1277-435b-a049-f610bf3b039d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:10.460278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf990b-1277-435b-a049-f610bf3b039d service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:10.460563 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf990b-1277-435b-a049-f610bf3b039d service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:10.460892 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf990b-1277-435b-a049-f610bf3b039d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:10.470024 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf990b-1277-435b-a049-f610bf3b039d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:10.473850 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf990b-1277-435b-a049-f610bf3b039d service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:10.482441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1190/2431] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:26:13.204855 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6ba6b-b8cf-4549-a082-5978778cdac8 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:13.205390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6ba6b-b8cf-4549-a082-5978778cdac8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:13.205390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6ba6b-b8cf-4549-a082-5978778cdac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:13.227190 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a1f6ba6b-b8cf-4549-a082-5978778cdac8 None None] MFA Rules not processed for user `02af03095e48472d96a995a530e78035`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:13.228416 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a1f6ba6b-b8cf-4549-a082-5978778cdac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:13.284681 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1242/2432] 10.222.0.141 () {58 vars in 972 bytes} [Tue Jul 26 16:26:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:26:13.297194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf990b-1277-435b-a049-f610bf3b039d service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:13.298702 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fddf990b-1277-435b-a049-f610bf3b039d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:13.370125 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf990b-1277-435b-a049-f610bf3b039d service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:13.375291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5d438-a302-4c60-81ac-11f0c79b33e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c5f92f21868436a99a5c7aaa1fc40b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:13.375907 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5d438-a302-4c60-81ac-11f0c79b33e7 service swift] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:13.376187 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5d438-a302-4c60-81ac-11f0c79b33e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:13.376459 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5d438-a302-4c60-81ac-11f0c79b33e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:13.384966 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5d438-a302-4c60-81ac-11f0c79b33e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:13.386538 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5d438-a302-4c60-81ac-11f0c79b33e7 service swift] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:13.394476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1191/2433] 10.222.0.141 () {60 vars in 1389 bytes} [Tue Jul 26 16:26:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 16:26:14.403206 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eef711-7724-4b92-acc7-74167e5db828 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:14.403712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eef711-7724-4b92-acc7-74167e5db828 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:14.403814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eef711-7724-4b92-acc7-74167e5db828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:14.424985 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-65eef711-7724-4b92-acc7-74167e5db828 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:14.426320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-65eef711-7724-4b92-acc7-74167e5db828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:14.434854 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1243/2434] 10.222.0.39 () {58 vars in 1020 bytes} [Tue Jul 26 16:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:26:14.452428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5d438-a302-4c60-81ac-11f0c79b33e7 service swift] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:14.464202 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5d438-a302-4c60-81ac-11f0c79b33e7 service swift] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:14.469988 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9d781-c526-47be-a1e9-25520e6cb258 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:14.470600 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9d781-c526-47be-a1e9-25520e6cb258 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:14.470881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9d781-c526-47be-a1e9-25520e6cb258 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:14.471155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9d781-c526-47be-a1e9-25520e6cb258 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:14.480217 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9d781-c526-47be-a1e9-25520e6cb258 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:14.482434 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9d781-c526-47be-a1e9-25520e6cb258 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:14.493249 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1192/2435] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:26:18.095164 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eef711-7724-4b92-acc7-74167e5db828 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:18.096636 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-65eef711-7724-4b92-acc7-74167e5db828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:18.101909 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:26:18.171129 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eef711-7724-4b92-acc7-74167e5db828 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:18.176519 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5cee4-5c13-4a14-84f9-f8c8a8a49eeb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda05b7b9675423e992470819d1c150a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:18.177194 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5cee4-5c13-4a14-84f9-f8c8a8a49eeb service placement] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:18.177469 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5cee4-5c13-4a14-84f9-f8c8a8a49eeb service placement] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:18.177748 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5cee4-5c13-4a14-84f9-f8c8a8a49eeb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:18.180417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-35b5cee4-5c13-4a14-84f9-f8c8a8a49eeb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:18.197467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5cee4-5c13-4a14-84f9-f8c8a8a49eeb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:18.197467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5cee4-5c13-4a14-84f9-f8c8a8a49eeb service placement] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:18.207629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1244/2436] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:26:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:26:24.488073 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=57 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:26:28.203099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=31 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:26:33.264759 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9d781-c526-47be-a1e9-25520e6cb258 service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:33.276493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9d781-c526-47be-a1e9-25520e6cb258 service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:33.281821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cb9f1-1b50-40cb-996b-c3bec25a4caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:33.282452 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cb9f1-1b50-40cb-996b-c3bec25a4caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:33.282734 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cb9f1-1b50-40cb-996b-c3bec25a4caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:33.283005 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cb9f1-1b50-40cb-996b-c3bec25a4caf admin admin] PATH_INFO: `/v3/users/25999825df11437d8f28518734750a4b` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:33.284802 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cb9f1-1b50-40cb-996b-c3bec25a4caf admin admin] RBAC: Authorizing `identity:delete_user(user_id=25999825df11437d8f28518734750a4b)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:33.285077 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8891bca-e846-4682-9c5c-d4420ece0fae None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:33.285564 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8891bca-e846-4682-9c5c-d4420ece0fae None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:33.285642 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8891bca-e846-4682-9c5c-d4420ece0fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:33.286281 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cb9f1-1b50-40cb-996b-c3bec25a4caf admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:33.308608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a8891bca-e846-4682-9c5c-d4420ece0fae None None] MFA Rules not processed for user `02af03095e48472d96a995a530e78035`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:33.309921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a8891bca-e846-4682-9c5c-d4420ece0fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:33.318299 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1245/2437] 10.222.0.141 () {58 vars in 1014 bytes} [Tue Jul 26 16:26:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:26:33.345380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8891bca-e846-4682-9c5c-d4420ece0fae None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:33.358811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8891bca-e846-4682-9c5c-d4420ece0fae None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:33.365475 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4666c1-10d7-4946-b78e-5ff01ecfbe46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c5f92f21868436a99a5c7aaa1fc40b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:33.372493 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4666c1-10d7-4946-b78e-5ff01ecfbe46 service swift] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:33.372493 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4666c1-10d7-4946-b78e-5ff01ecfbe46 service swift] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:33.372493 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4666c1-10d7-4946-b78e-5ff01ecfbe46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:33.376518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4666c1-10d7-4946-b78e-5ff01ecfbe46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:33.378058 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4666c1-10d7-4946-b78e-5ff01ecfbe46 service swift] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:33.386692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1246/2438] 10.222.0.141 () {60 vars in 1389 bytes} [Tue Jul 26 16:26:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 16:26:33.503779 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a38cb9f1-1b50-40cb-996b-c3bec25a4caf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25999825df11437d8f28518734750a4b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:33.504421 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a38cb9f1-1b50-40cb-996b-c3bec25a4caf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25999825df11437d8f28518734750a4b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:33.516304 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a38cb9f1-1b50-40cb-996b-c3bec25a4caf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25999825df11437d8f28518734750a4b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:33.523277 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a38cb9f1-1b50-40cb-996b-c3bec25a4caf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25999825df11437d8f28518734750a4b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:33.604803 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a38cb9f1-1b50-40cb-996b-c3bec25a4caf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25999825df11437d8f28518734750a4b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:33.611242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1193/2439] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:26:33 2022] DELETE /identity/v3/users/25999825df11437d8f28518734750a4b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:26:33.615879 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f29fd5-46f2-48ec-aa72-5ee56ea5048e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:33.616197 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f29fd5-46f2-48ec-aa72-5ee56ea5048e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:33.616491 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f29fd5-46f2-48ec-aa72-5ee56ea5048e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:33.636185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-20f29fd5-46f2-48ec-aa72-5ee56ea5048e None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:33.637324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-20f29fd5-46f2-48ec-aa72-5ee56ea5048e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:33.702602 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1247/2440] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:26:33.712795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cb9f1-1b50-40cb-996b-c3bec25a4caf admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:33.714186 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a38cb9f1-1b50-40cb-996b-c3bec25a4caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:33.773196 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cb9f1-1b50-40cb-996b-c3bec25a4caf admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:33.777096 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551d428-e087-4e4c-8cad-33cfc81bd500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:33.777718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551d428-e087-4e4c-8cad-33cfc81bd500 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:33.777999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551d428-e087-4e4c-8cad-33cfc81bd500 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:33.778271 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551d428-e087-4e4c-8cad-33cfc81bd500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:33.790049 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551d428-e087-4e4c-8cad-33cfc81bd500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:33.790680 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551d428-e087-4e4c-8cad-33cfc81bd500 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:33.804878 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1194/2441] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:26:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:26:34.241156 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f29fd5-46f2-48ec-aa72-5ee56ea5048e None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:34.243525 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-20f29fd5-46f2-48ec-aa72-5ee56ea5048e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:34.267277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f29fd5-46f2-48ec-aa72-5ee56ea5048e None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:34.271276 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efeecfc-83c6-4601-8ecf-42f000d7b536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:34.271950 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efeecfc-83c6-4601-8ecf-42f000d7b536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:34.272232 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efeecfc-83c6-4601-8ecf-42f000d7b536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:34.272510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efeecfc-83c6-4601-8ecf-42f000d7b536 admin admin] PATH_INFO: `/v3/projects/5391105a303a415f9f06e60946bcbdc4` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:34.274269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efeecfc-83c6-4601-8ecf-42f000d7b536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5391105a303a415f9f06e60946bcbdc4)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:34.276187 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efeecfc-83c6-4601-8ecf-42f000d7b536 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:34.387239 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1efeecfc-83c6-4601-8ecf-42f000d7b536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5391105a303a415f9f06e60946bcbdc4', 'request_id': 'req-1efeecfc-83c6-4601-8ecf-42f000d7b536'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:34.393853 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1efeecfc-83c6-4601-8ecf-42f000d7b536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5391105a303a415f9f06e60946bcbdc4', 'request_id': 'req-1efeecfc-83c6-4601-8ecf-42f000d7b536'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:34.394467 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff5435-c7ad-4429-9128-1e932eff825f None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:34.394879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff5435-c7ad-4429-9128-1e932eff825f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:34.395023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff5435-c7ad-4429-9128-1e932eff825f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:34.400057 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1efeecfc-83c6-4601-8ecf-42f000d7b536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5391105a303a415f9f06e60946bcbdc4', 'request_id': 'req-1efeecfc-83c6-4601-8ecf-42f000d7b536'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:34.415265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d3ff5435-c7ad-4429-9128-1e932eff825f None None] MFA Rules not processed for user `02af03095e48472d96a995a530e78035`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:34.416495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d3ff5435-c7ad-4429-9128-1e932eff825f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:34.477096 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1195/2442] 10.222.0.141 () {58 vars in 972 bytes} [Tue Jul 26 16:26:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:26:34.489740 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff5435-c7ad-4429-9128-1e932eff825f None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:34.491137 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d3ff5435-c7ad-4429-9128-1e932eff825f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:34.512108 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1efeecfc-83c6-4601-8ecf-42f000d7b536 admin admin] The token cache is being invalidate because project 5391105a303a415f9f06e60946bcbdc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:26:34.512455 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1efeecfc-83c6-4601-8ecf-42f000d7b536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:34.513130 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1efeecfc-83c6-4601-8ecf-42f000d7b536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:34.514890 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1248/2443] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:26:34 2022] DELETE /identity/v3/projects/5391105a303a415f9f06e60946bcbdc4 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:26:34.520935 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cbaf4-8c98-40d8-8b5a-1e2e648b4df7 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:34.521548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cbaf4-8c98-40d8-8b5a-1e2e648b4df7 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:34.524295 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:26:34.532278 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cbaf4-8c98-40d8-8b5a-1e2e648b4df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:34.556648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-382cbaf4-8c98-40d8-8b5a-1e2e648b4df7 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:34.558314 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-382cbaf4-8c98-40d8-8b5a-1e2e648b4df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:34.569611 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff5435-c7ad-4429-9128-1e932eff825f None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:34.575949 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b44b79-698c-4e88-a0e3-283a42adea48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c5f92f21868436a99a5c7aaa1fc40b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:34.576621 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b44b79-698c-4e88-a0e3-283a42adea48 service swift] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:34.576994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b44b79-698c-4e88-a0e3-283a42adea48 service swift] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:34.577269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b44b79-698c-4e88-a0e3-283a42adea48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:34.579158 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c7b44b79-698c-4e88-a0e3-283a42adea48 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:34.594924 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b44b79-698c-4e88-a0e3-283a42adea48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:34.597106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b44b79-698c-4e88-a0e3-283a42adea48 service swift] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:34.606958 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1196/2444] 10.222.0.141 () {60 vars in 1389 bytes} [Tue Jul 26 16:26:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 16:26:34.623775 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1249/2445] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:26:34.633434 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b98c8-e177-447a-b6ce-2e80d0d25570 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:34.633722 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b98c8-e177-447a-b6ce-2e80d0d25570 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:34.633994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b98c8-e177-447a-b6ce-2e80d0d25570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:34.653104 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-db7b98c8-e177-447a-b6ce-2e80d0d25570 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:34.656128 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-db7b98c8-e177-447a-b6ce-2e80d0d25570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:34.662288 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1197/2446] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:26:34.666464 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cbaf4-8c98-40d8-8b5a-1e2e648b4df7 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:34.672771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:26:34.676470 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cbaf4-8c98-40d8-8b5a-1e2e648b4df7 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:34.681567 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3a659-5eeb-4035-8b9d-48a2c91286f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:34.682174 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3a659-5eeb-4035-8b9d-48a2c91286f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:34.682456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3a659-5eeb-4035-8b9d-48a2c91286f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:34.682736 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3a659-5eeb-4035-8b9d-48a2c91286f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:34.683423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3a659-5eeb-4035-8b9d-48a2c91286f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:26:34.683733 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3a659-5eeb-4035-8b9d-48a2c91286f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:34.685362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3a659-5eeb-4035-8b9d-48a2c91286f5 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:34.697337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1250/2447] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:26:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:26:34.701485 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b98c8-e177-447a-b6ce-2e80d0d25570 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:34.710776 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b98c8-e177-447a-b6ce-2e80d0d25570 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:34.715580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e450375-ea47-45bb-b7f5-15fd6daa46c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:34.716202 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e450375-ea47-45bb-b7f5-15fd6daa46c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:34.716482 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e450375-ea47-45bb-b7f5-15fd6daa46c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:34.716789 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e450375-ea47-45bb-b7f5-15fd6daa46c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:34.717483 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e450375-ea47-45bb-b7f5-15fd6daa46c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:34.719433 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e450375-ea47-45bb-b7f5-15fd6daa46c2 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:34.833312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1198/2448] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:26:34 2022] POST /identity/v3/projects => generated 374 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:26:34.834421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3a659-5eeb-4035-8b9d-48a2c91286f5 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:34.846671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3a659-5eeb-4035-8b9d-48a2c91286f5 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:34.903329 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f41cfd-b21f-4ef7-ad1d-3c92e8f001ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:34.903969 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f41cfd-b21f-4ef7-ad1d-3c92e8f001ce admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:34.904252 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f41cfd-b21f-4ef7-ad1d-3c92e8f001ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:34.904524 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f41cfd-b21f-4ef7-ad1d-3c92e8f001ce admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:34.905237 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f41cfd-b21f-4ef7-ad1d-3c92e8f001ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:34.907144 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f41cfd-b21f-4ef7-ad1d-3c92e8f001ce admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:35.013952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1251/2449] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:26:34 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:26:35.015353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e450375-ea47-45bb-b7f5-15fd6daa46c2 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:35.025893 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e450375-ea47-45bb-b7f5-15fd6daa46c2 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:35.030732 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db727b-3311-4372-a4c4-64f7549a0b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:35.031349 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db727b-3311-4372-a4c4-64f7549a0b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:35.031632 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db727b-3311-4372-a4c4-64f7549a0b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:35.031908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db727b-3311-4372-a4c4-64f7549a0b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:35.032627 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db727b-3311-4372-a4c4-64f7549a0b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:35.034261 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db727b-3311-4372-a4c4-64f7549a0b71 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:35.045378 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1199/2450] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:26:35 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:26:35.049481 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f41cfd-b21f-4ef7-ad1d-3c92e8f001ce admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:35.064563 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f41cfd-b21f-4ef7-ad1d-3c92e8f001ce admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:35.069547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe7c70-a47c-49df-a4c4-5f3069c4878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:35.070200 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe7c70-a47c-49df-a4c4-5f3069c4878f admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:35.070483 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe7c70-a47c-49df-a4c4-5f3069c4878f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:35.070756 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe7c70-a47c-49df-a4c4-5f3069c4878f admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:35.071444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe7c70-a47c-49df-a4c4-5f3069c4878f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:35.076917 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe7c70-a47c-49df-a4c4-5f3069c4878f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:35.088493 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1252/2451] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:26:35 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:26:35.092694 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db727b-3311-4372-a4c4-64f7549a0b71 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:35.104045 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db727b-3311-4372-a4c4-64f7549a0b71 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:35.109054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa9d75-a26f-4002-a16f-82cfbe43279c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:35.109718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa9d75-a26f-4002-a16f-82cfbe43279c admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:35.109999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa9d75-a26f-4002-a16f-82cfbe43279c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:35.110272 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa9d75-a26f-4002-a16f-82cfbe43279c admin admin] PATH_INFO: `/v3/projects/61e408d4206a4f0cb19e409d49d1a210/users/c5e540b13bd84385b9332bfe10e30a92/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:35.126759 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa9d75-a26f-4002-a16f-82cfbe43279c admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e408d4206a4f0cb19e409d49d1a210, user_id=c5e540b13bd84385b9332bfe10e30a92, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:35.129552 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa9d75-a26f-4002-a16f-82cfbe43279c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:35.232404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1200/2452] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:26:35 2022] PUT /identity/v3/projects/61e408d4206a4f0cb19e409d49d1a210/users/c5e540b13bd84385b9332bfe10e30a92/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:26:35.237501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ef5e2-d462-4c13-be4b-b914734f04f4 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:35.237946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ef5e2-d462-4c13-be4b-b914734f04f4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:35.238227 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ef5e2-d462-4c13-be4b-b914734f04f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:35.257945 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d55ef5e2-d462-4c13-be4b-b914734f04f4 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:35.259144 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d55ef5e2-d462-4c13-be4b-b914734f04f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:35.311950 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70bd24-5190-4c23-9ebb-56907f6bed0c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:35.312264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70bd24-5190-4c23-9ebb-56907f6bed0c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:35.312545 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70bd24-5190-4c23-9ebb-56907f6bed0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:35.325175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1253/2453] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:26:35.332411 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-0d70bd24-5190-4c23-9ebb-56907f6bed0c None None] MFA Rules not processed for user `02af03095e48472d96a995a530e78035`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:35.333664 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0d70bd24-5190-4c23-9ebb-56907f6bed0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:35.334986 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ef5e2-d462-4c13-be4b-b914734f04f4 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:35.336295 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d55ef5e2-d462-4c13-be4b-b914734f04f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:35.391719 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1201/2454] 10.222.0.141 () {58 vars in 1014 bytes} [Tue Jul 26 16:26:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:26:35.396131 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ef5e2-d462-4c13-be4b-b914734f04f4 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:35.400687 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172333f-63f8-4494-9e8c-980edc7a1c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:35.401324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172333f-63f8-4494-9e8c-980edc7a1c22 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:35.401638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172333f-63f8-4494-9e8c-980edc7a1c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:35.401915 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172333f-63f8-4494-9e8c-980edc7a1c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:35.404406 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70bd24-5190-4c23-9ebb-56907f6bed0c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:35.405885 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0d70bd24-5190-4c23-9ebb-56907f6bed0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:35.418394 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172333f-63f8-4494-9e8c-980edc7a1c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:35.420258 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172333f-63f8-4494-9e8c-980edc7a1c22 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:35.430319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1254/2455] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:26:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:26:35.459896 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:26:35.478685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70bd24-5190-4c23-9ebb-56907f6bed0c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:35.484093 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8815f-788d-40d3-b23e-4acc68de422c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c5f92f21868436a99a5c7aaa1fc40b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:35.484734 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8815f-788d-40d3-b23e-4acc68de422c service swift] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:35.487968 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8815f-788d-40d3-b23e-4acc68de422c service swift] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:35.487968 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8815f-788d-40d3-b23e-4acc68de422c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:35.493293 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8815f-788d-40d3-b23e-4acc68de422c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:35.494911 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8815f-788d-40d3-b23e-4acc68de422c service swift] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:35.502782 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1202/2456] 10.222.0.141 () {60 vars in 1389 bytes} [Tue Jul 26 16:26:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 16:26:36.075082 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fe13e-bbc2-4136-82fd-1c7f5097984e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:36.075476 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fe13e-bbc2-4136-82fd-1c7f5097984e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:36.075780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fe13e-bbc2-4136-82fd-1c7f5097984e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:36.097101 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-7e2fe13e-bbc2-4136-82fd-1c7f5097984e None None] MFA Rules not processed for user `02af03095e48472d96a995a530e78035`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:36.098342 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7e2fe13e-bbc2-4136-82fd-1c7f5097984e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:36.105994 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1255/2457] 10.222.0.141 () {58 vars in 972 bytes} [Tue Jul 26 16:26:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:26:36.119718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8815f-788d-40d3-b23e-4acc68de422c service swift] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:36.126884 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110858e-0d3d-4a37-87ab-f2a1988650a2 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:36.127135 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110858e-0d3d-4a37-87ab-f2a1988650a2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:36.127436 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110858e-0d3d-4a37-87ab-f2a1988650a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:36.130552 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8815f-788d-40d3-b23e-4acc68de422c service swift] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:36.136519 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f2ac6-45f4-4d03-b000-d322ea52ba60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c5f92f21868436a99a5c7aaa1fc40b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:36.137243 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f2ac6-45f4-4d03-b000-d322ea52ba60 service swift] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:36.137633 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f2ac6-45f4-4d03-b000-d322ea52ba60 service swift] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:36.137991 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f2ac6-45f4-4d03-b000-d322ea52ba60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:36.142817 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:26:36.146743 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f2ac6-45f4-4d03-b000-d322ea52ba60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:36.148357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f2ac6-45f4-4d03-b000-d322ea52ba60 service swift] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:36.149211 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-9110858e-0d3d-4a37-87ab-f2a1988650a2 None None] MFA Rules not processed for user `a0a9e30da2bd4698abcff2bc5c4aba70`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:36.150464 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9110858e-0d3d-4a37-87ab-f2a1988650a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:36.156776 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1203/2458] 10.222.0.141 () {60 vars in 1389 bytes} [Tue Jul 26 16:26:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 16:26:36.208265 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1256/2459] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:26:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:26:39.182105 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f2ac6-45f4-4d03-b000-d322ea52ba60 service swift] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:39.184315 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1f9f2ac6-45f4-4d03-b000-d322ea52ba60 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:39.200996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f2ac6-45f4-4d03-b000-d322ea52ba60 service swift] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:39.208187 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa32f1d-612b-4f35-a141-4ed5f9bb95f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:39.209738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa32f1d-612b-4f35-a141-4ed5f9bb95f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:39.210207 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa32f1d-612b-4f35-a141-4ed5f9bb95f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:39.211213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa32f1d-612b-4f35-a141-4ed5f9bb95f8 admin admin] PATH_INFO: `/v3/users/21bec37f664d40239aefc31e279d97d7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:39.213943 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa32f1d-612b-4f35-a141-4ed5f9bb95f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21bec37f664d40239aefc31e279d97d7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:39.216886 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa32f1d-612b-4f35-a141-4ed5f9bb95f8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:39.585502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9fa32f1d-612b-4f35-a141-4ed5f9bb95f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21bec37f664d40239aefc31e279d97d7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:39.586553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9fa32f1d-612b-4f35-a141-4ed5f9bb95f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21bec37f664d40239aefc31e279d97d7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:39.609560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9fa32f1d-612b-4f35-a141-4ed5f9bb95f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21bec37f664d40239aefc31e279d97d7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:39.621236 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9fa32f1d-612b-4f35-a141-4ed5f9bb95f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21bec37f664d40239aefc31e279d97d7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:39.691928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9fa32f1d-612b-4f35-a141-4ed5f9bb95f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21bec37f664d40239aefc31e279d97d7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:39.710961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ae447-5914-4f8f-b59f-0bc7c8c53a54 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:39.711919 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ae447-5914-4f8f-b59f-0bc7c8c53a54 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:39.712380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ae447-5914-4f8f-b59f-0bc7c8c53a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:39.715620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1204/2460] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:26:39 2022] DELETE /identity/v3/users/21bec37f664d40239aefc31e279d97d7 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:26:39.733928 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-525ae447-5914-4f8f-b59f-0bc7c8c53a54 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:39.735475 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-525ae447-5914-4f8f-b59f-0bc7c8c53a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:39.856473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1257/2461] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:26:39.876151 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa32f1d-612b-4f35-a141-4ed5f9bb95f8 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:39.881624 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9fa32f1d-612b-4f35-a141-4ed5f9bb95f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:40.012119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa32f1d-612b-4f35-a141-4ed5f9bb95f8 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:40.018756 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056e30c-c43a-4c61-b534-b2ad41c017c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:40.020264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056e30c-c43a-4c61-b534-b2ad41c017c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:40.020556 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056e30c-c43a-4c61-b534-b2ad41c017c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:40.020888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056e30c-c43a-4c61-b534-b2ad41c017c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:40.037478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056e30c-c43a-4c61-b534-b2ad41c017c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:40.039646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056e30c-c43a-4c61-b534-b2ad41c017c5 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:40.053445 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1205/2462] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:26:41.005110 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ae447-5914-4f8f-b59f-0bc7c8c53a54 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:41.006326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-525ae447-5914-4f8f-b59f-0bc7c8c53a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:41.023891 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ae447-5914-4f8f-b59f-0bc7c8c53a54 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:41.030645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88803f5-d214-4d83-8275-765b37168e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:41.031563 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88803f5-d214-4d83-8275-765b37168e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:41.031937 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88803f5-d214-4d83-8275-765b37168e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:41.032696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88803f5-d214-4d83-8275-765b37168e28 admin admin] PATH_INFO: `/v3/projects/5eb1965cbb2b4ee9be24e03e67e04d36` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:41.036206 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88803f5-d214-4d83-8275-765b37168e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb1965cbb2b4ee9be24e03e67e04d36)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:41.039126 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88803f5-d214-4d83-8275-765b37168e28 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:41.193869 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e88803f5-d214-4d83-8275-765b37168e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb1965cbb2b4ee9be24e03e67e04d36', 'request_id': 'req-e88803f5-d214-4d83-8275-765b37168e28'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:41.202362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e88803f5-d214-4d83-8275-765b37168e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb1965cbb2b4ee9be24e03e67e04d36', 'request_id': 'req-e88803f5-d214-4d83-8275-765b37168e28'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:41.212770 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e88803f5-d214-4d83-8275-765b37168e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb1965cbb2b4ee9be24e03e67e04d36', 'request_id': 'req-e88803f5-d214-4d83-8275-765b37168e28'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:41.358782 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e88803f5-d214-4d83-8275-765b37168e28 admin admin] The token cache is being invalidate because project 5eb1965cbb2b4ee9be24e03e67e04d36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:26:41.359144 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e88803f5-d214-4d83-8275-765b37168e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:41.359912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e88803f5-d214-4d83-8275-765b37168e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:26:41.370787 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1258/2463] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:26:41 2022] DELETE /identity/v3/projects/5eb1965cbb2b4ee9be24e03e67e04d36 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:26:41.994417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536bcec-8f80-424a-8bd4-6f22b8caad32 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:41.994997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536bcec-8f80-424a-8bd4-6f22b8caad32 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:41.994997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536bcec-8f80-424a-8bd4-6f22b8caad32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:42.032302 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e536bcec-8f80-424a-8bd4-6f22b8caad32 None None] MFA Rules not processed for user `c5e540b13bd84385b9332bfe10e30a92`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:42.033805 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e536bcec-8f80-424a-8bd4-6f22b8caad32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:42.101033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:26:42.149147 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1206/2464] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:26:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:26:42.154725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88803f5-d214-4d83-8275-765b37168e28 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:42.156333 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e88803f5-d214-4d83-8275-765b37168e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:42.211715 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:26:42.239890 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88803f5-d214-4d83-8275-765b37168e28 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:42.245102 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1200ea2-c603-441b-bb31-084b41416508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:42.245739 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1200ea2-c603-441b-bb31-084b41416508 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:42.246069 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1200ea2-c603-441b-bb31-084b41416508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:42.246336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1200ea2-c603-441b-bb31-084b41416508 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:42.246942 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1200ea2-c603-441b-bb31-084b41416508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:42.248996 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1200ea2-c603-441b-bb31-084b41416508 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:42.419697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1259/2465] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:26:42 2022] POST /identity/v3/projects => generated 372 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:26:42.423854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536bcec-8f80-424a-8bd4-6f22b8caad32 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:42.436590 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536bcec-8f80-424a-8bd4-6f22b8caad32 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:42.515931 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea93d6a-6468-43b0-834a-48fcc98d8d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:42.516636 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea93d6a-6468-43b0-834a-48fcc98d8d03 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:42.517019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea93d6a-6468-43b0-834a-48fcc98d8d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:42.517418 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea93d6a-6468-43b0-834a-48fcc98d8d03 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:42.518176 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea93d6a-6468-43b0-834a-48fcc98d8d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:42.520413 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea93d6a-6468-43b0-834a-48fcc98d8d03 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:42.628542 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1207/2466] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:26:42 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:26:42.629777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1200ea2-c603-441b-bb31-084b41416508 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:42.640735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1200ea2-c603-441b-bb31-084b41416508 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:42.645392 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe747d7-1e1a-4d1c-a068-8659a10ae579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:42.645998 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe747d7-1e1a-4d1c-a068-8659a10ae579 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:42.646277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe747d7-1e1a-4d1c-a068-8659a10ae579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:42.646548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe747d7-1e1a-4d1c-a068-8659a10ae579 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:42.647231 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe747d7-1e1a-4d1c-a068-8659a10ae579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:42.648904 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe747d7-1e1a-4d1c-a068-8659a10ae579 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:42.660212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1260/2467] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:26:42 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:26:42.664416 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea93d6a-6468-43b0-834a-48fcc98d8d03 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:42.675457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea93d6a-6468-43b0-834a-48fcc98d8d03 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:42.681392 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f1257-e4ed-4aea-9bb7-2865e2d87080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:42.686827 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f1257-e4ed-4aea-9bb7-2865e2d87080 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:42.686827 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f1257-e4ed-4aea-9bb7-2865e2d87080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:42.686827 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f1257-e4ed-4aea-9bb7-2865e2d87080 admin admin] PATH_INFO: `/v3/projects/071693c97e8f44e5ad07ead404f83884/users/e8c36ee011894790bc29d6db6774ec0d/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:42.700842 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f1257-e4ed-4aea-9bb7-2865e2d87080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=071693c97e8f44e5ad07ead404f83884, user_id=e8c36ee011894790bc29d6db6774ec0d, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:42.703837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f1257-e4ed-4aea-9bb7-2865e2d87080 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:42.807680 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1208/2468] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:26:42 2022] PUT /identity/v3/projects/071693c97e8f44e5ad07ead404f83884/users/e8c36ee011894790bc29d6db6774ec0d/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:26:42.808748 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe747d7-1e1a-4d1c-a068-8659a10ae579 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:42.822202 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe747d7-1e1a-4d1c-a068-8659a10ae579 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:42.906017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f2057-f5ae-4453-9d28-95a144d7f9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:42.906894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f2057-f5ae-4453-9d28-95a144d7f9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:42.907030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f2057-f5ae-4453-9d28-95a144d7f9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:42.907249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f2057-f5ae-4453-9d28-95a144d7f9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:42.908267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f2057-f5ae-4453-9d28-95a144d7f9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:42.910251 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f2057-f5ae-4453-9d28-95a144d7f9a1 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:42.941204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1261/2469] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:26:42 2022] GET /identity/v3/roles => generated 1427 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:26:42.944596 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f1257-e4ed-4aea-9bb7-2865e2d87080 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:42.969029 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f1257-e4ed-4aea-9bb7-2865e2d87080 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:42.976509 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4612399-0b18-427e-af45-8e789e4c9653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:42.977568 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4612399-0b18-427e-af45-8e789e4c9653 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:42.977900 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4612399-0b18-427e-af45-8e789e4c9653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:42.978180 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4612399-0b18-427e-af45-8e789e4c9653 admin admin] PATH_INFO: `/v3/projects/071693c97e8f44e5ad07ead404f83884/users/e8c36ee011894790bc29d6db6774ec0d/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:42.981319 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4612399-0b18-427e-af45-8e789e4c9653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=071693c97e8f44e5ad07ead404f83884, user_id=e8c36ee011894790bc29d6db6774ec0d, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:42.985698 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4612399-0b18-427e-af45-8e789e4c9653 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:43.004870 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1209/2470] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:26:42 2022] PUT /identity/v3/projects/071693c97e8f44e5ad07ead404f83884/users/e8c36ee011894790bc29d6db6774ec0d/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:26:49.525746 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386caa0-9a2c-474e-8283-5b17b4458abb None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:49.526243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386caa0-9a2c-474e-8283-5b17b4458abb None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:49.526430 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386caa0-9a2c-474e-8283-5b17b4458abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:49.687758 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-e386caa0-9a2c-474e-8283-5b17b4458abb None None] MFA Rules not processed for user `e8c36ee011894790bc29d6db6774ec0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:49.689023 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e386caa0-9a2c-474e-8283-5b17b4458abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:49.762990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1262/2471] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:26:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:26:49.776406 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4612399-0b18-427e-af45-8e789e4c9653 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:49.778295 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a4612399-0b18-427e-af45-8e789e4c9653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:49.862730 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4612399-0b18-427e-af45-8e789e4c9653 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:49.869343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b1dc7-d52e-4002-946a-41b0d73d5506 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:49.869972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b1dc7-d52e-4002-946a-41b0d73d5506 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:49.870253 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b1dc7-d52e-4002-946a-41b0d73d5506 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:49.870527 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b1dc7-d52e-4002-946a-41b0d73d5506 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:49.890958 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:26:49.939123 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b1dc7-d52e-4002-946a-41b0d73d5506 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:49.941023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b1dc7-d52e-4002-946a-41b0d73d5506 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:49.952736 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1210/2472] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:26:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:26:52.608239 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b3281-fe9f-4de3-ad64-8687f49c6a11 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:52.608239 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b3281-fe9f-4de3-ad64-8687f49c6a11 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:52.608239 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b3281-fe9f-4de3-ad64-8687f49c6a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:52.632901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-bc3b3281-fe9f-4de3-ad64-8687f49c6a11 None None] MFA Rules not processed for user `c5e540b13bd84385b9332bfe10e30a92`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:52.636946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-bc3b3281-fe9f-4de3-ad64-8687f49c6a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:52.646100 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1263/2473] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:26:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:26:55.441235 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7fa6f-717c-4e03-8b86-2e6648e184b4 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:55.441235 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7fa6f-717c-4e03-8b86-2e6648e184b4 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:55.441235 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7fa6f-717c-4e03-8b86-2e6648e184b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:55.457825 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-5be7fa6f-717c-4e03-8b86-2e6648e184b4 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:55.459038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5be7fa6f-717c-4e03-8b86-2e6648e184b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:55.522462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1211/2474] 10.222.0.39 () {58 vars in 1020 bytes} [Tue Jul 26 16:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:26:55.537185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b3281-fe9f-4de3-ad64-8687f49c6a11 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:55.550084 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b3281-fe9f-4de3-ad64-8687f49c6a11 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:55.555986 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e762e10-0bb3-49bc-b790-4645a24b5e06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:55.556597 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e762e10-0bb3-49bc-b790-4645a24b5e06 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:55.556949 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e762e10-0bb3-49bc-b790-4645a24b5e06 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:55.557228 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e762e10-0bb3-49bc-b790-4645a24b5e06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:55.565526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e762e10-0bb3-49bc-b790-4645a24b5e06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:55.567096 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e762e10-0bb3-49bc-b790-4645a24b5e06 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:55.577222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1264/2475] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:26:58.931564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fc881-2aea-4818-8b32-77678a95a4d0 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:58.932016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fc881-2aea-4818-8b32-77678a95a4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:58.932094 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fc881-2aea-4818-8b32-77678a95a4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:58.952886 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b35fc881-2aea-4818-8b32-77678a95a4d0 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:26:58.956550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b35fc881-2aea-4818-8b32-77678a95a4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:26:58.962076 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1212/2476] 10.222.0.39 () {58 vars in 1020 bytes} [Tue Jul 26 16:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:26:58.978313 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e762e10-0bb3-49bc-b790-4645a24b5e06 service nova] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:26:58.990346 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e762e10-0bb3-49bc-b790-4645a24b5e06 service nova] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:26:58.996942 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd69d81-f313-4484-9174-12c8b1562f90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:26:58.997553 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd69d81-f313-4484-9174-12c8b1562f90 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:26:58.997860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd69d81-f313-4484-9174-12c8b1562f90 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:26:58.998133 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd69d81-f313-4484-9174-12c8b1562f90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:26:59.009802 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd69d81-f313-4484-9174-12c8b1562f90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:26:59.011538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd69d81-f313-4484-9174-12c8b1562f90 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:26:59.016123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:26:59.023375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1265/2477] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:26:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:27:01.800381 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3975094-53b8-4a11-b787-2e66ee1c0028 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:27:01.800914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3975094-53b8-4a11-b787-2e66ee1c0028 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:27:01.801092 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3975094-53b8-4a11-b787-2e66ee1c0028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:27:01.821997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-f3975094-53b8-4a11-b787-2e66ee1c0028 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:27:01.822562 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f3975094-53b8-4a11-b787-2e66ee1c0028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:27:01.830725 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1213/2478] 10.222.0.39 () {58 vars in 1020 bytes} [Tue Jul 26 16:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:27:01.848226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd69d81-f313-4484-9174-12c8b1562f90 service nova] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:27:01.849693 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2fd69d81-f313-4484-9174-12c8b1562f90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:27:01.864441 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd69d81-f313-4484-9174-12c8b1562f90 service nova] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:27:01.870535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58778b-b8db-4306-afa8-2253cbe24d68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:27:01.871143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58778b-b8db-4306-afa8-2253cbe24d68 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:27:01.871423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58778b-b8db-4306-afa8-2253cbe24d68 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:27:01.871695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58778b-b8db-4306-afa8-2253cbe24d68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:27:01.879877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58778b-b8db-4306-afa8-2253cbe24d68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:27:01.881482 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58778b-b8db-4306-afa8-2253cbe24d68 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:27:01.890684 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1266/2479] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:27:07.059475 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c32b9-eaa4-432d-b716-361821d887a7 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:27:07.059956 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c32b9-eaa4-432d-b716-361821d887a7 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:27:07.060068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c32b9-eaa4-432d-b716-361821d887a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:27:07.083979 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-fa9c32b9-eaa4-432d-b716-361821d887a7 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:27:07.087104 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fa9c32b9-eaa4-432d-b716-361821d887a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:27:07.095980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1214/2480] 10.222.0.39 () {58 vars in 1020 bytes} [Tue Jul 26 16:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:27:07.114222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58778b-b8db-4306-afa8-2253cbe24d68 service nova] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:27:07.127826 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58778b-b8db-4306-afa8-2253cbe24d68 service nova] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:27:07.134309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8c027-9ba2-404e-b7c5-c26436e0094c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:27:07.135054 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8c027-9ba2-404e-b7c5-c26436e0094c service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:27:07.135471 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8c027-9ba2-404e-b7c5-c26436e0094c service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:27:07.135754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8c027-9ba2-404e-b7c5-c26436e0094c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:27:07.145115 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8c027-9ba2-404e-b7c5-c26436e0094c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:27:07.146784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8c027-9ba2-404e-b7c5-c26436e0094c service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:27:07.164605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1267/2481] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:27:09.894879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417e5bd-20ba-4c03-8c6b-e11979a46872 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:27:09.895427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417e5bd-20ba-4c03-8c6b-e11979a46872 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:27:09.895570 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417e5bd-20ba-4c03-8c6b-e11979a46872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:27:09.915386 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e417e5bd-20ba-4c03-8c6b-e11979a46872 None None] MFA Rules not processed for user `b867401639e74527adb079981496b19f`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:27:09.917015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e417e5bd-20ba-4c03-8c6b-e11979a46872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:27:09.982341 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1215/2482] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:27:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:27:12.434904 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c894431-e242-44a6-bb62-9957e9551e84 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:27:12.435473 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c894431-e242-44a6-bb62-9957e9551e84 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:27:12.435605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c894431-e242-44a6-bb62-9957e9551e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:27:12.460520 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2c894431-e242-44a6-bb62-9957e9551e84 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:27:12.461871 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2c894431-e242-44a6-bb62-9957e9551e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:27:12.470575 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1268/2483] 10.222.0.39 () {58 vars in 1020 bytes} [Tue Jul 26 16:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:27:12.485470 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417e5bd-20ba-4c03-8c6b-e11979a46872 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:27:12.499125 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417e5bd-20ba-4c03-8c6b-e11979a46872 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:27:12.504725 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c26db2-00d3-4c2e-ad2f-97cb471952b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:27:12.505309 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c26db2-00d3-4c2e-ad2f-97cb471952b2 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:27:12.505592 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c26db2-00d3-4c2e-ad2f-97cb471952b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:27:12.505867 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c26db2-00d3-4c2e-ad2f-97cb471952b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:27:12.514308 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c26db2-00d3-4c2e-ad2f-97cb471952b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:27:12.515892 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c26db2-00d3-4c2e-ad2f-97cb471952b2 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:27:12.525506 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1216/2484] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:27:13.427044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fedded-be85-4072-9d53-58ae5365f633 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:27:13.427337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fedded-be85-4072-9d53-58ae5365f633 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:27:13.427672 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fedded-be85-4072-9d53-58ae5365f633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:27:13.450702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a8fedded-be85-4072-9d53-58ae5365f633 None None] MFA Rules not processed for user `ab89e3033bb949dfb468c2013bc6b096`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:27:13.451937 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a8fedded-be85-4072-9d53-58ae5365f633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:27:13.506692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1269/2485] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:27:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:27:22.521111 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=85 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:27:23.499879 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=41 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:27:30.381143 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759d162-a29a-4c75-ac17-8d0900d95698 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:27:30.381637 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759d162-a29a-4c75-ac17-8d0900d95698 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:27:30.381719 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759d162-a29a-4c75-ac17-8d0900d95698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:27:30.405419 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8759d162-a29a-4c75-ac17-8d0900d95698 None None] MFA Rules not processed for user `2e75b38158404b298375fab5234851b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:27:30.405419 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8759d162-a29a-4c75-ac17-8d0900d95698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:27:30.458287 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1217/2486] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:27:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:27:33.223574 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fedded-be85-4072-9d53-58ae5365f633 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:27:33.225019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a8fedded-be85-4072-9d53-58ae5365f633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:27:33.284770 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fedded-be85-4072-9d53-58ae5365f633 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:27:33.288212 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2b5eb-231d-4a62-86ef-9266752ac099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:27:33.288868 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2b5eb-231d-4a62-86ef-9266752ac099 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:27:33.289150 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2b5eb-231d-4a62-86ef-9266752ac099 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:27:33.289426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2b5eb-231d-4a62-86ef-9266752ac099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:27:33.299386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2b5eb-231d-4a62-86ef-9266752ac099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:27:33.301023 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2b5eb-231d-4a62-86ef-9266752ac099 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:27:33.310832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1270/2487] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:27:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:27:40.451656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=25 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:27:43.306496 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=26 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:27:50.159038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759d162-a29a-4c75-ac17-8d0900d95698 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:27:50.161376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8759d162-a29a-4c75-ac17-8d0900d95698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:27:50.177051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759d162-a29a-4c75-ac17-8d0900d95698 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:27:50.187511 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa778715-5af7-4ea0-8f33-fc8b1f004a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:27:50.188203 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa778715-5af7-4ea0-8f33-fc8b1f004a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:27:50.188478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa778715-5af7-4ea0-8f33-fc8b1f004a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:27:50.188804 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa778715-5af7-4ea0-8f33-fc8b1f004a3e admin admin] PATH_INFO: `/v3/users/a0a9e30da2bd4698abcff2bc5c4aba70` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:27:50.190163 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa778715-5af7-4ea0-8f33-fc8b1f004a3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a9e30da2bd4698abcff2bc5c4aba70)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:27:50.192114 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa778715-5af7-4ea0-8f33-fc8b1f004a3e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:27:50.467053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-aa778715-5af7-4ea0-8f33-fc8b1f004a3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a9e30da2bd4698abcff2bc5c4aba70'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:27:50.467740 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-aa778715-5af7-4ea0-8f33-fc8b1f004a3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a9e30da2bd4698abcff2bc5c4aba70'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:27:50.479738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-aa778715-5af7-4ea0-8f33-fc8b1f004a3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a9e30da2bd4698abcff2bc5c4aba70'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:27:50.486708 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-aa778715-5af7-4ea0-8f33-fc8b1f004a3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a9e30da2bd4698abcff2bc5c4aba70'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:27:50.589763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-aa778715-5af7-4ea0-8f33-fc8b1f004a3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a9e30da2bd4698abcff2bc5c4aba70'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:27:50.596965 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1218/2488] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:27:50 2022] DELETE /identity/v3/users/a0a9e30da2bd4698abcff2bc5c4aba70 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:27:50.882742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2b5eb-231d-4a62-86ef-9266752ac099 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:27:50.893895 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2b5eb-231d-4a62-86ef-9266752ac099 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:27:50.958957 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a40ea-3ece-421c-81c5-67d8bcebfb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:27:50.959596 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a40ea-3ece-421c-81c5-67d8bcebfb0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:27:50.959875 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a40ea-3ece-421c-81c5-67d8bcebfb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:27:50.960146 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a40ea-3ece-421c-81c5-67d8bcebfb0f admin admin] PATH_INFO: `/v3/projects/655175878a7f460f8390382b16a23c88` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:27:50.961337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a40ea-3ece-421c-81c5-67d8bcebfb0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=655175878a7f460f8390382b16a23c88)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:27:50.963235 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a40ea-3ece-421c-81c5-67d8bcebfb0f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:27:51.108049 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7d4a40ea-3ece-421c-81c5-67d8bcebfb0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '655175878a7f460f8390382b16a23c88', 'request_id': 'req-7d4a40ea-3ece-421c-81c5-67d8bcebfb0f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:27:51.114248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7d4a40ea-3ece-421c-81c5-67d8bcebfb0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '655175878a7f460f8390382b16a23c88', 'request_id': 'req-7d4a40ea-3ece-421c-81c5-67d8bcebfb0f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:27:51.119940 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7d4a40ea-3ece-421c-81c5-67d8bcebfb0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '655175878a7f460f8390382b16a23c88', 'request_id': 'req-7d4a40ea-3ece-421c-81c5-67d8bcebfb0f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:27:51.191667 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7d4a40ea-3ece-421c-81c5-67d8bcebfb0f admin admin] The token cache is being invalidate because project 655175878a7f460f8390382b16a23c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:27:51.191947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7d4a40ea-3ece-421c-81c5-67d8bcebfb0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:27:51.192562 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7d4a40ea-3ece-421c-81c5-67d8bcebfb0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:27:51.194093 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1271/2489] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:27:50 2022] DELETE /identity/v3/projects/655175878a7f460f8390382b16a23c88 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:28:00.593198 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:28:01.188604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:28:13.627174 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa778715-5af7-4ea0-8f33-fc8b1f004a3e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:28:13.628720 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-aa778715-5af7-4ea0-8f33-fc8b1f004a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:13.688791 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa778715-5af7-4ea0-8f33-fc8b1f004a3e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:28:13.741843 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae33b95-561f-426a-be1a-16ed5290111f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:28:13.742465 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae33b95-561f-426a-be1a-16ed5290111f service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:13.742750 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae33b95-561f-426a-be1a-16ed5290111f service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:13.743092 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae33b95-561f-426a-be1a-16ed5290111f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:13.745027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5ae33b95-561f-426a-be1a-16ed5290111f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:13.821195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae33b95-561f-426a-be1a-16ed5290111f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:28:13.822869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae33b95-561f-426a-be1a-16ed5290111f service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:28:13.835521 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1219/2490] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:28:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:28:15.018121 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a40ea-3ece-421c-81c5-67d8bcebfb0f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:28:15.019565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7d4a40ea-3ece-421c-81c5-67d8bcebfb0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:15.031708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a40ea-3ece-421c-81c5-67d8bcebfb0f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:28:15.035222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553976f-56b8-4aac-9f44-84d7606932bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:28:15.035821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553976f-56b8-4aac-9f44-84d7606932bf service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:15.036095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553976f-56b8-4aac-9f44-84d7606932bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:15.036365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553976f-56b8-4aac-9f44-84d7606932bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:15.038091 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1553976f-56b8-4aac-9f44-84d7606932bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:15.051941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553976f-56b8-4aac-9f44-84d7606932bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:28:15.053433 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553976f-56b8-4aac-9f44-84d7606932bf service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:28:15.065065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1272/2491] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:28:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:28:19.652049 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae33b95-561f-426a-be1a-16ed5290111f service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:28:19.653560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5ae33b95-561f-426a-be1a-16ed5290111f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:19.667542 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae33b95-561f-426a-be1a-16ed5290111f service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:28:19.672067 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ca3dd-a441-4f4f-88c2-f6efbe57652b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:28:19.672709 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ca3dd-a441-4f4f-88c2-f6efbe57652b service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:19.672997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ca3dd-a441-4f4f-88c2-f6efbe57652b service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:19.673274 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ca3dd-a441-4f4f-88c2-f6efbe57652b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:19.675003 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ad1ca3dd-a441-4f4f-88c2-f6efbe57652b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:19.729256 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:28:19.745563 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ca3dd-a441-4f4f-88c2-f6efbe57652b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:28:19.747145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ca3dd-a441-4f4f-88c2-f6efbe57652b service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:28:19.758030 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1220/2492] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:28:23.701689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553976f-56b8-4aac-9f44-84d7606932bf service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:28:23.703119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1553976f-56b8-4aac-9f44-84d7606932bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:23.718612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553976f-56b8-4aac-9f44-84d7606932bf service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:28:23.723104 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3952a-a272-487c-b780-39db26456f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:28:23.724016 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3952a-a272-487c-b780-39db26456f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:23.724016 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3952a-a272-487c-b780-39db26456f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:23.724290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3952a-a272-487c-b780-39db26456f2b admin admin] PATH_INFO: `/v3/users/b867401639e74527adb079981496b19f` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:23.725468 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3952a-a272-487c-b780-39db26456f2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b867401639e74527adb079981496b19f)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:28:23.727357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3952a-a272-487c-b780-39db26456f2b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:28:23.901494 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4ac3952a-a272-487c-b780-39db26456f2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b867401639e74527adb079981496b19f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:28:23.902349 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4ac3952a-a272-487c-b780-39db26456f2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b867401639e74527adb079981496b19f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:28:24.001143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4ac3952a-a272-487c-b780-39db26456f2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b867401639e74527adb079981496b19f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:28:24.013535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4ac3952a-a272-487c-b780-39db26456f2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b867401639e74527adb079981496b19f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:28:24.014167 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4ac3952a-a272-487c-b780-39db26456f2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b867401639e74527adb079981496b19f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:28:24.026033 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1273/2493] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:28:23 2022] DELETE /identity/v3/users/b867401639e74527adb079981496b19f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:28:24.266213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ca3dd-a441-4f4f-88c2-f6efbe57652b service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:28:24.277086 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ca3dd-a441-4f4f-88c2-f6efbe57652b service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:28:24.337604 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f8896-0f16-41d9-bdff-25eec0bfce63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:28:24.338251 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f8896-0f16-41d9-bdff-25eec0bfce63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:24.338530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f8896-0f16-41d9-bdff-25eec0bfce63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:24.338810 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f8896-0f16-41d9-bdff-25eec0bfce63 admin admin] PATH_INFO: `/v3/projects/d4aac3a9e2694d10844c9000c1e34b7e` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:24.340070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f8896-0f16-41d9-bdff-25eec0bfce63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4aac3a9e2694d10844c9000c1e34b7e)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:28:24.342117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f8896-0f16-41d9-bdff-25eec0bfce63 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:28:24.455852 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ba5f8896-0f16-41d9-bdff-25eec0bfce63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4aac3a9e2694d10844c9000c1e34b7e', 'request_id': 'req-ba5f8896-0f16-41d9-bdff-25eec0bfce63'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:28:24.462468 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ba5f8896-0f16-41d9-bdff-25eec0bfce63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4aac3a9e2694d10844c9000c1e34b7e', 'request_id': 'req-ba5f8896-0f16-41d9-bdff-25eec0bfce63'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:28:24.468346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ba5f8896-0f16-41d9-bdff-25eec0bfce63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4aac3a9e2694d10844c9000c1e34b7e', 'request_id': 'req-ba5f8896-0f16-41d9-bdff-25eec0bfce63'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:28:24.612117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ba5f8896-0f16-41d9-bdff-25eec0bfce63 admin admin] The token cache is being invalidate because project d4aac3a9e2694d10844c9000c1e34b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:28:24.612441 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ba5f8896-0f16-41d9-bdff-25eec0bfce63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:28:24.613119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ba5f8896-0f16-41d9-bdff-25eec0bfce63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:28:24.618487 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1221/2494] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:28:24 2022] DELETE /identity/v3/projects/d4aac3a9e2694d10844c9000c1e34b7e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:28:24.619644 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af6063-abd9-4498-90bd-b7dfe5e61781 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:24.620014 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af6063-abd9-4498-90bd-b7dfe5e61781 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:24.620296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af6063-abd9-4498-90bd-b7dfe5e61781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:24.641318 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-80af6063-abd9-4498-90bd-b7dfe5e61781 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:28:24.642478 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-80af6063-abd9-4498-90bd-b7dfe5e61781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:24.704869 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1274/2495] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:28:24.712542 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dad1f5-94f6-4277-85ec-c28ee15bc339 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:24.712863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dad1f5-94f6-4277-85ec-c28ee15bc339 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:24.713144 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dad1f5-94f6-4277-85ec-c28ee15bc339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:24.733348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e5dad1f5-94f6-4277-85ec-c28ee15bc339 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:28:24.734625 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e5dad1f5-94f6-4277-85ec-c28ee15bc339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:24.742819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1222/2496] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:28:24.747523 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af6063-abd9-4498-90bd-b7dfe5e61781 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:28:24.757753 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af6063-abd9-4498-90bd-b7dfe5e61781 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:28:24.762286 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07efd9e-b127-4b6a-8e96-566cffa2cb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:28:24.762871 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07efd9e-b127-4b6a-8e96-566cffa2cb14 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:24.763148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07efd9e-b127-4b6a-8e96-566cffa2cb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:24.764036 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07efd9e-b127-4b6a-8e96-566cffa2cb14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:24.764766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07efd9e-b127-4b6a-8e96-566cffa2cb14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:28:24.765073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07efd9e-b127-4b6a-8e96-566cffa2cb14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:28:24.766665 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07efd9e-b127-4b6a-8e96-566cffa2cb14 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:28:24.778498 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1275/2497] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:28:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:28:24.782970 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dad1f5-94f6-4277-85ec-c28ee15bc339 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:28:24.792366 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dad1f5-94f6-4277-85ec-c28ee15bc339 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:28:24.797915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb857d9-9838-40ce-9c6d-6080229f5cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:28:24.798529 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb857d9-9838-40ce-9c6d-6080229f5cce admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:24.798807 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb857d9-9838-40ce-9c6d-6080229f5cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:24.799105 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb857d9-9838-40ce-9c6d-6080229f5cce admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:24.799763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb857d9-9838-40ce-9c6d-6080229f5cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:28:24.801756 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb857d9-9838-40ce-9c6d-6080229f5cce admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:28:24.908390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1223/2498] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:28:24 2022] POST /identity/v3/projects => generated 386 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:28:24.912933 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07efd9e-b127-4b6a-8e96-566cffa2cb14 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:28:24.924224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07efd9e-b127-4b6a-8e96-566cffa2cb14 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:28:24.974149 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:28:24.988430 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca93ffd-5e19-4161-aa45-f65b97c1aedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:28:24.992207 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca93ffd-5e19-4161-aa45-f65b97c1aedf admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:24.992207 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca93ffd-5e19-4161-aa45-f65b97c1aedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:24.992207 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca93ffd-5e19-4161-aa45-f65b97c1aedf admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:24.992207 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca93ffd-5e19-4161-aa45-f65b97c1aedf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:28:24.992207 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca93ffd-5e19-4161-aa45-f65b97c1aedf admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:28:25.070609 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1276/2499] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:28:24 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:28:25.071843 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb857d9-9838-40ce-9c6d-6080229f5cce admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:28:25.082804 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb857d9-9838-40ce-9c6d-6080229f5cce admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:28:25.087680 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf87996-ca70-489e-9967-ef435b23517c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:28:25.088297 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf87996-ca70-489e-9967-ef435b23517c admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:25.088576 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf87996-ca70-489e-9967-ef435b23517c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:25.088877 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf87996-ca70-489e-9967-ef435b23517c admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:25.089575 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf87996-ca70-489e-9967-ef435b23517c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:28:25.091208 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf87996-ca70-489e-9967-ef435b23517c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:28:25.104917 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1224/2500] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:28:25 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:28:25.106784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca93ffd-5e19-4161-aa45-f65b97c1aedf admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:28:25.118793 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca93ffd-5e19-4161-aa45-f65b97c1aedf admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:28:25.124896 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27338e8-8b1f-4255-9403-91826ce119c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:28:25.125543 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27338e8-8b1f-4255-9403-91826ce119c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:25.125850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27338e8-8b1f-4255-9403-91826ce119c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:25.126123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27338e8-8b1f-4255-9403-91826ce119c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:25.126811 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27338e8-8b1f-4255-9403-91826ce119c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:28:25.128481 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27338e8-8b1f-4255-9403-91826ce119c4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:28:25.143312 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1277/2501] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:28:25 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:28:25.148515 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf87996-ca70-489e-9967-ef435b23517c admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:28:25.155353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf87996-ca70-489e-9967-ef435b23517c admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:28:25.160264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec1c83-9e17-4fa0-a088-1654e7081dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:28:25.160970 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec1c83-9e17-4fa0-a088-1654e7081dad admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:25.161389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec1c83-9e17-4fa0-a088-1654e7081dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:25.161614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec1c83-9e17-4fa0-a088-1654e7081dad admin admin] PATH_INFO: `/v3/projects/63f595fcb1144892a5a741e5d7367b7e/users/8c83c9a2d38e460fb838ffc9f50fea8b/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:25.177816 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec1c83-9e17-4fa0-a088-1654e7081dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f595fcb1144892a5a741e5d7367b7e, user_id=8c83c9a2d38e460fb838ffc9f50fea8b, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:28:25.183553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec1c83-9e17-4fa0-a088-1654e7081dad admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:28:25.243304 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1225/2502] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:28:25 2022] PUT /identity/v3/projects/63f595fcb1144892a5a741e5d7367b7e/users/8c83c9a2d38e460fb838ffc9f50fea8b/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:28:25.248937 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b53e2d-7ca2-46d3-b80d-d857873d12e5 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:25.249226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b53e2d-7ca2-46d3-b80d-d857873d12e5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:25.249505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b53e2d-7ca2-46d3-b80d-d857873d12e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:25.268250 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c7b53e2d-7ca2-46d3-b80d-d857873d12e5 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:28:25.269502 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c7b53e2d-7ca2-46d3-b80d-d857873d12e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:25.331453 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1278/2503] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:28:25.342010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec1c83-9e17-4fa0-a088-1654e7081dad admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:28:25.343785 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-02ec1c83-9e17-4fa0-a088-1654e7081dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:25.364340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:28:25.400997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec1c83-9e17-4fa0-a088-1654e7081dad admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:28:25.405211 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b749c93-b574-4ced-916c-a9d734626b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:28:25.405827 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b749c93-b574-4ced-916c-a9d734626b85 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:25.406105 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b749c93-b574-4ced-916c-a9d734626b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:25.406376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b749c93-b574-4ced-916c-a9d734626b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:25.415301 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b749c93-b574-4ced-916c-a9d734626b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:28:25.416770 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b749c93-b574-4ced-916c-a9d734626b85 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:28:25.427439 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1226/2504] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:28:28.602267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b53e2d-7ca2-46d3-b80d-d857873d12e5 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:28:28.603851 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c7b53e2d-7ca2-46d3-b80d-d857873d12e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:28.707398 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b53e2d-7ca2-46d3-b80d-d857873d12e5 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:28:28.723730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c509070-ec0e-496f-8e00-067e0a15bb02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:28:28.723730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c509070-ec0e-496f-8e00-067e0a15bb02 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:28.723730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c509070-ec0e-496f-8e00-067e0a15bb02 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:28.723730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c509070-ec0e-496f-8e00-067e0a15bb02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:28.724221 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9c509070-ec0e-496f-8e00-067e0a15bb02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:28.791498 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c509070-ec0e-496f-8e00-067e0a15bb02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:28:28.793399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c509070-ec0e-496f-8e00-067e0a15bb02 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:28:28.805321 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1279/2505] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:28:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:28:31.404478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41887feb-701e-4fc9-85de-7b37e681a7ee None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:31.405599 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41887feb-701e-4fc9-85de-7b37e681a7ee None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:31.406047 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41887feb-701e-4fc9-85de-7b37e681a7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:31.437839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-41887feb-701e-4fc9-85de-7b37e681a7ee None None] MFA Rules not processed for user `8c83c9a2d38e460fb838ffc9f50fea8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:28:31.439119 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-41887feb-701e-4fc9-85de-7b37e681a7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:31.519509 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1227/2506] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:28:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:28:31.534938 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c509070-ec0e-496f-8e00-067e0a15bb02 service nova] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:28:31.536421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9c509070-ec0e-496f-8e00-067e0a15bb02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:31.546210 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:28:31.552175 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c509070-ec0e-496f-8e00-067e0a15bb02 service nova] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:28:31.559031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5112e3-984f-46d5-a38b-d14d72e5e9a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:28:31.560415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5112e3-984f-46d5-a38b-d14d72e5e9a3 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:31.560415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5112e3-984f-46d5-a38b-d14d72e5e9a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:31.560415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5112e3-984f-46d5-a38b-d14d72e5e9a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:31.569896 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5112e3-984f-46d5-a38b-d14d72e5e9a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:28:31.571340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5112e3-984f-46d5-a38b-d14d72e5e9a3 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:28:31.583010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1280/2507] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:28:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:28:34.705947 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ad4a1-1600-41ca-83a0-efbcc25c3ace None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:34.706559 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ad4a1-1600-41ca-83a0-efbcc25c3ace None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:34.706559 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ad4a1-1600-41ca-83a0-efbcc25c3ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:34.727751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-663ad4a1-1600-41ca-83a0-efbcc25c3ace None None] MFA Rules not processed for user `8c83c9a2d38e460fb838ffc9f50fea8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:28:34.729068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-663ad4a1-1600-41ca-83a0-efbcc25c3ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:34.738531 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1228/2508] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:28:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:28:35.077609 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5112e3-984f-46d5-a38b-d14d72e5e9a3 service nova] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:28:35.079158 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4e5112e3-984f-46d5-a38b-d14d72e5e9a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:35.091815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5112e3-984f-46d5-a38b-d14d72e5e9a3 service nova] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:28:35.095618 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c712a1c-fa89-48a6-b8ab-f46190382607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:28:35.096247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c712a1c-fa89-48a6-b8ab-f46190382607 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:35.096515 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c712a1c-fa89-48a6-b8ab-f46190382607 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:35.096854 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c712a1c-fa89-48a6-b8ab-f46190382607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:35.100038 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2c712a1c-fa89-48a6-b8ab-f46190382607 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:35.113296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c712a1c-fa89-48a6-b8ab-f46190382607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:28:35.114526 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c712a1c-fa89-48a6-b8ab-f46190382607 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:28:35.123661 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1281/2509] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:28:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:28:35.564745 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ad4a1-1600-41ca-83a0-efbcc25c3ace None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:28:35.566384 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-663ad4a1-1600-41ca-83a0-efbcc25c3ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:35.646819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ad4a1-1600-41ca-83a0-efbcc25c3ace None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:28:35.652381 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64911c44-ff1c-4c24-b79f-1528dbd43aa8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda05b7b9675423e992470819d1c150a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:28:35.653133 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64911c44-ff1c-4c24-b79f-1528dbd43aa8 service placement] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:35.653420 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64911c44-ff1c-4c24-b79f-1528dbd43aa8 service placement] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:35.654242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64911c44-ff1c-4c24-b79f-1528dbd43aa8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:35.656022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-64911c44-ff1c-4c24-b79f-1528dbd43aa8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:35.668236 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64911c44-ff1c-4c24-b79f-1528dbd43aa8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:28:35.670713 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64911c44-ff1c-4c24-b79f-1528dbd43aa8 service placement] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:28:35.681461 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1229/2510] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:28:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:28:35.772773 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c712a1c-fa89-48a6-b8ab-f46190382607 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:28:35.787467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c712a1c-fa89-48a6-b8ab-f46190382607 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:28:35.793118 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705067e5-2ac4-430b-8b6e-d0fcef74271d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:28:35.793809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705067e5-2ac4-430b-8b6e-d0fcef74271d service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:35.794209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705067e5-2ac4-430b-8b6e-d0fcef74271d service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:35.795031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705067e5-2ac4-430b-8b6e-d0fcef74271d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:35.797328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-705067e5-2ac4-430b-8b6e-d0fcef74271d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:35.860748 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705067e5-2ac4-430b-8b6e-d0fcef74271d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:28:35.862340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705067e5-2ac4-430b-8b6e-d0fcef74271d service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:28:35.872199 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1282/2511] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:28:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:28:39.584936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64911c44-ff1c-4c24-b79f-1528dbd43aa8 service placement] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:28:39.597560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64911c44-ff1c-4c24-b79f-1528dbd43aa8 service placement] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:28:39.602309 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7507f1-c69e-4957-be28-f6fb78978e1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:28:39.602951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7507f1-c69e-4957-be28-f6fb78978e1f service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:39.603270 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7507f1-c69e-4957-be28-f6fb78978e1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:39.603550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7507f1-c69e-4957-be28-f6fb78978e1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:39.605625 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2b7507f1-c69e-4957-be28-f6fb78978e1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:39.616329 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7507f1-c69e-4957-be28-f6fb78978e1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:28:39.617798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7507f1-c69e-4957-be28-f6fb78978e1f service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:28:39.627316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1230/2512] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:28:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:28:45.867209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=39 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:28:49.627517 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:28:50.251027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67059856-8ef5-4ea5-be3d-8fc10d78c189 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:50.251027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67059856-8ef5-4ea5-be3d-8fc10d78c189 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:50.251027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67059856-8ef5-4ea5-be3d-8fc10d78c189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:50.270385 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-67059856-8ef5-4ea5-be3d-8fc10d78c189 None None] MFA Rules not processed for user `02af03095e48472d96a995a530e78035`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:28:50.271608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-67059856-8ef5-4ea5-be3d-8fc10d78c189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:50.335724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1283/2513] 10.222.0.141 () {58 vars in 1014 bytes} [Tue Jul 26 16:28:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:28:50.483660 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7507f1-c69e-4957-be28-f6fb78978e1f service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:28:50.485316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2b7507f1-c69e-4957-be28-f6fb78978e1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:50.570651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7507f1-c69e-4957-be28-f6fb78978e1f service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:28:50.576012 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd229775-2e50-4492-8f68-7e57f087ecea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c5f92f21868436a99a5c7aaa1fc40b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:28:50.576652 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd229775-2e50-4492-8f68-7e57f087ecea service swift] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:50.576965 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd229775-2e50-4492-8f68-7e57f087ecea service swift] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:50.577920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd229775-2e50-4492-8f68-7e57f087ecea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:50.587062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd229775-2e50-4492-8f68-7e57f087ecea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:28:50.588755 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd229775-2e50-4492-8f68-7e57f087ecea service swift] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:28:50.604803 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1231/2514] 10.222.0.141 () {60 vars in 1389 bytes} [Tue Jul 26 16:28:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 16:28:51.352601 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67059856-8ef5-4ea5-be3d-8fc10d78c189 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:28:51.368249 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67059856-8ef5-4ea5-be3d-8fc10d78c189 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:28:51.375274 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3141a-81e1-4a54-8808-879abf10c9b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:28:51.375963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3141a-81e1-4a54-8808-879abf10c9b1 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:51.376330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3141a-81e1-4a54-8808-879abf10c9b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:51.376614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3141a-81e1-4a54-8808-879abf10c9b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:51.378502 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-98c3141a-81e1-4a54-8808-879abf10c9b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:51.409031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3141a-81e1-4a54-8808-879abf10c9b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:28:51.411696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3141a-81e1-4a54-8808-879abf10c9b1 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:28:51.426911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1284/2515] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:28:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:28:56.859298 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd229775-2e50-4492-8f68-7e57f087ecea service swift] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:28:56.874901 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd229775-2e50-4492-8f68-7e57f087ecea service swift] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:28:56.883161 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa8f1a-08bc-4b89-9148-c1d333038be1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:28:56.885658 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa8f1a-08bc-4b89-9148-c1d333038be1 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:28:56.885658 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa8f1a-08bc-4b89-9148-c1d333038be1 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:28:56.885658 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa8f1a-08bc-4b89-9148-c1d333038be1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:28:56.887699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-85aa8f1a-08bc-4b89-9148-c1d333038be1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:28:56.907079 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa8f1a-08bc-4b89-9148-c1d333038be1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:28:56.909289 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa8f1a-08bc-4b89-9148-c1d333038be1 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:28:56.963294 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1232/2516] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:28:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:29:01.419185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=31 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:29:05.170933 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3141a-81e1-4a54-8808-879abf10c9b1 service nova] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:05.180757 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3141a-81e1-4a54-8808-879abf10c9b1 service nova] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:05.187501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecad99a-1799-47f4-be42-7db0927cb450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:05.187501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecad99a-1799-47f4-be42-7db0927cb450 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:05.187501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecad99a-1799-47f4-be42-7db0927cb450 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:05.187501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecad99a-1799-47f4-be42-7db0927cb450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:05.187961 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-eecad99a-1799-47f4-be42-7db0927cb450 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:05.200715 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecad99a-1799-47f4-be42-7db0927cb450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:05.202199 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecad99a-1799-47f4-be42-7db0927cb450 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:05.212437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1285/2517] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:29:06.670470 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa8f1a-08bc-4b89-9148-c1d333038be1 service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:06.681890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa8f1a-08bc-4b89-9148-c1d333038be1 service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:06.688270 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c871a4-1414-4be3-a081-2846221c4419 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:06.688971 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c871a4-1414-4be3-a081-2846221c4419 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:06.689247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c871a4-1414-4be3-a081-2846221c4419 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:06.689535 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c871a4-1414-4be3-a081-2846221c4419 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:06.691505 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-77c871a4-1414-4be3-a081-2846221c4419 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:06.705585 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c871a4-1414-4be3-a081-2846221c4419 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:06.707512 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c871a4-1414-4be3-a081-2846221c4419 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:06.719262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1233/2518] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:29:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:29:08.535664 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f2150-ccd6-48c3-98ba-3f7704435d0c None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:08.536135 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f2150-ccd6-48c3-98ba-3f7704435d0c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:08.536290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f2150-ccd6-48c3-98ba-3f7704435d0c None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:08.541383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1286/2519] 10.222.0.141 () {54 vars in 926 bytes} [Tue Jul 26 16:29:08 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:29:08.551811 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405af10-ba99-422c-bd08-de2107b79248 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:08.551811 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405af10-ba99-422c-bd08-de2107b79248 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:08.551811 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405af10-ba99-422c-bd08-de2107b79248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:08.574817 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-6405af10-ba99-422c-bd08-de2107b79248 None None] MFA Rules not processed for user `f7eac931cabf4921b6dbd42f63b9300f`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:29:08.576320 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6405af10-ba99-422c-bd08-de2107b79248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:08.587277 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1234/2520] 10.222.0.141 () {58 vars in 1023 bytes} [Tue Jul 26 16:29:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:29:08.623431 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f2150-ccd6-48c3-98ba-3f7704435d0c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:08.626650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-de9f2150-ccd6-48c3-98ba-3f7704435d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:08.700010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f2150-ccd6-48c3-98ba-3f7704435d0c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:08.704540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0c194-c2d8-4ce8-92a0-def0834aa7cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d25aebc2bbc47b5adb7200275c98d90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:08.705201 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0c194-c2d8-4ce8-92a0-def0834aa7cb service glance] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:08.705488 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0c194-c2d8-4ce8-92a0-def0834aa7cb service glance] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:08.705839 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0c194-c2d8-4ce8-92a0-def0834aa7cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:08.716414 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0c194-c2d8-4ce8-92a0-def0834aa7cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:08.717792 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0c194-c2d8-4ce8-92a0-def0834aa7cb service glance] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:08.728943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1287/2521] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:29:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:29:08.989070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b49bb-1e01-4ed1-b3c5-d5655b4e4873 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:08.989416 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b49bb-1e01-4ed1-b3c5-d5655b4e4873 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:08.989909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b49bb-1e01-4ed1-b3c5-d5655b4e4873 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:08.991312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1235/2522] 10.222.0.141 () {54 vars in 926 bytes} [Tue Jul 26 16:29:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 16:29:08.998188 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b28811-09aa-414a-8a3f-0218ddc306f4 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:08.998471 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b28811-09aa-414a-8a3f-0218ddc306f4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:08.999022 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b28811-09aa-414a-8a3f-0218ddc306f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:09.020301 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-31b28811-09aa-414a-8a3f-0218ddc306f4 None None] MFA Rules not processed for user `d1a99faad91b4357973f4bbb6632c724`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:29:09.021793 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-31b28811-09aa-414a-8a3f-0218ddc306f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:09.030418 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1288/2523] 10.222.0.141 () {58 vars in 1023 bytes} [Tue Jul 26 16:29:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:29:09.045694 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b49bb-1e01-4ed1-b3c5-d5655b4e4873 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:09.058462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b49bb-1e01-4ed1-b3c5-d5655b4e4873 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:09.062033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41450d1e-14eb-467d-9189-79e4259ed603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:09.062644 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41450d1e-14eb-467d-9189-79e4259ed603 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:09.062920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41450d1e-14eb-467d-9189-79e4259ed603 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:09.063188 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41450d1e-14eb-467d-9189-79e4259ed603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:09.070776 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41450d1e-14eb-467d-9189-79e4259ed603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:09.072131 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41450d1e-14eb-467d-9189-79e4259ed603 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:09.080030 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1236/2524] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:29:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:29:09.144505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b28811-09aa-414a-8a3f-0218ddc306f4 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:09.146280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-31b28811-09aa-414a-8a3f-0218ddc306f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:09.166379 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b28811-09aa-414a-8a3f-0218ddc306f4 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:09.170868 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9a888-ae28-4829-b213-05767d5675c9 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:09.174420 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9a888-ae28-4829-b213-05767d5675c9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:09.174420 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9a888-ae28-4829-b213-05767d5675c9 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:09.174420 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1237/2525] 10.222.0.141 () {54 vars in 926 bytes} [Tue Jul 26 16:29:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 16:29:09.176883 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2c734-e302-4c4d-9a86-9819ced1f481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:09.177648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2c734-e302-4c4d-9a86-9819ced1f481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:09.178178 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2c734-e302-4c4d-9a86-9819ced1f481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:09.178420 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2c734-e302-4c4d-9a86-9819ced1f481 admin admin] PATH_INFO: `/v3/users/2e75b38158404b298375fab5234851b0` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:09.178826 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c21a6-9e75-4ae5-bfbd-d8701c9a327c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:09.179137 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c21a6-9e75-4ae5-bfbd-d8701c9a327c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:09.179427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c21a6-9e75-4ae5-bfbd-d8701c9a327c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:09.179954 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2c734-e302-4c4d-9a86-9819ced1f481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e75b38158404b298375fab5234851b0)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:09.182144 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2c734-e302-4c4d-9a86-9819ced1f481 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:09.203179 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-f11c21a6-9e75-4ae5-bfbd-d8701c9a327c None None] MFA Rules not processed for user `f7eac931cabf4921b6dbd42f63b9300f`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:29:09.204529 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f11c21a6-9e75-4ae5-bfbd-d8701c9a327c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:09.214015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1238/2526] 10.222.0.141 () {58 vars in 1023 bytes} [Tue Jul 26 16:29:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:29:09.225562 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c21a6-9e75-4ae5-bfbd-d8701c9a327c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:09.236049 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c21a6-9e75-4ae5-bfbd-d8701c9a327c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:09.240625 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbded1d-12f9-4287-8c38-ae657557678d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:09.241300 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbded1d-12f9-4287-8c38-ae657557678d service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:09.241573 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbded1d-12f9-4287-8c38-ae657557678d service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:09.241841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbded1d-12f9-4287-8c38-ae657557678d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:09.252959 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbded1d-12f9-4287-8c38-ae657557678d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:09.254456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbded1d-12f9-4287-8c38-ae657557678d service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:09.266269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1239/2527] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:29:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:29:09.365199 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7ea2c734-e302-4c4d-9a86-9819ced1f481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e75b38158404b298375fab5234851b0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:09.365898 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7ea2c734-e302-4c4d-9a86-9819ced1f481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e75b38158404b298375fab5234851b0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:09.465870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7ea2c734-e302-4c4d-9a86-9819ced1f481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e75b38158404b298375fab5234851b0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:09.486732 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7ea2c734-e302-4c4d-9a86-9819ced1f481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e75b38158404b298375fab5234851b0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:09.487793 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7ea2c734-e302-4c4d-9a86-9819ced1f481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e75b38158404b298375fab5234851b0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:09.501017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1289/2528] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:29:09 2022] DELETE /identity/v3/users/2e75b38158404b298375fab5234851b0 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:29:09.768986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbded1d-12f9-4287-8c38-ae657557678d service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:09.785672 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbded1d-12f9-4287-8c38-ae657557678d service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:09.861617 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f59666-5bb8-44f2-a616-0be8aaf4b587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:09.862260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f59666-5bb8-44f2-a616-0be8aaf4b587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:09.862542 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f59666-5bb8-44f2-a616-0be8aaf4b587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:09.862818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f59666-5bb8-44f2-a616-0be8aaf4b587 admin admin] PATH_INFO: `/v3/projects/4a9c76ad32964ba094c0e201f0762cc8` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:09.863972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f59666-5bb8-44f2-a616-0be8aaf4b587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a9c76ad32964ba094c0e201f0762cc8)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:09.866038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f59666-5bb8-44f2-a616-0be8aaf4b587 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:09.965130 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:29:09.986333 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-55f59666-5bb8-44f2-a616-0be8aaf4b587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a9c76ad32964ba094c0e201f0762cc8', 'request_id': 'req-55f59666-5bb8-44f2-a616-0be8aaf4b587'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:09.995177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-55f59666-5bb8-44f2-a616-0be8aaf4b587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a9c76ad32964ba094c0e201f0762cc8', 'request_id': 'req-55f59666-5bb8-44f2-a616-0be8aaf4b587'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:10.001716 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-55f59666-5bb8-44f2-a616-0be8aaf4b587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a9c76ad32964ba094c0e201f0762cc8', 'request_id': 'req-55f59666-5bb8-44f2-a616-0be8aaf4b587'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:10.082228 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-55f59666-5bb8-44f2-a616-0be8aaf4b587 admin admin] The token cache is being invalidate because project 4a9c76ad32964ba094c0e201f0762cc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:29:10.082494 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-55f59666-5bb8-44f2-a616-0be8aaf4b587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:10.083398 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-55f59666-5bb8-44f2-a616-0be8aaf4b587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:10.085520 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1240/2529] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:29:09 2022] DELETE /identity/v3/projects/4a9c76ad32964ba094c0e201f0762cc8 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:29:10.092083 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabfe85-5898-4482-a50d-094a1477e0f4 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:10.092722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabfe85-5898-4482-a50d-094a1477e0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:10.093057 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabfe85-5898-4482-a50d-094a1477e0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:10.121751 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6dabfe85-5898-4482-a50d-094a1477e0f4 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:29:10.123043 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6dabfe85-5898-4482-a50d-094a1477e0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:10.192506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:29:10.205540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1290/2530] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:29:10.215722 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c5944-bd66-402b-8154-296e66ef4c8b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:10.216133 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c5944-bd66-402b-8154-296e66ef4c8b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:10.216378 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c5944-bd66-402b-8154-296e66ef4c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:10.241704 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-184c5944-bd66-402b-8154-296e66ef4c8b None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:29:10.243036 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-184c5944-bd66-402b-8154-296e66ef4c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:10.255372 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1241/2531] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:29:10.259807 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabfe85-5898-4482-a50d-094a1477e0f4 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:10.270347 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabfe85-5898-4482-a50d-094a1477e0f4 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:10.275450 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb694d-1918-4f9d-b3c0-82cea8237be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:10.276068 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb694d-1918-4f9d-b3c0-82cea8237be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:10.276369 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb694d-1918-4f9d-b3c0-82cea8237be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:10.276645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb694d-1918-4f9d-b3c0-82cea8237be4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:10.277361 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb694d-1918-4f9d-b3c0-82cea8237be4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:29:10.277654 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb694d-1918-4f9d-b3c0-82cea8237be4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:10.279248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb694d-1918-4f9d-b3c0-82cea8237be4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:10.291570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1291/2532] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:29:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:29:10.297469 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c5944-bd66-402b-8154-296e66ef4c8b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:10.310209 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c5944-bd66-402b-8154-296e66ef4c8b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:10.316738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25111f-7dff-491d-89f8-cbca5c173c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:10.317587 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25111f-7dff-491d-89f8-cbca5c173c89 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:10.318090 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25111f-7dff-491d-89f8-cbca5c173c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:10.318434 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25111f-7dff-491d-89f8-cbca5c173c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:10.319175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25111f-7dff-491d-89f8-cbca5c173c89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:10.321395 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25111f-7dff-491d-89f8-cbca5c173c89 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:10.456556 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1242/2533] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:29:10 2022] POST /identity/v3/projects => generated 372 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:29:10.461727 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb694d-1918-4f9d-b3c0-82cea8237be4 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:10.472327 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb694d-1918-4f9d-b3c0-82cea8237be4 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:10.531174 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11568904-495d-4a8f-af15-209745b1f240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:10.531796 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11568904-495d-4a8f-af15-209745b1f240 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:10.532076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11568904-495d-4a8f-af15-209745b1f240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:10.532352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11568904-495d-4a8f-af15-209745b1f240 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:10.533051 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11568904-495d-4a8f-af15-209745b1f240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:10.535230 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11568904-495d-4a8f-af15-209745b1f240 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:10.660425 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1292/2534] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:29:10 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:29:10.664836 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25111f-7dff-491d-89f8-cbca5c173c89 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:10.676345 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25111f-7dff-491d-89f8-cbca5c173c89 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:10.681067 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44304555-ef3e-4f63-b7d2-7b01f736473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:10.681681 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44304555-ef3e-4f63-b7d2-7b01f736473c admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:10.681963 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44304555-ef3e-4f63-b7d2-7b01f736473c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:10.682241 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44304555-ef3e-4f63-b7d2-7b01f736473c admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:10.683054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44304555-ef3e-4f63-b7d2-7b01f736473c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:10.684702 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44304555-ef3e-4f63-b7d2-7b01f736473c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:10.695343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1243/2535] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:29:10 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:29:10.699620 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11568904-495d-4a8f-af15-209745b1f240 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:10.709887 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11568904-495d-4a8f-af15-209745b1f240 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:10.714407 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d9361-ce18-4a52-b57f-2067abbd83b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:10.715018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d9361-ce18-4a52-b57f-2067abbd83b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:10.715298 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d9361-ce18-4a52-b57f-2067abbd83b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:10.715570 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d9361-ce18-4a52-b57f-2067abbd83b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:10.716248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d9361-ce18-4a52-b57f-2067abbd83b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:10.718438 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d9361-ce18-4a52-b57f-2067abbd83b4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:10.729281 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1293/2536] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:29:10 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:29:10.734299 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44304555-ef3e-4f63-b7d2-7b01f736473c admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:10.745393 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44304555-ef3e-4f63-b7d2-7b01f736473c admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:10.750283 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2882c6d-5d7d-4b4d-b8c3-d83a1eedb853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:10.750965 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2882c6d-5d7d-4b4d-b8c3-d83a1eedb853 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:10.751246 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2882c6d-5d7d-4b4d-b8c3-d83a1eedb853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:10.751520 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2882c6d-5d7d-4b4d-b8c3-d83a1eedb853 admin admin] PATH_INFO: `/v3/projects/8a502b939f304045a62d6284517c09f5/users/761e2b1a58824e79a0919b3438fc43c2/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:10.767126 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2882c6d-5d7d-4b4d-b8c3-d83a1eedb853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a502b939f304045a62d6284517c09f5, user_id=761e2b1a58824e79a0919b3438fc43c2, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:10.769818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2882c6d-5d7d-4b4d-b8c3-d83a1eedb853 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:10.844606 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1244/2537] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:29:10 2022] PUT /identity/v3/projects/8a502b939f304045a62d6284517c09f5/users/761e2b1a58824e79a0919b3438fc43c2/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:29:10.854721 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831e3c1-83ed-4c90-9b51-363c5d47c60f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:10.855002 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831e3c1-83ed-4c90-9b51-363c5d47c60f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:10.855277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831e3c1-83ed-4c90-9b51-363c5d47c60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:10.890990 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d831e3c1-83ed-4c90-9b51-363c5d47c60f None None] MFA Rules not processed for user `761e2b1a58824e79a0919b3438fc43c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:29:10.892222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d831e3c1-83ed-4c90-9b51-363c5d47c60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:10.974703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1294/2538] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:29:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:29:10.979661 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2882c6d-5d7d-4b4d-b8c3-d83a1eedb853 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:11.053687 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2882c6d-5d7d-4b4d-b8c3-d83a1eedb853 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:11.058738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409df5bf-ac59-495e-bd57-93ba14f04494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:11.059364 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409df5bf-ac59-495e-bd57-93ba14f04494 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:11.059644 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409df5bf-ac59-495e-bd57-93ba14f04494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:11.059913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409df5bf-ac59-495e-bd57-93ba14f04494 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:11.060568 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409df5bf-ac59-495e-bd57-93ba14f04494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:11.062811 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409df5bf-ac59-495e-bd57-93ba14f04494 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:11.189039 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1245/2539] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:29:10 2022] POST /identity/v3/projects => generated 372 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:29:11.190343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831e3c1-83ed-4c90-9b51-363c5d47c60f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:11.205190 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831e3c1-83ed-4c90-9b51-363c5d47c60f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:11.258724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:29:11.272449 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c143ae2-94c8-4853-a6f4-e14262bb2063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:11.273556 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c143ae2-94c8-4853-a6f4-e14262bb2063 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:11.274131 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c143ae2-94c8-4853-a6f4-e14262bb2063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:11.274461 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c143ae2-94c8-4853-a6f4-e14262bb2063 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:11.275375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c143ae2-94c8-4853-a6f4-e14262bb2063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:11.277592 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c143ae2-94c8-4853-a6f4-e14262bb2063 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:11.384094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1295/2540] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:29:11 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:29:11.388361 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409df5bf-ac59-495e-bd57-93ba14f04494 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:11.399947 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409df5bf-ac59-495e-bd57-93ba14f04494 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:11.404905 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559fa98-962c-44e1-999d-de161a3dd7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:11.406026 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559fa98-962c-44e1-999d-de161a3dd7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:11.406306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559fa98-962c-44e1-999d-de161a3dd7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:11.406579 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559fa98-962c-44e1-999d-de161a3dd7e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:11.407313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559fa98-962c-44e1-999d-de161a3dd7e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:11.409019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559fa98-962c-44e1-999d-de161a3dd7e9 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:11.420777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1246/2541] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:29:11 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:29:11.425621 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c143ae2-94c8-4853-a6f4-e14262bb2063 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:11.436428 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c143ae2-94c8-4853-a6f4-e14262bb2063 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:11.441359 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2613d-971a-45e0-bd1b-b23c151c6dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:11.442018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2613d-971a-45e0-bd1b-b23c151c6dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:11.442459 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2613d-971a-45e0-bd1b-b23c151c6dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:11.442733 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2613d-971a-45e0-bd1b-b23c151c6dfc admin admin] PATH_INFO: `/v3/projects/13401040564a4b5684be63f018ac6c3f/users/24e7114aa3804ad98400b59695cc31b5/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:11.459201 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2613d-971a-45e0-bd1b-b23c151c6dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=13401040564a4b5684be63f018ac6c3f, user_id=24e7114aa3804ad98400b59695cc31b5, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:11.462020 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2613d-971a-45e0-bd1b-b23c151c6dfc admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:11.536310 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1296/2542] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:29:11 2022] PUT /identity/v3/projects/13401040564a4b5684be63f018ac6c3f/users/24e7114aa3804ad98400b59695cc31b5/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:29:11.540311 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559fa98-962c-44e1-999d-de161a3dd7e9 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:11.553223 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559fa98-962c-44e1-999d-de161a3dd7e9 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:11.574140 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:29:11.611823 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dabdf-45e1-4c3e-b375-6f8c2c147a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:11.612536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dabdf-45e1-4c3e-b375-6f8c2c147a72 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:11.613087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dabdf-45e1-4c3e-b375-6f8c2c147a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:11.613369 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dabdf-45e1-4c3e-b375-6f8c2c147a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:11.614131 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5dabdf-45e1-4c3e-b375-6f8c2c147a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:11.615639 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5dabdf-45e1-4c3e-b375-6f8c2c147a72 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:11.626998 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1247/2543] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:29:11 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:29:11.631531 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2613d-971a-45e0-bd1b-b23c151c6dfc admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:11.654353 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2613d-971a-45e0-bd1b-b23c151c6dfc admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:11.657243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09951487-5fc5-4829-8a62-3e4d1f2ba9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:11.657918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09951487-5fc5-4829-8a62-3e4d1f2ba9d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:11.658201 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09951487-5fc5-4829-8a62-3e4d1f2ba9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:11.658479 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09951487-5fc5-4829-8a62-3e4d1f2ba9d6 admin admin] PATH_INFO: `/v3/projects/13401040564a4b5684be63f018ac6c3f/users/24e7114aa3804ad98400b59695cc31b5/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:11.660447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09951487-5fc5-4829-8a62-3e4d1f2ba9d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13401040564a4b5684be63f018ac6c3f, user_id=24e7114aa3804ad98400b59695cc31b5, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:11.663209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09951487-5fc5-4829-8a62-3e4d1f2ba9d6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:11.674578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1297/2544] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:29:11 2022] PUT /identity/v3/projects/13401040564a4b5684be63f018ac6c3f/users/24e7114aa3804ad98400b59695cc31b5/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:29:11.686332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbac00-dec3-4023-b869-caacd82faa84 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:11.686667 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbac00-dec3-4023-b869-caacd82faa84 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:11.686938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbac00-dec3-4023-b869-caacd82faa84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:11.716292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-fffbac00-dec3-4023-b869-caacd82faa84 None None] MFA Rules not processed for user `24e7114aa3804ad98400b59695cc31b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:29:11.717566 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fffbac00-dec3-4023-b869-caacd82faa84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:11.797449 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1248/2545] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:29:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:29:11.808164 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09951487-5fc5-4829-8a62-3e4d1f2ba9d6 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:11.810716 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-09951487-5fc5-4829-8a62-3e4d1f2ba9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:11.841078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfb5c7-d2df-49ea-b12d-65b995454c46 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:11.841368 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfb5c7-d2df-49ea-b12d-65b995454c46 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:11.841648 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfb5c7-d2df-49ea-b12d-65b995454c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:11.862110 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-aecfb5c7-d2df-49ea-b12d-65b995454c46 None None] MFA Rules not processed for user `02af03095e48472d96a995a530e78035`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:29:11.863340 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-aecfb5c7-d2df-49ea-b12d-65b995454c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:11.882625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09951487-5fc5-4829-8a62-3e4d1f2ba9d6 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:11.886439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3967098-e8b6-41af-bd2a-a2bea977d84d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:11.887368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3967098-e8b6-41af-bd2a-a2bea977d84d service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:11.887368 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3967098-e8b6-41af-bd2a-a2bea977d84d service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:11.887625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3967098-e8b6-41af-bd2a-a2bea977d84d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:11.898278 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3967098-e8b6-41af-bd2a-a2bea977d84d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:11.899735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3967098-e8b6-41af-bd2a-a2bea977d84d service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:11.910243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1298/2546] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:29:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:29:11.926034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1249/2547] 10.222.0.141 () {58 vars in 1014 bytes} [Tue Jul 26 16:29:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:29:11.943375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3967098-e8b6-41af-bd2a-a2bea977d84d service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:11.943684 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f3967098-e8b6-41af-bd2a-a2bea977d84d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:12.027614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3967098-e8b6-41af-bd2a-a2bea977d84d service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:12.033693 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5b317-000d-4778-b7cc-9077a34a87fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c5f92f21868436a99a5c7aaa1fc40b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:12.036896 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5b317-000d-4778-b7cc-9077a34a87fc service swift] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:12.036896 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5b317-000d-4778-b7cc-9077a34a87fc service swift] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:12.036896 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5b317-000d-4778-b7cc-9077a34a87fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:12.045219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5b317-000d-4778-b7cc-9077a34a87fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:12.046642 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5b317-000d-4778-b7cc-9077a34a87fc service swift] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:12.056065 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1299/2548] 10.222.0.141 () {60 vars in 1389 bytes} [Tue Jul 26 16:29:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 16:29:12.119784 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfb5c7-d2df-49ea-b12d-65b995454c46 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:12.134466 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfb5c7-d2df-49ea-b12d-65b995454c46 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:12.135318 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513de15-33af-4c7c-ae3e-eaba8c089a52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:12.135949 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513de15-33af-4c7c-ae3e-eaba8c089a52 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:12.136230 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513de15-33af-4c7c-ae3e-eaba8c089a52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:12.136504 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513de15-33af-4c7c-ae3e-eaba8c089a52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:12.196453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:29:12.208053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513de15-33af-4c7c-ae3e-eaba8c089a52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:12.209716 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513de15-33af-4c7c-ae3e-eaba8c089a52 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:12.221168 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1250/2549] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:29:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:29:22.052107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=79,keystone:INSERT=5 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:29:22.229295 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:29:27.586234 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa88f7-d942-4296-a576-ec485aa40c1d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:27.586234 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa88f7-d942-4296-a576-ec485aa40c1d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:27.586234 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa88f7-d942-4296-a576-ec485aa40c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:27.604267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f4aa88f7-d942-4296-a576-ec485aa40c1d None None] MFA Rules not processed for user `02af03095e48472d96a995a530e78035`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:29:27.605520 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f4aa88f7-d942-4296-a576-ec485aa40c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:27.613524 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1300/2550] 10.222.0.141 () {58 vars in 972 bytes} [Tue Jul 26 16:29:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:29:27.626377 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513de15-33af-4c7c-ae3e-eaba8c089a52 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:27.637846 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513de15-33af-4c7c-ae3e-eaba8c089a52 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:27.644506 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c0cab-beec-423d-9ae9-4a7218b33b31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c5f92f21868436a99a5c7aaa1fc40b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:27.645163 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c0cab-beec-423d-9ae9-4a7218b33b31 service swift] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:27.645443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c0cab-beec-423d-9ae9-4a7218b33b31 service swift] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:27.645717 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c0cab-beec-423d-9ae9-4a7218b33b31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:27.655157 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c0cab-beec-423d-9ae9-4a7218b33b31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:27.656849 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c0cab-beec-423d-9ae9-4a7218b33b31 service swift] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:27.666025 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1251/2551] 10.222.0.141 () {60 vars in 1389 bytes} [Tue Jul 26 16:29:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 16:29:35.365293 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f17272-3bc2-4598-8f6c-0dae0d9c6f44 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:35.365836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f17272-3bc2-4598-8f6c-0dae0d9c6f44 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:35.365836 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f17272-3bc2-4598-8f6c-0dae0d9c6f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:35.385999 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-77f17272-3bc2-4598-8f6c-0dae0d9c6f44 None None] MFA Rules not processed for user `8c83c9a2d38e460fb838ffc9f50fea8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:29:35.387206 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-77f17272-3bc2-4598-8f6c-0dae0d9c6f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:35.445344 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1301/2552] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:29:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:29:35.770544 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c0cab-beec-423d-9ae9-4a7218b33b31 service swift] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:35.772378 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-578c0cab-beec-423d-9ae9-4a7218b33b31 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:35.833442 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c0cab-beec-423d-9ae9-4a7218b33b31 service swift] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:35.837467 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f538bb-f9d3-4490-b8d0-ff71bc3586cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:35.838100 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f538bb-f9d3-4490-b8d0-ff71bc3586cb service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:35.838384 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f538bb-f9d3-4490-b8d0-ff71bc3586cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:35.838658 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f538bb-f9d3-4490-b8d0-ff71bc3586cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:35.840467 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-79f538bb-f9d3-4490-b8d0-ff71bc3586cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:35.851584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f538bb-f9d3-4490-b8d0-ff71bc3586cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:35.852312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f538bb-f9d3-4490-b8d0-ff71bc3586cb service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:35.861021 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1252/2553] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:29:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:29:45.438009 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=28 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:29:45.857012 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=32 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:29:50.091702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f17272-3bc2-4598-8f6c-0dae0d9c6f44 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:50.177821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f17272-3bc2-4598-8f6c-0dae0d9c6f44 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:50.182604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb6184-159a-4a8f-b2d8-115f62764a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:50.183382 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb6184-159a-4a8f-b2d8-115f62764a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:50.183686 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb6184-159a-4a8f-b2d8-115f62764a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:50.184021 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb6184-159a-4a8f-b2d8-115f62764a1f admin admin] PATH_INFO: `/v3/users/761e2b1a58824e79a0919b3438fc43c2` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:50.185454 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb6184-159a-4a8f-b2d8-115f62764a1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=761e2b1a58824e79a0919b3438fc43c2)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:50.187753 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb6184-159a-4a8f-b2d8-115f62764a1f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:50.406466 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5cdb6184-159a-4a8f-b2d8-115f62764a1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '761e2b1a58824e79a0919b3438fc43c2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:50.407126 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5cdb6184-159a-4a8f-b2d8-115f62764a1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '761e2b1a58824e79a0919b3438fc43c2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:50.494601 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5cdb6184-159a-4a8f-b2d8-115f62764a1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '761e2b1a58824e79a0919b3438fc43c2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:50.510350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5cdb6184-159a-4a8f-b2d8-115f62764a1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '761e2b1a58824e79a0919b3438fc43c2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:50.511088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5cdb6184-159a-4a8f-b2d8-115f62764a1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '761e2b1a58824e79a0919b3438fc43c2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:50.526655 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1302/2554] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:29:50 2022] DELETE /identity/v3/users/761e2b1a58824e79a0919b3438fc43c2 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:29:50.531334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1979d4e-d9e8-40f3-84a0-2c30dae50a2c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:50.531855 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1979d4e-d9e8-40f3-84a0-2c30dae50a2c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:50.539753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1979d4e-d9e8-40f3-84a0-2c30dae50a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:50.551960 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e1979d4e-d9e8-40f3-84a0-2c30dae50a2c None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:29:50.553191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e1979d4e-d9e8-40f3-84a0-2c30dae50a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:50.620220 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1253/2555] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:29:50.631670 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb6184-159a-4a8f-b2d8-115f62764a1f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:50.633332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5cdb6184-159a-4a8f-b2d8-115f62764a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:50.704111 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb6184-159a-4a8f-b2d8-115f62764a1f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:50.710131 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af77f13-e028-45c5-bcd3-1b1c1dfdfa36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:50.710866 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af77f13-e028-45c5-bcd3-1b1c1dfdfa36 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:50.711207 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af77f13-e028-45c5-bcd3-1b1c1dfdfa36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:50.711538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af77f13-e028-45c5-bcd3-1b1c1dfdfa36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:50.723023 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af77f13-e028-45c5-bcd3-1b1c1dfdfa36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:50.724934 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af77f13-e028-45c5-bcd3-1b1c1dfdfa36 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:50.738201 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1303/2556] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:29:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:29:51.222884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1979d4e-d9e8-40f3-84a0-2c30dae50a2c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:51.222884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e1979d4e-d9e8-40f3-84a0-2c30dae50a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:51.247941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1979d4e-d9e8-40f3-84a0-2c30dae50a2c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:51.253371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfff4b-6b6e-452d-9752-9bae808027ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:51.254384 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfff4b-6b6e-452d-9752-9bae808027ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:51.255118 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfff4b-6b6e-452d-9752-9bae808027ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:51.256023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfff4b-6b6e-452d-9752-9bae808027ed admin admin] PATH_INFO: `/v3/projects/8a502b939f304045a62d6284517c09f5` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:51.257360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfff4b-6b6e-452d-9752-9bae808027ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a502b939f304045a62d6284517c09f5)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:51.259460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfff4b-6b6e-452d-9752-9bae808027ed admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:51.391332 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3ecfff4b-6b6e-452d-9752-9bae808027ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a502b939f304045a62d6284517c09f5', 'request_id': 'req-3ecfff4b-6b6e-452d-9752-9bae808027ed'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:51.397934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3ecfff4b-6b6e-452d-9752-9bae808027ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a502b939f304045a62d6284517c09f5', 'request_id': 'req-3ecfff4b-6b6e-452d-9752-9bae808027ed'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:51.404001 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3ecfff4b-6b6e-452d-9752-9bae808027ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a502b939f304045a62d6284517c09f5', 'request_id': 'req-3ecfff4b-6b6e-452d-9752-9bae808027ed'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:51.476913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3ecfff4b-6b6e-452d-9752-9bae808027ed admin admin] The token cache is being invalidate because project 8a502b939f304045a62d6284517c09f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:29:51.477226 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3ecfff4b-6b6e-452d-9752-9bae808027ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:51.477864 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3ecfff4b-6b6e-452d-9752-9bae808027ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:51.479391 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1254/2557] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:29:51 2022] DELETE /identity/v3/projects/8a502b939f304045a62d6284517c09f5 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:29:51.483418 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af77f13-e028-45c5-bcd3-1b1c1dfdfa36 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:51.493690 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af77f13-e028-45c5-bcd3-1b1c1dfdfa36 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:51.512344 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:29:51.554090 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184646ef-1dd9-41fd-97ce-3955c6ba323e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:51.554755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184646ef-1dd9-41fd-97ce-3955c6ba323e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:51.555193 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184646ef-1dd9-41fd-97ce-3955c6ba323e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:51.555493 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184646ef-1dd9-41fd-97ce-3955c6ba323e admin admin] PATH_INFO: `/v3/users/24e7114aa3804ad98400b59695cc31b5` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:51.556796 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184646ef-1dd9-41fd-97ce-3955c6ba323e admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e7114aa3804ad98400b59695cc31b5)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:51.558721 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184646ef-1dd9-41fd-97ce-3955c6ba323e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:51.779650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-184646ef-1dd9-41fd-97ce-3955c6ba323e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e7114aa3804ad98400b59695cc31b5'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:51.780258 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-184646ef-1dd9-41fd-97ce-3955c6ba323e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e7114aa3804ad98400b59695cc31b5'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:51.874045 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-184646ef-1dd9-41fd-97ce-3955c6ba323e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e7114aa3804ad98400b59695cc31b5'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:51.886716 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-184646ef-1dd9-41fd-97ce-3955c6ba323e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e7114aa3804ad98400b59695cc31b5'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:51.887355 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-184646ef-1dd9-41fd-97ce-3955c6ba323e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e7114aa3804ad98400b59695cc31b5'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:51.900169 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1304/2558] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:29:51 2022] DELETE /identity/v3/users/24e7114aa3804ad98400b59695cc31b5 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:29:52.350650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfff4b-6b6e-452d-9752-9bae808027ed admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:52.352278 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3ecfff4b-6b6e-452d-9752-9bae808027ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:52.368355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfff4b-6b6e-452d-9752-9bae808027ed admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:52.447908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee6d82-a9b2-4066-8296-befe5d8fef6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:52.448646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee6d82-a9b2-4066-8296-befe5d8fef6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:52.448949 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee6d82-a9b2-4066-8296-befe5d8fef6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:52.449219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee6d82-a9b2-4066-8296-befe5d8fef6a admin admin] PATH_INFO: `/v3/projects/13401040564a4b5684be63f018ac6c3f` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:52.450534 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee6d82-a9b2-4066-8296-befe5d8fef6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=13401040564a4b5684be63f018ac6c3f)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:52.452456 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee6d82-a9b2-4066-8296-befe5d8fef6a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:52.578800 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:29:52.595899 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2cee6d82-a9b2-4066-8296-befe5d8fef6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13401040564a4b5684be63f018ac6c3f', 'request_id': 'req-2cee6d82-a9b2-4066-8296-befe5d8fef6a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:52.602201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2cee6d82-a9b2-4066-8296-befe5d8fef6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13401040564a4b5684be63f018ac6c3f', 'request_id': 'req-2cee6d82-a9b2-4066-8296-befe5d8fef6a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:52.607947 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2cee6d82-a9b2-4066-8296-befe5d8fef6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13401040564a4b5684be63f018ac6c3f', 'request_id': 'req-2cee6d82-a9b2-4066-8296-befe5d8fef6a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:52.693243 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2cee6d82-a9b2-4066-8296-befe5d8fef6a admin admin] The token cache is being invalidate because project 13401040564a4b5684be63f018ac6c3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:29:52.693531 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2cee6d82-a9b2-4066-8296-befe5d8fef6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:52.694225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2cee6d82-a9b2-4066-8296-befe5d8fef6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:29:52.695868 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1255/2559] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:29:52 2022] DELETE /identity/v3/projects/13401040564a4b5684be63f018ac6c3f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:29:52.701370 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8859110-a8b3-4042-a06b-7a4ad7ad1898 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:52.701987 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8859110-a8b3-4042-a06b-7a4ad7ad1898 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:52.701987 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8859110-a8b3-4042-a06b-7a4ad7ad1898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:52.722007 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f8859110-a8b3-4042-a06b-7a4ad7ad1898 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:29:52.723490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f8859110-a8b3-4042-a06b-7a4ad7ad1898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:52.792200 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1305/2560] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:29:52.801742 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740c556-639b-44e3-b416-ad28aee35ac8 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:52.802024 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740c556-639b-44e3-b416-ad28aee35ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:52.802295 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740c556-639b-44e3-b416-ad28aee35ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:52.823994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-2740c556-639b-44e3-b416-ad28aee35ac8 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:29:52.825732 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2740c556-639b-44e3-b416-ad28aee35ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:52.837723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1256/2561] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:29:52.842558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8859110-a8b3-4042-a06b-7a4ad7ad1898 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:52.853017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8859110-a8b3-4042-a06b-7a4ad7ad1898 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:52.857932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c84c6-0232-4a66-aa70-5e661ee769ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:52.858562 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c84c6-0232-4a66-aa70-5e661ee769ea admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:52.858844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c84c6-0232-4a66-aa70-5e661ee769ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:52.859117 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c84c6-0232-4a66-aa70-5e661ee769ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:52.859801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c84c6-0232-4a66-aa70-5e661ee769ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:29:52.860103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c84c6-0232-4a66-aa70-5e661ee769ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:52.861799 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c84c6-0232-4a66-aa70-5e661ee769ea admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:52.873490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1306/2562] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:29:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:29:52.877968 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740c556-639b-44e3-b416-ad28aee35ac8 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:52.888071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740c556-639b-44e3-b416-ad28aee35ac8 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:52.892780 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf517cad-f5e9-40c7-a3f4-62982a9bca65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:52.893390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf517cad-f5e9-40c7-a3f4-62982a9bca65 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:52.893701 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf517cad-f5e9-40c7-a3f4-62982a9bca65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:52.894001 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf517cad-f5e9-40c7-a3f4-62982a9bca65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:52.894729 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf517cad-f5e9-40c7-a3f4-62982a9bca65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:52.897277 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf517cad-f5e9-40c7-a3f4-62982a9bca65 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:52.974950 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1257/2563] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:29:52 2022] POST /identity/v3/projects => generated 358 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:29:52.979190 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c84c6-0232-4a66-aa70-5e661ee769ea admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:52.989847 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c84c6-0232-4a66-aa70-5e661ee769ea admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:53.016426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:29:53.047912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728040d-2396-4ab9-bbcd-4d5d29f16c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:53.048578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728040d-2396-4ab9-bbcd-4d5d29f16c73 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:53.048886 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728040d-2396-4ab9-bbcd-4d5d29f16c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:53.049164 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728040d-2396-4ab9-bbcd-4d5d29f16c73 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:53.049820 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728040d-2396-4ab9-bbcd-4d5d29f16c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:53.052312 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728040d-2396-4ab9-bbcd-4d5d29f16c73 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:53.162646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1307/2564] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:29:52 2022] POST /identity/v3/users => generated 280 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:29:53.166987 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf517cad-f5e9-40c7-a3f4-62982a9bca65 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:53.178680 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf517cad-f5e9-40c7-a3f4-62982a9bca65 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:53.184372 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325006f-aa51-417d-bfab-08ced99ec065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:53.185019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325006f-aa51-417d-bfab-08ced99ec065 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:53.185304 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325006f-aa51-417d-bfab-08ced99ec065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:53.185581 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325006f-aa51-417d-bfab-08ced99ec065 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:53.186282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325006f-aa51-417d-bfab-08ced99ec065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:53.187893 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325006f-aa51-417d-bfab-08ced99ec065 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:53.198741 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1258/2565] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:29:53 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:29:53.202755 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728040d-2396-4ab9-bbcd-4d5d29f16c73 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:53.212863 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728040d-2396-4ab9-bbcd-4d5d29f16c73 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:53.217629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84c388-256f-451c-b07c-7f60a9638e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:53.218224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84c388-256f-451c-b07c-7f60a9638e7c admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:53.218501 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84c388-256f-451c-b07c-7f60a9638e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:53.218770 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84c388-256f-451c-b07c-7f60a9638e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:53.219447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84c388-256f-451c-b07c-7f60a9638e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:53.221071 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84c388-256f-451c-b07c-7f60a9638e7c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:53.230948 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1308/2566] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:29:53 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:29:53.235144 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325006f-aa51-417d-bfab-08ced99ec065 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:53.245866 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325006f-aa51-417d-bfab-08ced99ec065 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:53.250890 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11494a54-b2cd-40c0-9639-63314eb7466c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:53.251574 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11494a54-b2cd-40c0-9639-63314eb7466c admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:53.251851 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11494a54-b2cd-40c0-9639-63314eb7466c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:53.252127 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11494a54-b2cd-40c0-9639-63314eb7466c admin admin] PATH_INFO: `/v3/projects/df3895fc64844b1091195b0302f5db84/users/963b0cfa1a554723a04f1f0ac93b4c7e/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:53.267518 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11494a54-b2cd-40c0-9639-63314eb7466c admin admin] RBAC: Authorizing `identity:create_grant(project_id=df3895fc64844b1091195b0302f5db84, user_id=963b0cfa1a554723a04f1f0ac93b4c7e, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:53.270218 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11494a54-b2cd-40c0-9639-63314eb7466c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:53.363810 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1259/2567] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:29:53 2022] PUT /identity/v3/projects/df3895fc64844b1091195b0302f5db84/users/963b0cfa1a554723a04f1f0ac93b4c7e/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:29:53.375487 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ff67e-6634-4fd6-98df-1651ee374db5 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:53.375798 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ff67e-6634-4fd6-98df-1651ee374db5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:53.376085 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ff67e-6634-4fd6-98df-1651ee374db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:53.407858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-399ff67e-6634-4fd6-98df-1651ee374db5 None None] MFA Rules not processed for user `963b0cfa1a554723a04f1f0ac93b4c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:29:53.409188 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-399ff67e-6634-4fd6-98df-1651ee374db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:53.484784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1309/2568] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:29:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:29:53.489448 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11494a54-b2cd-40c0-9639-63314eb7466c admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:53.560978 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11494a54-b2cd-40c0-9639-63314eb7466c admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:53.566199 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1420cf5-09c5-46ab-b432-ddfffbd245cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:53.566817 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1420cf5-09c5-46ab-b432-ddfffbd245cc admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:53.567099 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1420cf5-09c5-46ab-b432-ddfffbd245cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:53.568168 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1420cf5-09c5-46ab-b432-ddfffbd245cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:53.568883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1420cf5-09c5-46ab-b432-ddfffbd245cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:53.570835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1420cf5-09c5-46ab-b432-ddfffbd245cc admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:53.667047 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1260/2569] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:29:53 2022] POST /identity/v3/projects => generated 356 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:29:53.671503 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ff67e-6634-4fd6-98df-1651ee374db5 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:53.683014 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ff67e-6634-4fd6-98df-1651ee374db5 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:53.744129 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b745ddd-0de6-46e2-a4bc-2436a7d334f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:53.744783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b745ddd-0de6-46e2-a4bc-2436a7d334f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:53.744963 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b745ddd-0de6-46e2-a4bc-2436a7d334f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:53.745231 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b745ddd-0de6-46e2-a4bc-2436a7d334f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:53.746035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b745ddd-0de6-46e2-a4bc-2436a7d334f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:53.747935 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b745ddd-0de6-46e2-a4bc-2436a7d334f7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:53.858160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1310/2570] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:29:53 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:29:53.859606 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1420cf5-09c5-46ab-b432-ddfffbd245cc admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:53.870219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1420cf5-09c5-46ab-b432-ddfffbd245cc admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:53.875029 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495f134-968d-4ef4-893b-2b17f61e1fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:53.875649 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495f134-968d-4ef4-893b-2b17f61e1fac admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:53.875934 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495f134-968d-4ef4-893b-2b17f61e1fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:53.876217 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495f134-968d-4ef4-893b-2b17f61e1fac admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:53.876943 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495f134-968d-4ef4-893b-2b17f61e1fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:53.878550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495f134-968d-4ef4-893b-2b17f61e1fac admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:53.891111 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1261/2571] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:29:53 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:29:53.903437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b745ddd-0de6-46e2-a4bc-2436a7d334f7 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:53.917339 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b745ddd-0de6-46e2-a4bc-2436a7d334f7 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:53.923912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad556739-a902-4ec7-8120-87a2a8b50a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:53.924587 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad556739-a902-4ec7-8120-87a2a8b50a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:53.924919 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad556739-a902-4ec7-8120-87a2a8b50a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:53.925193 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad556739-a902-4ec7-8120-87a2a8b50a98 admin admin] PATH_INFO: `/v3/projects/a52a180b88fe48a79c7a84bfec75f048/users/2accd80d17d2420db3d19f7afcefe3b1/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:53.946496 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad556739-a902-4ec7-8120-87a2a8b50a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a52a180b88fe48a79c7a84bfec75f048, user_id=2accd80d17d2420db3d19f7afcefe3b1, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:53.949312 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad556739-a902-4ec7-8120-87a2a8b50a98 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:54.034663 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1311/2572] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:29:53 2022] PUT /identity/v3/projects/a52a180b88fe48a79c7a84bfec75f048/users/2accd80d17d2420db3d19f7afcefe3b1/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:29:54.039266 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495f134-968d-4ef4-893b-2b17f61e1fac admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:54.049933 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495f134-968d-4ef4-893b-2b17f61e1fac admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:54.070738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:29:54.109478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66056a0e-ed12-4c97-a6ad-9b51796cda84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:54.110106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66056a0e-ed12-4c97-a6ad-9b51796cda84 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:54.110390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66056a0e-ed12-4c97-a6ad-9b51796cda84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:54.110690 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66056a0e-ed12-4c97-a6ad-9b51796cda84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:54.111387 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66056a0e-ed12-4c97-a6ad-9b51796cda84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:54.113122 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66056a0e-ed12-4c97-a6ad-9b51796cda84 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:54.123212 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1262/2573] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:29:54 2022] GET /identity/v3/roles => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:29:54.127569 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad556739-a902-4ec7-8120-87a2a8b50a98 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:54.134311 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:29:54.139785 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad556739-a902-4ec7-8120-87a2a8b50a98 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:54.144605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31ec47-3040-4e73-a73c-80c9e0ccfd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:54.145291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31ec47-3040-4e73-a73c-80c9e0ccfd57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:54.146118 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31ec47-3040-4e73-a73c-80c9e0ccfd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:54.146396 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31ec47-3040-4e73-a73c-80c9e0ccfd57 admin admin] PATH_INFO: `/v3/projects/a52a180b88fe48a79c7a84bfec75f048/users/2accd80d17d2420db3d19f7afcefe3b1/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:54.148474 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31ec47-3040-4e73-a73c-80c9e0ccfd57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a52a180b88fe48a79c7a84bfec75f048, user_id=2accd80d17d2420db3d19f7afcefe3b1, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:54.151167 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31ec47-3040-4e73-a73c-80c9e0ccfd57 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:54.162403 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1312/2574] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:29:54 2022] PUT /identity/v3/projects/a52a180b88fe48a79c7a84bfec75f048/users/2accd80d17d2420db3d19f7afcefe3b1/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:29:54.172938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970d2fe-0422-40b6-aaf7-6da14ed9d19f None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:54.174372 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970d2fe-0422-40b6-aaf7-6da14ed9d19f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:54.174372 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970d2fe-0422-40b6-aaf7-6da14ed9d19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:54.200871 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-2970d2fe-0422-40b6-aaf7-6da14ed9d19f None None] MFA Rules not processed for user `2accd80d17d2420db3d19f7afcefe3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:29:54.203483 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2970d2fe-0422-40b6-aaf7-6da14ed9d19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:54.271196 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1263/2575] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:29:54 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:29:54.282748 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31ec47-3040-4e73-a73c-80c9e0ccfd57 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:54.284437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8b31ec47-3040-4e73-a73c-80c9e0ccfd57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:29:54.344619 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31ec47-3040-4e73-a73c-80c9e0ccfd57 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:54.348401 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584eff2-257e-4be2-a25a-e12f5da05b8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:54.349055 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584eff2-257e-4be2-a25a-e12f5da05b8c service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:54.349338 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584eff2-257e-4be2-a25a-e12f5da05b8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:54.349611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584eff2-257e-4be2-a25a-e12f5da05b8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:54.358887 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584eff2-257e-4be2-a25a-e12f5da05b8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:54.360341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584eff2-257e-4be2-a25a-e12f5da05b8c service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:54.370157 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1313/2576] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:29:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:29:54.618064 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970d2fe-0422-40b6-aaf7-6da14ed9d19f None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:29:54.627744 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970d2fe-0422-40b6-aaf7-6da14ed9d19f None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:29:54.631919 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3e99b-c7da-444a-afe1-50d1c583cc69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:29:54.632546 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3e99b-c7da-444a-afe1-50d1c583cc69 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:29:54.632838 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3e99b-c7da-444a-afe1-50d1c583cc69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:29:54.633108 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3e99b-c7da-444a-afe1-50d1c583cc69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:29:54.689140 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3e99b-c7da-444a-afe1-50d1c583cc69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:29:54.690588 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3e99b-c7da-444a-afe1-50d1c583cc69 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:29:54.700067 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1264/2577] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:29:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:30:04.365911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:04.696015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=80 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:14.000560 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584eff2-257e-4be2-a25a-e12f5da05b8c service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:14.077654 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584eff2-257e-4be2-a25a-e12f5da05b8c service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:14.082938 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09007c2c-6048-4aa8-98b5-b2a1420609ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:14.084231 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09007c2c-6048-4aa8-98b5-b2a1420609ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:14.084231 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09007c2c-6048-4aa8-98b5-b2a1420609ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:14.084231 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09007c2c-6048-4aa8-98b5-b2a1420609ec admin admin] PATH_INFO: `/v3/users/963b0cfa1a554723a04f1f0ac93b4c7e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:14.085689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09007c2c-6048-4aa8-98b5-b2a1420609ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=963b0cfa1a554723a04f1f0ac93b4c7e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:14.087605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09007c2c-6048-4aa8-98b5-b2a1420609ec admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:14.391197 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-09007c2c-6048-4aa8-98b5-b2a1420609ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '963b0cfa1a554723a04f1f0ac93b4c7e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:14.391865 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-09007c2c-6048-4aa8-98b5-b2a1420609ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '963b0cfa1a554723a04f1f0ac93b4c7e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:14.493174 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-09007c2c-6048-4aa8-98b5-b2a1420609ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '963b0cfa1a554723a04f1f0ac93b4c7e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:14.506354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-09007c2c-6048-4aa8-98b5-b2a1420609ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '963b0cfa1a554723a04f1f0ac93b4c7e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:14.506998 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-09007c2c-6048-4aa8-98b5-b2a1420609ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '963b0cfa1a554723a04f1f0ac93b4c7e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:14.519374 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1314/2578] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:30:13 2022] DELETE /identity/v3/users/963b0cfa1a554723a04f1f0ac93b4c7e => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:14.524612 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44be7a-f461-4948-9a04-5f81ce37bcb5 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:14.525135 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44be7a-f461-4948-9a04-5f81ce37bcb5 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:14.525275 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44be7a-f461-4948-9a04-5f81ce37bcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:14.545320 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8e44be7a-f461-4948-9a04-5f81ce37bcb5 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:14.546536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8e44be7a-f461-4948-9a04-5f81ce37bcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:14.608010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1265/2579] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:14.618070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09007c2c-6048-4aa8-98b5-b2a1420609ec admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:14.619408 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-09007c2c-6048-4aa8-98b5-b2a1420609ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:14.679383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09007c2c-6048-4aa8-98b5-b2a1420609ec admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:14.683032 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39557849-77b9-4487-b542-949f58cc9d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:14.683647 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557849-77b9-4487-b542-949f58cc9d45 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:14.683930 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557849-77b9-4487-b542-949f58cc9d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:14.684213 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557849-77b9-4487-b542-949f58cc9d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:14.694485 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39557849-77b9-4487-b542-949f58cc9d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:14.696031 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39557849-77b9-4487-b542-949f58cc9d45 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:14.705585 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1315/2580] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:30:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:30:15.112502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44be7a-f461-4948-9a04-5f81ce37bcb5 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:15.114653 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8e44be7a-f461-4948-9a04-5f81ce37bcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:15.134034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44be7a-f461-4948-9a04-5f81ce37bcb5 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:15.143141 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bc92d-266e-4eb2-9b90-42daeb92900c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:15.143812 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bc92d-266e-4eb2-9b90-42daeb92900c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:15.144099 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bc92d-266e-4eb2-9b90-42daeb92900c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:15.144379 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bc92d-266e-4eb2-9b90-42daeb92900c admin admin] PATH_INFO: `/v3/projects/df3895fc64844b1091195b0302f5db84` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:15.145601 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776bc92d-266e-4eb2-9b90-42daeb92900c admin admin] RBAC: Authorizing `identity:delete_project(project_id=df3895fc64844b1091195b0302f5db84)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:15.147545 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776bc92d-266e-4eb2-9b90-42daeb92900c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:15.272033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-776bc92d-266e-4eb2-9b90-42daeb92900c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df3895fc64844b1091195b0302f5db84', 'request_id': 'req-776bc92d-266e-4eb2-9b90-42daeb92900c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:15.281957 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-776bc92d-266e-4eb2-9b90-42daeb92900c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df3895fc64844b1091195b0302f5db84', 'request_id': 'req-776bc92d-266e-4eb2-9b90-42daeb92900c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:15.290211 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-776bc92d-266e-4eb2-9b90-42daeb92900c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df3895fc64844b1091195b0302f5db84', 'request_id': 'req-776bc92d-266e-4eb2-9b90-42daeb92900c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:15.400980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-776bc92d-266e-4eb2-9b90-42daeb92900c admin admin] The token cache is being invalidate because project df3895fc64844b1091195b0302f5db84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:30:15.401192 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-776bc92d-266e-4eb2-9b90-42daeb92900c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:15.401800 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-776bc92d-266e-4eb2-9b90-42daeb92900c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:15.403299 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1266/2581] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:30:15 2022] DELETE /identity/v3/projects/df3895fc64844b1091195b0302f5db84 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:15.407421 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39557849-77b9-4487-b542-949f58cc9d45 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:15.420525 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39557849-77b9-4487-b542-949f58cc9d45 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:15.441804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:15.481071 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec877c7-0a57-452c-9f46-c995ab525c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:15.481700 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec877c7-0a57-452c-9f46-c995ab525c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:15.481974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec877c7-0a57-452c-9f46-c995ab525c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:15.482242 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec877c7-0a57-452c-9f46-c995ab525c50 admin admin] PATH_INFO: `/v3/users/2accd80d17d2420db3d19f7afcefe3b1` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:15.483380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec877c7-0a57-452c-9f46-c995ab525c50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2accd80d17d2420db3d19f7afcefe3b1)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:15.485382 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec877c7-0a57-452c-9f46-c995ab525c50 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:15.702440 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-cec877c7-0a57-452c-9f46-c995ab525c50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2accd80d17d2420db3d19f7afcefe3b1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:15.703149 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-cec877c7-0a57-452c-9f46-c995ab525c50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2accd80d17d2420db3d19f7afcefe3b1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:15.767720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-cec877c7-0a57-452c-9f46-c995ab525c50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2accd80d17d2420db3d19f7afcefe3b1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:15.782219 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-cec877c7-0a57-452c-9f46-c995ab525c50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2accd80d17d2420db3d19f7afcefe3b1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:15.782923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-cec877c7-0a57-452c-9f46-c995ab525c50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2accd80d17d2420db3d19f7afcefe3b1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:15.796108 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1316/2582] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:30:15 2022] DELETE /identity/v3/users/2accd80d17d2420db3d19f7afcefe3b1 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:16.298991 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bc92d-266e-4eb2-9b90-42daeb92900c admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:16.300414 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-776bc92d-266e-4eb2-9b90-42daeb92900c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:16.315173 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bc92d-266e-4eb2-9b90-42daeb92900c admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:16.373371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32aa351-82d8-4211-9782-c6eebbbe384c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:16.374025 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32aa351-82d8-4211-9782-c6eebbbe384c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:16.374300 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32aa351-82d8-4211-9782-c6eebbbe384c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:16.374571 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32aa351-82d8-4211-9782-c6eebbbe384c admin admin] PATH_INFO: `/v3/projects/a52a180b88fe48a79c7a84bfec75f048` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:16.375726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32aa351-82d8-4211-9782-c6eebbbe384c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a52a180b88fe48a79c7a84bfec75f048)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:16.377739 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32aa351-82d8-4211-9782-c6eebbbe384c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:16.464652 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:16.480817 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f32aa351-82d8-4211-9782-c6eebbbe384c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a52a180b88fe48a79c7a84bfec75f048', 'request_id': 'req-f32aa351-82d8-4211-9782-c6eebbbe384c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:16.487030 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f32aa351-82d8-4211-9782-c6eebbbe384c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a52a180b88fe48a79c7a84bfec75f048', 'request_id': 'req-f32aa351-82d8-4211-9782-c6eebbbe384c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:16.492974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f32aa351-82d8-4211-9782-c6eebbbe384c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a52a180b88fe48a79c7a84bfec75f048', 'request_id': 'req-f32aa351-82d8-4211-9782-c6eebbbe384c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:16.575983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f32aa351-82d8-4211-9782-c6eebbbe384c admin admin] The token cache is being invalidate because project a52a180b88fe48a79c7a84bfec75f048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:30:16.576221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f32aa351-82d8-4211-9782-c6eebbbe384c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:16.576874 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f32aa351-82d8-4211-9782-c6eebbbe384c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:16.580725 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1267/2583] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:30:16 2022] DELETE /identity/v3/projects/a52a180b88fe48a79c7a84bfec75f048 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:16.583344 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecdf03-8fdb-4240-afd3-e425405d3a0b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:16.583800 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecdf03-8fdb-4240-afd3-e425405d3a0b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:16.583900 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecdf03-8fdb-4240-afd3-e425405d3a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:16.603929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-07ecdf03-8fdb-4240-afd3-e425405d3a0b None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:16.609416 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-07ecdf03-8fdb-4240-afd3-e425405d3a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:16.670284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1317/2584] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:30:16.679766 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924378c-a69f-48dc-9d79-d5568e462acc None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:16.680163 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924378c-a69f-48dc-9d79-d5568e462acc None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:16.680536 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924378c-a69f-48dc-9d79-d5568e462acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:16.700825 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-1924378c-a69f-48dc-9d79-d5568e462acc None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:16.703598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1924378c-a69f-48dc-9d79-d5568e462acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:16.713738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1268/2585] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:16.717012 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecdf03-8fdb-4240-afd3-e425405d3a0b None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:16.724564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924378c-a69f-48dc-9d79-d5568e462acc None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:16.726010 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1924378c-a69f-48dc-9d79-d5568e462acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:16.726650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecdf03-8fdb-4240-afd3-e425405d3a0b None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:16.731335 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0a0d6-9263-402a-9a34-2f5295472f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:16.731948 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0a0d6-9263-402a-9a34-2f5295472f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:16.732260 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0a0d6-9263-402a-9a34-2f5295472f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:16.732530 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0a0d6-9263-402a-9a34-2f5295472f44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:16.733270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0a0d6-9263-402a-9a34-2f5295472f44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:30:16.733573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0a0d6-9263-402a-9a34-2f5295472f44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:16.735152 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0a0d6-9263-402a-9a34-2f5295472f44 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:16.749819 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1318/2586] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:30:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:30:16.754007 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0a0d6-9263-402a-9a34-2f5295472f44 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:16.763974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0a0d6-9263-402a-9a34-2f5295472f44 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:16.768585 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26fb37-5265-4636-a343-c042b168fdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:16.769621 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26fb37-5265-4636-a343-c042b168fdac admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:16.770343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26fb37-5265-4636-a343-c042b168fdac admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:16.770343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26fb37-5265-4636-a343-c042b168fdac admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:16.770915 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26fb37-5265-4636-a343-c042b168fdac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:16.772892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26fb37-5265-4636-a343-c042b168fdac admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:16.795406 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924378c-a69f-48dc-9d79-d5568e462acc None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:16.799113 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c283d5-a64d-49e3-b871-7f4795f70bed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:16.799733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c283d5-a64d-49e3-b871-7f4795f70bed service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:16.800016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c283d5-a64d-49e3-b871-7f4795f70bed service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:16.800291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c283d5-a64d-49e3-b871-7f4795f70bed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:16.802789 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-62c283d5-a64d-49e3-b871-7f4795f70bed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:16.815261 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c283d5-a64d-49e3-b871-7f4795f70bed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:16.816784 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c283d5-a64d-49e3-b871-7f4795f70bed service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:16.826928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1269/2587] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:30:16.904630 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1319/2588] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:30:16 2022] POST /identity/v3/projects => generated 378 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:30:16.908993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c283d5-a64d-49e3-b871-7f4795f70bed service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:16.919896 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c283d5-a64d-49e3-b871-7f4795f70bed service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:16.981980 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b2e3a-306b-4116-98f2-a008de270cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:16.982603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b2e3a-306b-4116-98f2-a008de270cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:16.982889 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b2e3a-306b-4116-98f2-a008de270cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:16.983151 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b2e3a-306b-4116-98f2-a008de270cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:16.983813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b2e3a-306b-4116-98f2-a008de270cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:16.985786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b2e3a-306b-4116-98f2-a008de270cb8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:17.075371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1270/2589] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:30:16 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:30:17.079545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26fb37-5265-4636-a343-c042b168fdac admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:17.091301 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26fb37-5265-4636-a343-c042b168fdac admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:17.096060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdd8de-8dc7-4de2-8546-fd69c55520ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:17.096774 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdd8de-8dc7-4de2-8546-fd69c55520ae admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:17.097412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdd8de-8dc7-4de2-8546-fd69c55520ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:17.097692 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdd8de-8dc7-4de2-8546-fd69c55520ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:17.101945 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdd8de-8dc7-4de2-8546-fd69c55520ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:17.106412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdd8de-8dc7-4de2-8546-fd69c55520ae admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:17.106612 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:17.119556 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1320/2590] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:17 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:30:17.124112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b2e3a-306b-4116-98f2-a008de270cb8 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:17.135473 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b2e3a-306b-4116-98f2-a008de270cb8 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:17.140220 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00ff8b-5c05-4bc8-9c29-6f731bb3e9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:17.141380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00ff8b-5c05-4bc8-9c29-6f731bb3e9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:17.141524 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00ff8b-5c05-4bc8-9c29-6f731bb3e9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:17.141854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00ff8b-5c05-4bc8-9c29-6f731bb3e9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:17.142610 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00ff8b-5c05-4bc8-9c29-6f731bb3e9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:17.144312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00ff8b-5c05-4bc8-9c29-6f731bb3e9b8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:17.155900 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1271/2591] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:17 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:30:17.160197 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdd8de-8dc7-4de2-8546-fd69c55520ae admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:17.170841 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdd8de-8dc7-4de2-8546-fd69c55520ae admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:17.175727 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b34137-63e7-4db8-aa13-1779d670d26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:17.176924 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b34137-63e7-4db8-aa13-1779d670d26e admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:17.177298 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b34137-63e7-4db8-aa13-1779d670d26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:17.177573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b34137-63e7-4db8-aa13-1779d670d26e admin admin] PATH_INFO: `/v3/projects/c050d8d1898c4199b661fe0d048ead22/users/072f7fecc5f54619ba26c00a4588347d/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:17.194147 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b34137-63e7-4db8-aa13-1779d670d26e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c050d8d1898c4199b661fe0d048ead22, user_id=072f7fecc5f54619ba26c00a4588347d, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:17.196846 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b34137-63e7-4db8-aa13-1779d670d26e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:17.330213 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1321/2592] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:30:17 2022] PUT /identity/v3/projects/c050d8d1898c4199b661fe0d048ead22/users/072f7fecc5f54619ba26c00a4588347d/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:17.340563 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef400f4-fdd6-47e6-88b5-a239f34d9c8b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:17.341166 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef400f4-fdd6-47e6-88b5-a239f34d9c8b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:17.341166 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef400f4-fdd6-47e6-88b5-a239f34d9c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:17.374193 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-6ef400f4-fdd6-47e6-88b5-a239f34d9c8b None None] MFA Rules not processed for user `072f7fecc5f54619ba26c00a4588347d`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:17.375425 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6ef400f4-fdd6-47e6-88b5-a239f34d9c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:17.396459 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:17.450725 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1272/2593] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:17.455373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b34137-63e7-4db8-aa13-1779d670d26e admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:17.529698 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b34137-63e7-4db8-aa13-1779d670d26e admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:17.539662 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea237a5a-99bd-420e-ae3a-fd82913ee53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:17.541996 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea237a5a-99bd-420e-ae3a-fd82913ee53f admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:17.541996 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea237a5a-99bd-420e-ae3a-fd82913ee53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:17.541996 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea237a5a-99bd-420e-ae3a-fd82913ee53f admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:17.543104 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea237a5a-99bd-420e-ae3a-fd82913ee53f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:17.546076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea237a5a-99bd-420e-ae3a-fd82913ee53f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:17.647021 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1322/2594] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:30:17 2022] POST /identity/v3/projects => generated 380 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:30:17.649695 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef400f4-fdd6-47e6-88b5-a239f34d9c8b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:17.663378 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef400f4-fdd6-47e6-88b5-a239f34d9c8b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:17.742991 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b6bec-a1bc-40e2-b9df-d93cf9ebd02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:17.743610 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b6bec-a1bc-40e2-b9df-d93cf9ebd02b admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:17.743889 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b6bec-a1bc-40e2-b9df-d93cf9ebd02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:17.744160 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b6bec-a1bc-40e2-b9df-d93cf9ebd02b admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:17.744886 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b6bec-a1bc-40e2-b9df-d93cf9ebd02b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:17.746872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b6bec-a1bc-40e2-b9df-d93cf9ebd02b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:17.844249 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1273/2595] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:30:17 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:30:17.848029 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea237a5a-99bd-420e-ae3a-fd82913ee53f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:17.861957 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea237a5a-99bd-420e-ae3a-fd82913ee53f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:17.874366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eabe69-365f-47b8-9297-d756497c5ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:17.875319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eabe69-365f-47b8-9297-d756497c5ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:17.875712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eabe69-365f-47b8-9297-d756497c5ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:17.876094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eabe69-365f-47b8-9297-d756497c5ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:17.876860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eabe69-365f-47b8-9297-d756497c5ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:17.879947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eabe69-365f-47b8-9297-d756497c5ff4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:17.901429 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1323/2596] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:17 2022] GET /identity/v3/roles => generated 1427 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:30:17.905918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b6bec-a1bc-40e2-b9df-d93cf9ebd02b admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:17.923286 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b6bec-a1bc-40e2-b9df-d93cf9ebd02b admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:17.938357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d363c5-66e6-404f-9694-f139561bf134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:17.940725 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d363c5-66e6-404f-9694-f139561bf134 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:17.940725 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d363c5-66e6-404f-9694-f139561bf134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:17.941027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d363c5-66e6-404f-9694-f139561bf134 admin admin] PATH_INFO: `/v3/projects/bf4a06f80256408abf44da85d9b72944/users/ec3f67bfdf974587b08f4eb8030e27ec/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:17.986447 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d363c5-66e6-404f-9694-f139561bf134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf4a06f80256408abf44da85d9b72944, user_id=ec3f67bfdf974587b08f4eb8030e27ec, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:17.989352 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d363c5-66e6-404f-9694-f139561bf134 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:18.059141 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1274/2597] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:30:17 2022] PUT /identity/v3/projects/bf4a06f80256408abf44da85d9b72944/users/ec3f67bfdf974587b08f4eb8030e27ec/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:18.063314 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eabe69-365f-47b8-9297-d756497c5ff4 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:18.074536 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eabe69-365f-47b8-9297-d756497c5ff4 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:18.138644 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65426fd0-6d46-4a6a-b6ff-387ee8b22c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:18.140092 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65426fd0-6d46-4a6a-b6ff-387ee8b22c01 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:18.142122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65426fd0-6d46-4a6a-b6ff-387ee8b22c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:18.144592 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65426fd0-6d46-4a6a-b6ff-387ee8b22c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:18.150013 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65426fd0-6d46-4a6a-b6ff-387ee8b22c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:18.152252 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65426fd0-6d46-4a6a-b6ff-387ee8b22c01 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:18.165997 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1324/2598] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:18 2022] GET /identity/v3/roles => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:30:18.170433 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d363c5-66e6-404f-9694-f139561bf134 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:18.181653 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d363c5-66e6-404f-9694-f139561bf134 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:18.186684 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12df818-aeef-4b6b-8f47-d5684b02487f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:18.187410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12df818-aeef-4b6b-8f47-d5684b02487f admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:18.187692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12df818-aeef-4b6b-8f47-d5684b02487f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:18.187969 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12df818-aeef-4b6b-8f47-d5684b02487f admin admin] PATH_INFO: `/v3/projects/bf4a06f80256408abf44da85d9b72944/users/ec3f67bfdf974587b08f4eb8030e27ec/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:18.189944 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12df818-aeef-4b6b-8f47-d5684b02487f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf4a06f80256408abf44da85d9b72944, user_id=ec3f67bfdf974587b08f4eb8030e27ec, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:18.192699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12df818-aeef-4b6b-8f47-d5684b02487f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:18.206038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1275/2599] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:30:18 2022] PUT /identity/v3/projects/bf4a06f80256408abf44da85d9b72944/users/ec3f67bfdf974587b08f4eb8030e27ec/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:18.218258 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8f36c-bd5f-4af1-b505-ce65feecc6e3 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:18.218545 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8f36c-bd5f-4af1-b505-ce65feecc6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:18.218815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8f36c-bd5f-4af1-b505-ce65feecc6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:18.253969 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-55b8f36c-bd5f-4af1-b505-ce65feecc6e3 None None] MFA Rules not processed for user `ec3f67bfdf974587b08f4eb8030e27ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:18.255229 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-55b8f36c-bd5f-4af1-b505-ce65feecc6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:18.299561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:18.352868 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1325/2600] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:18.365798 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12df818-aeef-4b6b-8f47-d5684b02487f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:18.368179 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c12df818-aeef-4b6b-8f47-d5684b02487f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:18.432346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12df818-aeef-4b6b-8f47-d5684b02487f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:18.438270 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cdf0b-b05a-42b8-896a-a23479fbdac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:18.439357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cdf0b-b05a-42b8-896a-a23479fbdac4 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:18.439866 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cdf0b-b05a-42b8-896a-a23479fbdac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:18.440361 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cdf0b-b05a-42b8-896a-a23479fbdac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:18.481433 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:18.521018 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cdf0b-b05a-42b8-896a-a23479fbdac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:18.522935 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cdf0b-b05a-42b8-896a-a23479fbdac4 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:18.533221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1276/2601] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:30:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:30:20.405414 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8f36c-bd5f-4af1-b505-ce65feecc6e3 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:20.406851 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-55b8f36c-bd5f-4af1-b505-ce65feecc6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:20.421138 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8f36c-bd5f-4af1-b505-ce65feecc6e3 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:20.425675 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d5ac6-fbdc-4f0a-b4f4-e2faac2a85a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:20.426897 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d5ac6-fbdc-4f0a-b4f4-e2faac2a85a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:20.427502 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d5ac6-fbdc-4f0a-b4f4-e2faac2a85a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:20.427983 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d5ac6-fbdc-4f0a-b4f4-e2faac2a85a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:20.439343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d5ac6-fbdc-4f0a-b4f4-e2faac2a85a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:20.440877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d5ac6-fbdc-4f0a-b4f4-e2faac2a85a2 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:20.452950 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1326/2602] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:30:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:30:20.665451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cdf0b-b05a-42b8-896a-a23479fbdac4 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:20.667173 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c45cdf0b-b05a-42b8-896a-a23479fbdac4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:20.763881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cdf0b-b05a-42b8-896a-a23479fbdac4 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:20.768931 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48c0db-e2f0-48fb-926d-a537ed14591a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda05b7b9675423e992470819d1c150a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:20.770063 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48c0db-e2f0-48fb-926d-a537ed14591a service placement] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:20.770355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48c0db-e2f0-48fb-926d-a537ed14591a service placement] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:20.770630 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48c0db-e2f0-48fb-926d-a537ed14591a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:20.772398 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1a48c0db-e2f0-48fb-926d-a537ed14591a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:20.784356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48c0db-e2f0-48fb-926d-a537ed14591a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:20.786694 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48c0db-e2f0-48fb-926d-a537ed14591a service placement] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:20.797989 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1277/2603] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:30:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:30:20.824018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d5ac6-fbdc-4f0a-b4f4-e2faac2a85a2 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:20.825484 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9e9d5ac6-fbdc-4f0a-b4f4-e2faac2a85a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:20.907060 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d5ac6-fbdc-4f0a-b4f4-e2faac2a85a2 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:20.912471 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503d2d6-180a-4d27-8bef-c2e1c35146be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:20.913184 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503d2d6-180a-4d27-8bef-c2e1c35146be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:20.913480 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503d2d6-180a-4d27-8bef-c2e1c35146be admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:20.913754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503d2d6-180a-4d27-8bef-c2e1c35146be admin admin] PATH_INFO: `/v3/users/ab89e3033bb949dfb468c2013bc6b096` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:20.915006 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503d2d6-180a-4d27-8bef-c2e1c35146be admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab89e3033bb949dfb468c2013bc6b096)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:20.917043 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503d2d6-180a-4d27-8bef-c2e1c35146be admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:21.111066 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3503d2d6-180a-4d27-8bef-c2e1c35146be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab89e3033bb949dfb468c2013bc6b096'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:21.111731 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3503d2d6-180a-4d27-8bef-c2e1c35146be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab89e3033bb949dfb468c2013bc6b096'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:21.168157 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3503d2d6-180a-4d27-8bef-c2e1c35146be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab89e3033bb949dfb468c2013bc6b096'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:21.182981 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3503d2d6-180a-4d27-8bef-c2e1c35146be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab89e3033bb949dfb468c2013bc6b096'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:21.183697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3503d2d6-180a-4d27-8bef-c2e1c35146be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab89e3033bb949dfb468c2013bc6b096'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:21.196412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1327/2604] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:30:20 2022] DELETE /identity/v3/users/ab89e3033bb949dfb468c2013bc6b096 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:21.548545 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48c0db-e2f0-48fb-926d-a537ed14591a service placement] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:21.561527 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48c0db-e2f0-48fb-926d-a537ed14591a service placement] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:21.621530 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810abce2-33c8-4d24-add0-6a144c6c1ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:21.622209 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810abce2-33c8-4d24-add0-6a144c6c1ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:21.622626 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810abce2-33c8-4d24-add0-6a144c6c1ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:21.622943 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810abce2-33c8-4d24-add0-6a144c6c1ca5 admin admin] PATH_INFO: `/v3/projects/68c67a229e254c1a947e53f16ec47dfb` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:21.624097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810abce2-33c8-4d24-add0-6a144c6c1ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68c67a229e254c1a947e53f16ec47dfb)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:21.626078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810abce2-33c8-4d24-add0-6a144c6c1ca5 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:21.730658 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-810abce2-33c8-4d24-add0-6a144c6c1ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68c67a229e254c1a947e53f16ec47dfb', 'request_id': 'req-810abce2-33c8-4d24-add0-6a144c6c1ca5'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:21.738502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-810abce2-33c8-4d24-add0-6a144c6c1ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68c67a229e254c1a947e53f16ec47dfb', 'request_id': 'req-810abce2-33c8-4d24-add0-6a144c6c1ca5'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:21.740652 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:21.746667 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-810abce2-33c8-4d24-add0-6a144c6c1ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68c67a229e254c1a947e53f16ec47dfb', 'request_id': 'req-810abce2-33c8-4d24-add0-6a144c6c1ca5'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:21.875778 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-810abce2-33c8-4d24-add0-6a144c6c1ca5 admin admin] The token cache is being invalidate because project 68c67a229e254c1a947e53f16ec47dfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:30:21.876244 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-810abce2-33c8-4d24-add0-6a144c6c1ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:21.876930 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-810abce2-33c8-4d24-add0-6a144c6c1ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:21.878454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1278/2605] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:30:21 2022] DELETE /identity/v3/projects/68c67a229e254c1a947e53f16ec47dfb => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:21.884144 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d646452-363a-4173-8c4a-021380a833b6 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:21.885085 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d646452-363a-4173-8c4a-021380a833b6 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:21.885085 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d646452-363a-4173-8c4a-021380a833b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:21.906001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-0d646452-363a-4173-8c4a-021380a833b6 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:21.916035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0d646452-363a-4173-8c4a-021380a833b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:21.956021 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:21.994268 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1328/2606] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:22.003056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5a0c8-4ed8-4b2d-abb1-0ef081fc9954 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:22.003342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5a0c8-4ed8-4b2d-abb1-0ef081fc9954 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:22.003614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5a0c8-4ed8-4b2d-abb1-0ef081fc9954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:22.025009 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-7fb5a0c8-4ed8-4b2d-abb1-0ef081fc9954 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:22.026232 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7fb5a0c8-4ed8-4b2d-abb1-0ef081fc9954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:22.034664 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1279/2607] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:22.039122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d646452-363a-4173-8c4a-021380a833b6 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:22.049465 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d646452-363a-4173-8c4a-021380a833b6 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:22.061722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a77056-ba5d-478f-aa0c-44af00222805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:22.061722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a77056-ba5d-478f-aa0c-44af00222805 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:22.061722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a77056-ba5d-478f-aa0c-44af00222805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:22.061722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a77056-ba5d-478f-aa0c-44af00222805 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:22.062206 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a77056-ba5d-478f-aa0c-44af00222805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:30:22.062206 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a77056-ba5d-478f-aa0c-44af00222805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:22.062206 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a77056-ba5d-478f-aa0c-44af00222805 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:22.072916 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1329/2608] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:30:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:30:22.077469 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5a0c8-4ed8-4b2d-abb1-0ef081fc9954 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:22.088091 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5a0c8-4ed8-4b2d-abb1-0ef081fc9954 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:22.092858 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b47b2-7fa3-474d-b2a1-a5e0c56837db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:22.096285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b47b2-7fa3-474d-b2a1-a5e0c56837db admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:22.096285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b47b2-7fa3-474d-b2a1-a5e0c56837db admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:22.096285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b47b2-7fa3-474d-b2a1-a5e0c56837db admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:22.096285 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b47b2-7fa3-474d-b2a1-a5e0c56837db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:22.096806 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b47b2-7fa3-474d-b2a1-a5e0c56837db admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:22.253096 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1280/2609] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:30:22 2022] POST /identity/v3/projects => generated 374 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:30:22.257860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a77056-ba5d-478f-aa0c-44af00222805 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:22.268418 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a77056-ba5d-478f-aa0c-44af00222805 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:22.327832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56ce73-a3fc-42db-9d15-0e214c474156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:22.328366 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56ce73-a3fc-42db-9d15-0e214c474156 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:22.328642 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56ce73-a3fc-42db-9d15-0e214c474156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:22.328967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56ce73-a3fc-42db-9d15-0e214c474156 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:22.329634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56ce73-a3fc-42db-9d15-0e214c474156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:22.331591 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56ce73-a3fc-42db-9d15-0e214c474156 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:22.433266 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1330/2610] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:30:22 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:30:22.435834 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b47b2-7fa3-474d-b2a1-a5e0c56837db admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:22.447219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b47b2-7fa3-474d-b2a1-a5e0c56837db admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:22.452494 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82ff67-9841-4704-950f-bc378802953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:22.453219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82ff67-9841-4704-950f-bc378802953e admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:22.453513 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82ff67-9841-4704-950f-bc378802953e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:22.453770 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82ff67-9841-4704-950f-bc378802953e admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:22.454596 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82ff67-9841-4704-950f-bc378802953e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:22.456124 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82ff67-9841-4704-950f-bc378802953e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:22.466679 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1281/2611] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:22 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:30:22.475000 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56ce73-a3fc-42db-9d15-0e214c474156 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:22.485098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56ce73-a3fc-42db-9d15-0e214c474156 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:22.491355 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea778fce-1003-4890-9763-c3888cfcabb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:22.497918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea778fce-1003-4890-9763-c3888cfcabb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:22.497918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea778fce-1003-4890-9763-c3888cfcabb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:22.497918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea778fce-1003-4890-9763-c3888cfcabb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:22.497918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea778fce-1003-4890-9763-c3888cfcabb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:22.497918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea778fce-1003-4890-9763-c3888cfcabb3 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:22.510607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1331/2612] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:22 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:30:22.515069 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82ff67-9841-4704-950f-bc378802953e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:22.525989 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82ff67-9841-4704-950f-bc378802953e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:22.532243 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351ede0-c354-412c-9866-4ae2c763fe9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:22.533510 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351ede0-c354-412c-9866-4ae2c763fe9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:22.533951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351ede0-c354-412c-9866-4ae2c763fe9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:22.534400 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351ede0-c354-412c-9866-4ae2c763fe9a admin admin] PATH_INFO: `/v3/projects/12db4082799f47fd8a9b218b21712897/users/f24d7d1303104c92aa281dc0c927947e/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:22.549907 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351ede0-c354-412c-9866-4ae2c763fe9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=12db4082799f47fd8a9b218b21712897, user_id=f24d7d1303104c92aa281dc0c927947e, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:22.553146 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351ede0-c354-412c-9866-4ae2c763fe9a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:22.668688 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1282/2613] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:30:22 2022] PUT /identity/v3/projects/12db4082799f47fd8a9b218b21712897/users/f24d7d1303104c92aa281dc0c927947e/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:22.680199 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fa26f-d14c-44be-a84f-2b33c1c70bff None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:22.680481 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fa26f-d14c-44be-a84f-2b33c1c70bff None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:22.680797 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fa26f-d14c-44be-a84f-2b33c1c70bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:22.708846 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d86fa26f-d14c-44be-a84f-2b33c1c70bff None None] MFA Rules not processed for user `f24d7d1303104c92aa281dc0c927947e`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:22.710084 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d86fa26f-d14c-44be-a84f-2b33c1c70bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:22.777835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1332/2614] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:22.790436 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351ede0-c354-412c-9866-4ae2c763fe9a admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:22.792160 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3351ede0-c354-412c-9866-4ae2c763fe9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:22.868495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351ede0-c354-412c-9866-4ae2c763fe9a admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:22.874146 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1f1cf-4024-4703-a358-3e73bf33531f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:22.875297 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1f1cf-4024-4703-a358-3e73bf33531f service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:22.875297 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1f1cf-4024-4703-a358-3e73bf33531f service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:22.875505 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1f1cf-4024-4703-a358-3e73bf33531f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:22.883825 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1f1cf-4024-4703-a358-3e73bf33531f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:22.885830 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1f1cf-4024-4703-a358-3e73bf33531f service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:22.894952 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1283/2615] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:30:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:30:23.125092 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fa26f-d14c-44be-a84f-2b33c1c70bff None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:23.157919 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:23.190621 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fa26f-d14c-44be-a84f-2b33c1c70bff None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:23.195018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472924f7-309b-4fb1-a65f-39a169450f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:23.195662 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472924f7-309b-4fb1-a65f-39a169450f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:23.195928 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472924f7-309b-4fb1-a65f-39a169450f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:23.196200 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472924f7-309b-4fb1-a65f-39a169450f4d admin admin] PATH_INFO: `/v3/users/f24d7d1303104c92aa281dc0c927947e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:23.197412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472924f7-309b-4fb1-a65f-39a169450f4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f24d7d1303104c92aa281dc0c927947e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:23.199331 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472924f7-309b-4fb1-a65f-39a169450f4d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:23.419091 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-472924f7-309b-4fb1-a65f-39a169450f4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f24d7d1303104c92aa281dc0c927947e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:23.419766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-472924f7-309b-4fb1-a65f-39a169450f4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f24d7d1303104c92aa281dc0c927947e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:23.502436 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-472924f7-309b-4fb1-a65f-39a169450f4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f24d7d1303104c92aa281dc0c927947e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:23.516273 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-472924f7-309b-4fb1-a65f-39a169450f4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f24d7d1303104c92aa281dc0c927947e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:23.517043 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-472924f7-309b-4fb1-a65f-39a169450f4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f24d7d1303104c92aa281dc0c927947e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:23.533875 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1333/2616] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:30:23 2022] DELETE /identity/v3/users/f24d7d1303104c92aa281dc0c927947e => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:23.538189 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a44ffc-a5f2-4299-89c9-f680e3d0ec29 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:23.538483 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a44ffc-a5f2-4299-89c9-f680e3d0ec29 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:23.538756 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a44ffc-a5f2-4299-89c9-f680e3d0ec29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:23.558804 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d3a44ffc-a5f2-4299-89c9-f680e3d0ec29 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:23.560012 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d3a44ffc-a5f2-4299-89c9-f680e3d0ec29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:23.635247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1284/2617] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:23.645913 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472924f7-309b-4fb1-a65f-39a169450f4d admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:23.647432 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-472924f7-309b-4fb1-a65f-39a169450f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:23.705906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472924f7-309b-4fb1-a65f-39a169450f4d admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:23.710468 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c63c4-ec6d-4dc9-82bd-f670a4ac408b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:23.711185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c63c4-ec6d-4dc9-82bd-f670a4ac408b service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:23.711556 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c63c4-ec6d-4dc9-82bd-f670a4ac408b service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:23.711879 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c63c4-ec6d-4dc9-82bd-f670a4ac408b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:23.721580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c63c4-ec6d-4dc9-82bd-f670a4ac408b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:23.723062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c63c4-ec6d-4dc9-82bd-f670a4ac408b service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:23.735188 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1334/2618] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:30:24.163078 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a44ffc-a5f2-4299-89c9-f680e3d0ec29 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:24.165267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d3a44ffc-a5f2-4299-89c9-f680e3d0ec29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:24.178664 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a44ffc-a5f2-4299-89c9-f680e3d0ec29 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:24.184634 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e1805-c108-4713-abfb-52af9ea6a5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:24.185139 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e1805-c108-4713-abfb-52af9ea6a5d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:24.185419 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e1805-c108-4713-abfb-52af9ea6a5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:24.186265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e1805-c108-4713-abfb-52af9ea6a5d9 admin admin] PATH_INFO: `/v3/projects/12db4082799f47fd8a9b218b21712897` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:24.187450 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e1805-c108-4713-abfb-52af9ea6a5d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12db4082799f47fd8a9b218b21712897)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:24.189448 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e1805-c108-4713-abfb-52af9ea6a5d9 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:24.191224 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:24.325095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3d0e1805-c108-4713-abfb-52af9ea6a5d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12db4082799f47fd8a9b218b21712897', 'request_id': 'req-3d0e1805-c108-4713-abfb-52af9ea6a5d9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:24.331233 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3d0e1805-c108-4713-abfb-52af9ea6a5d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12db4082799f47fd8a9b218b21712897', 'request_id': 'req-3d0e1805-c108-4713-abfb-52af9ea6a5d9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:24.338355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3d0e1805-c108-4713-abfb-52af9ea6a5d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12db4082799f47fd8a9b218b21712897', 'request_id': 'req-3d0e1805-c108-4713-abfb-52af9ea6a5d9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:24.445033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3d0e1805-c108-4713-abfb-52af9ea6a5d9 admin admin] The token cache is being invalidate because project 12db4082799f47fd8a9b218b21712897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:30:24.445692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3d0e1805-c108-4713-abfb-52af9ea6a5d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:24.446208 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3d0e1805-c108-4713-abfb-52af9ea6a5d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:24.447752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1285/2619] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:30:24 2022] DELETE /identity/v3/projects/12db4082799f47fd8a9b218b21712897 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:30:24.453177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2668d0-1611-484e-aa3a-8512345134e3 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:24.453707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2668d0-1611-484e-aa3a-8512345134e3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:24.453707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2668d0-1611-484e-aa3a-8512345134e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:24.474641 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-ce2668d0-1611-484e-aa3a-8512345134e3 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:24.475885 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ce2668d0-1611-484e-aa3a-8512345134e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:24.522945 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:24.538291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1335/2620] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:24.548360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db076d41-edf8-40b2-9f24-09072688a7b9 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:24.550113 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db076d41-edf8-40b2-9f24-09072688a7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:24.550113 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db076d41-edf8-40b2-9f24-09072688a7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:24.568607 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-db076d41-edf8-40b2-9f24-09072688a7b9 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:24.569834 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-db076d41-edf8-40b2-9f24-09072688a7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:24.578587 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1286/2621] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:24.583615 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2668d0-1611-484e-aa3a-8512345134e3 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:24.595590 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2668d0-1611-484e-aa3a-8512345134e3 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:24.601788 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a19e56-473c-497b-96e9-52d9260c67a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:24.602415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a19e56-473c-497b-96e9-52d9260c67a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:24.602718 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a19e56-473c-497b-96e9-52d9260c67a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:24.602996 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a19e56-473c-497b-96e9-52d9260c67a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:24.603774 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a19e56-473c-497b-96e9-52d9260c67a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:30:24.604084 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a19e56-473c-497b-96e9-52d9260c67a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:24.605794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a19e56-473c-497b-96e9-52d9260c67a4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:24.618105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1336/2622] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:30:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:30:24.622913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db076d41-edf8-40b2-9f24-09072688a7b9 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:24.632304 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db076d41-edf8-40b2-9f24-09072688a7b9 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:24.638226 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2a7df-89aa-4d93-8066-4361b9e17a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:24.638544 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2a7df-89aa-4d93-8066-4361b9e17a20 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:24.638958 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2a7df-89aa-4d93-8066-4361b9e17a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:24.639090 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2a7df-89aa-4d93-8066-4361b9e17a20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:24.639900 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2a7df-89aa-4d93-8066-4361b9e17a20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:24.641711 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2a7df-89aa-4d93-8066-4361b9e17a20 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:24.751711 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1287/2623] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:30:24 2022] POST /identity/v3/projects => generated 370 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:30:24.756019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a19e56-473c-497b-96e9-52d9260c67a4 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:24.766665 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a19e56-473c-497b-96e9-52d9260c67a4 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:24.829558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1252eea-3c7a-45a2-9ced-614ae9834edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:24.830142 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1252eea-3c7a-45a2-9ced-614ae9834edc admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:24.830377 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1252eea-3c7a-45a2-9ced-614ae9834edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:24.830742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1252eea-3c7a-45a2-9ced-614ae9834edc admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:24.831297 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1252eea-3c7a-45a2-9ced-614ae9834edc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:24.833370 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1252eea-3c7a-45a2-9ced-614ae9834edc admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:24.970385 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1337/2624] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:30:24 2022] POST /identity/v3/users => generated 286 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:30:24.973583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2a7df-89aa-4d93-8066-4361b9e17a20 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:24.973759 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1252eea-3c7a-45a2-9ced-614ae9834edc admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:24.975708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e1252eea-3c7a-45a2-9ced-614ae9834edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:24.986327 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2a7df-89aa-4d93-8066-4361b9e17a20 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:24.988022 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1252eea-3c7a-45a2-9ced-614ae9834edc admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:24.995235 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665b937-bc85-4077-b709-4c54ae172b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:24.995907 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665b937-bc85-4077-b709-4c54ae172b3f admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:24.996237 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665b937-bc85-4077-b709-4c54ae172b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:24.996493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665b937-bc85-4077-b709-4c54ae172b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:24.996610 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cb991-53a2-4aed-b9c1-bfe0516c4794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:24.997419 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665b937-bc85-4077-b709-4c54ae172b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:24.997556 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cb991-53a2-4aed-b9c1-bfe0516c4794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:24.997556 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cb991-53a2-4aed-b9c1-bfe0516c4794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:24.997899 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cb991-53a2-4aed-b9c1-bfe0516c4794 admin admin] PATH_INFO: `/v3/users/072f7fecc5f54619ba26c00a4588347d` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:24.998962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cb991-53a2-4aed-b9c1-bfe0516c4794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=072f7fecc5f54619ba26c00a4588347d)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:24.999128 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665b937-bc85-4077-b709-4c54ae172b3f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:25.000921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cb991-53a2-4aed-b9c1-bfe0516c4794 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:25.011222 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1288/2625] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:24 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:30:25.015978 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665b937-bc85-4077-b709-4c54ae172b3f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:25.033026 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665b937-bc85-4077-b709-4c54ae172b3f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:25.039672 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed061ec2-bc97-4193-bbed-9f0f49527ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:25.040297 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed061ec2-bc97-4193-bbed-9f0f49527ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:25.040580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed061ec2-bc97-4193-bbed-9f0f49527ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:25.040889 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed061ec2-bc97-4193-bbed-9f0f49527ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:25.041589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed061ec2-bc97-4193-bbed-9f0f49527ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:25.043300 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed061ec2-bc97-4193-bbed-9f0f49527ee5 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:25.056844 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1289/2626] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:25 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:30:25.062366 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed061ec2-bc97-4193-bbed-9f0f49527ee5 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:25.074475 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed061ec2-bc97-4193-bbed-9f0f49527ee5 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:25.079634 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25e476-4dc2-47a8-aec7-cb984799b9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:25.080263 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25e476-4dc2-47a8-aec7-cb984799b9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:25.080576 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25e476-4dc2-47a8-aec7-cb984799b9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:25.080862 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25e476-4dc2-47a8-aec7-cb984799b9e8 admin admin] PATH_INFO: `/v3/projects/7dc14b70ec184693b64ac2f25e79a3b1/users/8ec73f068a6548fea6f6bc05714554fa/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:25.099309 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25e476-4dc2-47a8-aec7-cb984799b9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc14b70ec184693b64ac2f25e79a3b1, user_id=8ec73f068a6548fea6f6bc05714554fa, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:25.099309 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25e476-4dc2-47a8-aec7-cb984799b9e8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:25.202869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1290/2627] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:30:25 2022] PUT /identity/v3/projects/7dc14b70ec184693b64ac2f25e79a3b1/users/8ec73f068a6548fea6f6bc05714554fa/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:30:25.214263 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faf8fa-8501-4120-bd36-5dd3133d0fcb None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:25.214605 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faf8fa-8501-4120-bd36-5dd3133d0fcb None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:25.214823 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faf8fa-8501-4120-bd36-5dd3133d0fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:25.250381 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-19faf8fa-8501-4120-bd36-5dd3133d0fcb None None] MFA Rules not processed for user `8ec73f068a6548fea6f6bc05714554fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:25.251708 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-19faf8fa-8501-4120-bd36-5dd3133d0fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:25.261707 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a10cb991-53a2-4aed-b9c1-bfe0516c4794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '072f7fecc5f54619ba26c00a4588347d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:25.262614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a10cb991-53a2-4aed-b9c1-bfe0516c4794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '072f7fecc5f54619ba26c00a4588347d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:25.333758 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1291/2628] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:30:25.338965 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faf8fa-8501-4120-bd36-5dd3133d0fcb None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:25.347591 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:25.367794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a10cb991-53a2-4aed-b9c1-bfe0516c4794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '072f7fecc5f54619ba26c00a4588347d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:25.404390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a10cb991-53a2-4aed-b9c1-bfe0516c4794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '072f7fecc5f54619ba26c00a4588347d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:25.405665 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a10cb991-53a2-4aed-b9c1-bfe0516c4794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '072f7fecc5f54619ba26c00a4588347d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:25.428727 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1338/2629] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:30:24 2022] DELETE /identity/v3/users/072f7fecc5f54619ba26c00a4588347d => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:30:25.434129 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691c029-1648-4672-a0e1-2859f17025f0 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:25.434468 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691c029-1648-4672-a0e1-2859f17025f0 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:25.434648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691c029-1648-4672-a0e1-2859f17025f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:25.443805 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faf8fa-8501-4120-bd36-5dd3133d0fcb None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:25.456929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-0691c029-1648-4672-a0e1-2859f17025f0 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:25.458248 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0691c029-1648-4672-a0e1-2859f17025f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:25.521207 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:25.534622 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743668c-20e9-4eda-b830-6be27846d139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:25.535582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743668c-20e9-4eda-b830-6be27846d139 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:25.535862 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743668c-20e9-4eda-b830-6be27846d139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:25.536137 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743668c-20e9-4eda-b830-6be27846d139 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:25.537150 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743668c-20e9-4eda-b830-6be27846d139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:25.540038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743668c-20e9-4eda-b830-6be27846d139 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:25.557592 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1339/2630] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:30:25.571842 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691c029-1648-4672-a0e1-2859f17025f0 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:25.573864 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0691c029-1648-4672-a0e1-2859f17025f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:25.663385 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691c029-1648-4672-a0e1-2859f17025f0 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:25.667488 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d2d29-3364-4395-8090-57e507880587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:25.668143 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d2d29-3364-4395-8090-57e507880587 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:25.668424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d2d29-3364-4395-8090-57e507880587 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:25.668724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d2d29-3364-4395-8090-57e507880587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:25.679308 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d2d29-3364-4395-8090-57e507880587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:25.680849 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d2d29-3364-4395-8090-57e507880587 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:25.690626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1340/2631] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:30:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:30:25.978085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1292/2632] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:30:25 2022] POST /identity/v3/projects => generated 366 bytes in 640 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:30:25.982438 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d2d29-3364-4395-8090-57e507880587 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:25.984180 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-818d2d29-3364-4395-8090-57e507880587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:25.999689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d2d29-3364-4395-8090-57e507880587 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:26.073393 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfcf5c-17cc-48bc-86b9-313500efc3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:26.074381 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfcf5c-17cc-48bc-86b9-313500efc3fa admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:26.074694 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfcf5c-17cc-48bc-86b9-313500efc3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:26.075006 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfcf5c-17cc-48bc-86b9-313500efc3fa admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:26.075754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfcf5c-17cc-48bc-86b9-313500efc3fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:26.077822 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfcf5c-17cc-48bc-86b9-313500efc3fa admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:26.189417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1341/2633] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:30:25 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:30:26.190909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743668c-20e9-4eda-b830-6be27846d139 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:26.209713 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743668c-20e9-4eda-b830-6be27846d139 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:26.226282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301fb9c-cb9f-483b-9710-9b1490211eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:26.226922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301fb9c-cb9f-483b-9710-9b1490211eae admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:26.227202 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301fb9c-cb9f-483b-9710-9b1490211eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:26.227855 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301fb9c-cb9f-483b-9710-9b1490211eae admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:26.228542 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301fb9c-cb9f-483b-9710-9b1490211eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:26.230191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301fb9c-cb9f-483b-9710-9b1490211eae admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:26.243089 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1293/2634] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:26 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:30:26.248168 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfcf5c-17cc-48bc-86b9-313500efc3fa admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:26.262009 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfcf5c-17cc-48bc-86b9-313500efc3fa admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:26.272465 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7380e-9cad-4282-a28c-8cb829a48026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:26.273418 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7380e-9cad-4282-a28c-8cb829a48026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:26.279606 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7380e-9cad-4282-a28c-8cb829a48026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:26.279606 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7380e-9cad-4282-a28c-8cb829a48026 admin admin] PATH_INFO: `/v3/projects/92ca47de5291443a9d4e692601b325f3/users/3bfe9f2ffcda43f380d3632ec70d8257/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:26.301544 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7380e-9cad-4282-a28c-8cb829a48026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ca47de5291443a9d4e692601b325f3, user_id=3bfe9f2ffcda43f380d3632ec70d8257, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:26.304515 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7380e-9cad-4282-a28c-8cb829a48026 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:26.337123 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301fb9c-cb9f-483b-9710-9b1490211eae admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:26.340001 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8301fb9c-cb9f-483b-9710-9b1490211eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:26.362922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301fb9c-cb9f-483b-9710-9b1490211eae admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:26.370486 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f189ba-2a03-445a-8add-b6e66217a185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:26.371297 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f189ba-2a03-445a-8add-b6e66217a185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:26.371670 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f189ba-2a03-445a-8add-b6e66217a185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:26.371831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f189ba-2a03-445a-8add-b6e66217a185 admin admin] PATH_INFO: `/v3/projects/c050d8d1898c4199b661fe0d048ead22` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:26.377579 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f189ba-2a03-445a-8add-b6e66217a185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c050d8d1898c4199b661fe0d048ead22)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:26.377579 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f189ba-2a03-445a-8add-b6e66217a185 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:26.436702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1342/2635] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:30:26 2022] PUT /identity/v3/projects/92ca47de5291443a9d4e692601b325f3/users/3bfe9f2ffcda43f380d3632ec70d8257/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:26.441061 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7380e-9cad-4282-a28c-8cb829a48026 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:26.500534 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:26.517909 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7380e-9cad-4282-a28c-8cb829a48026 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:26.523418 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2ecd7-597f-4db4-8976-c07149870f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:26.524216 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2ecd7-597f-4db4-8976-c07149870f47 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:26.524542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2ecd7-597f-4db4-8976-c07149870f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:26.524902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2ecd7-597f-4db4-8976-c07149870f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:26.525715 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2ecd7-597f-4db4-8976-c07149870f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:26.527412 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2ecd7-597f-4db4-8976-c07149870f47 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:26.539339 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1343/2636] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:26 2022] GET /identity/v3/roles => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:30:26.543893 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-35f189ba-2a03-445a-8add-b6e66217a185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c050d8d1898c4199b661fe0d048ead22', 'request_id': 'req-35f189ba-2a03-445a-8add-b6e66217a185'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:26.547105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2ecd7-597f-4db4-8976-c07149870f47 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:26.559415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-35f189ba-2a03-445a-8add-b6e66217a185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c050d8d1898c4199b661fe0d048ead22', 'request_id': 'req-35f189ba-2a03-445a-8add-b6e66217a185'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:26.563851 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2ecd7-597f-4db4-8976-c07149870f47 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:26.571943 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-35f189ba-2a03-445a-8add-b6e66217a185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c050d8d1898c4199b661fe0d048ead22', 'request_id': 'req-35f189ba-2a03-445a-8add-b6e66217a185'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:26.641703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d52a1a-7f15-47a7-8f5a-9d44eba42812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:26.642367 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d52a1a-7f15-47a7-8f5a-9d44eba42812 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:26.642644 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d52a1a-7f15-47a7-8f5a-9d44eba42812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:26.642916 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d52a1a-7f15-47a7-8f5a-9d44eba42812 admin admin] PATH_INFO: `/v3/projects/92ca47de5291443a9d4e692601b325f3/users/3bfe9f2ffcda43f380d3632ec70d8257/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:26.646061 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d52a1a-7f15-47a7-8f5a-9d44eba42812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ca47de5291443a9d4e692601b325f3, user_id=3bfe9f2ffcda43f380d3632ec70d8257, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:26.648802 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d52a1a-7f15-47a7-8f5a-9d44eba42812 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:26.664494 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-35f189ba-2a03-445a-8add-b6e66217a185 admin admin] The token cache is being invalidate because project c050d8d1898c4199b661fe0d048ead22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:30:26.664956 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-35f189ba-2a03-445a-8add-b6e66217a185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:26.666247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-35f189ba-2a03-445a-8add-b6e66217a185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:26.667093 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1344/2637] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:30:26 2022] PUT /identity/v3/projects/92ca47de5291443a9d4e692601b325f3/users/3bfe9f2ffcda43f380d3632ec70d8257/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:26.669230 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1294/2638] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:30:26 2022] DELETE /identity/v3/projects/c050d8d1898c4199b661fe0d048ead22 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:26.673803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d52a1a-7f15-47a7-8f5a-9d44eba42812 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:26.677008 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-56d52a1a-7f15-47a7-8f5a-9d44eba42812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:26.682663 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281edd8-5e94-4c1c-9a3b-82bd3ba32563 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:26.682943 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281edd8-5e94-4c1c-9a3b-82bd3ba32563 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:26.683225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281edd8-5e94-4c1c-9a3b-82bd3ba32563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:26.709969 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:26.723011 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-1281edd8-5e94-4c1c-9a3b-82bd3ba32563 None None] MFA Rules not processed for user `3bfe9f2ffcda43f380d3632ec70d8257`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:26.725759 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1281edd8-5e94-4c1c-9a3b-82bd3ba32563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:26.772633 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d52a1a-7f15-47a7-8f5a-9d44eba42812 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:26.779447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f0fca-5bd5-4b0f-9b23-2ce86f5b964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:26.780150 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f0fca-5bd5-4b0f-9b23-2ce86f5b964b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:26.780428 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f0fca-5bd5-4b0f-9b23-2ce86f5b964b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:26.780943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f0fca-5bd5-4b0f-9b23-2ce86f5b964b admin admin] PATH_INFO: `/v3/users/ec3f67bfdf974587b08f4eb8030e27ec` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:26.782166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f0fca-5bd5-4b0f-9b23-2ce86f5b964b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec3f67bfdf974587b08f4eb8030e27ec)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:26.784336 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f0fca-5bd5-4b0f-9b23-2ce86f5b964b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:26.830474 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1295/2639] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:30:26.844431 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281edd8-5e94-4c1c-9a3b-82bd3ba32563 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:26.846099 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1281edd8-5e94-4c1c-9a3b-82bd3ba32563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:26.911023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281edd8-5e94-4c1c-9a3b-82bd3ba32563 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:26.917525 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858afc35-11ae-4b88-8ef9-14572a8315b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:26.918172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858afc35-11ae-4b88-8ef9-14572a8315b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:26.918454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858afc35-11ae-4b88-8ef9-14572a8315b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:26.918727 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858afc35-11ae-4b88-8ef9-14572a8315b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:26.930796 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858afc35-11ae-4b88-8ef9-14572a8315b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:26.933656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858afc35-11ae-4b88-8ef9-14572a8315b2 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:26.948614 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1296/2640] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:30:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:30:27.097198 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6f6f0fca-5bd5-4b0f-9b23-2ce86f5b964b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec3f67bfdf974587b08f4eb8030e27ec'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:27.097943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6f6f0fca-5bd5-4b0f-9b23-2ce86f5b964b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec3f67bfdf974587b08f4eb8030e27ec'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:27.132936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858afc35-11ae-4b88-8ef9-14572a8315b2 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:27.134343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-858afc35-11ae-4b88-8ef9-14572a8315b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:27.147065 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858afc35-11ae-4b88-8ef9-14572a8315b2 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:27.151233 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1761c6-6765-495c-960b-db45325a4272 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:27.151849 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1761c6-6765-495c-960b-db45325a4272 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:27.152130 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1761c6-6765-495c-960b-db45325a4272 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:27.152402 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1761c6-6765-495c-960b-db45325a4272 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:27.154306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0f1761c6-6765-495c-960b-db45325a4272 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:27.177294 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6f6f0fca-5bd5-4b0f-9b23-2ce86f5b964b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec3f67bfdf974587b08f4eb8030e27ec'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:27.192929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6f6f0fca-5bd5-4b0f-9b23-2ce86f5b964b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec3f67bfdf974587b08f4eb8030e27ec'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:27.193740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6f6f0fca-5bd5-4b0f-9b23-2ce86f5b964b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec3f67bfdf974587b08f4eb8030e27ec'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:27.202607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:27.212147 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1345/2641] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:30:26 2022] DELETE /identity/v3/users/ec3f67bfdf974587b08f4eb8030e27ec => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:27.246028 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1761c6-6765-495c-960b-db45325a4272 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:27.246028 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1761c6-6765-495c-960b-db45325a4272 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:27.246028 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1297/2642] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:30:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:30:27.768815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f0fca-5bd5-4b0f-9b23-2ce86f5b964b admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:27.770699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6f6f0fca-5bd5-4b0f-9b23-2ce86f5b964b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:27.857097 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f0fca-5bd5-4b0f-9b23-2ce86f5b964b admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:27.862861 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731cc47-da0c-4914-be51-4607110397ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:27.864576 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731cc47-da0c-4914-be51-4607110397ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:27.864858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731cc47-da0c-4914-be51-4607110397ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:27.865135 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731cc47-da0c-4914-be51-4607110397ad admin admin] PATH_INFO: `/v3/projects/bf4a06f80256408abf44da85d9b72944` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:27.866385 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731cc47-da0c-4914-be51-4607110397ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf4a06f80256408abf44da85d9b72944)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:27.868310 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731cc47-da0c-4914-be51-4607110397ad admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:28.077160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a731cc47-da0c-4914-be51-4607110397ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf4a06f80256408abf44da85d9b72944', 'request_id': 'req-a731cc47-da0c-4914-be51-4607110397ad'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:28.087592 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a731cc47-da0c-4914-be51-4607110397ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf4a06f80256408abf44da85d9b72944', 'request_id': 'req-a731cc47-da0c-4914-be51-4607110397ad'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:28.100012 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a731cc47-da0c-4914-be51-4607110397ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf4a06f80256408abf44da85d9b72944', 'request_id': 'req-a731cc47-da0c-4914-be51-4607110397ad'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:28.221505 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a731cc47-da0c-4914-be51-4607110397ad admin admin] The token cache is being invalidate because project bf4a06f80256408abf44da85d9b72944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:30:28.221839 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a731cc47-da0c-4914-be51-4607110397ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:28.223200 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a731cc47-da0c-4914-be51-4607110397ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:28.224873 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1346/2643] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:30:27 2022] DELETE /identity/v3/projects/bf4a06f80256408abf44da85d9b72944 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:28.231539 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05502def-7bda-4d82-a8a0-977aeabcdeca None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:28.231539 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05502def-7bda-4d82-a8a0-977aeabcdeca None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:28.231852 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05502def-7bda-4d82-a8a0-977aeabcdeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:28.265401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-05502def-7bda-4d82-a8a0-977aeabcdeca None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:28.266645 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-05502def-7bda-4d82-a8a0-977aeabcdeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:28.318947 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:28.372701 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1298/2644] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:30:28.381771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374d671-e3a8-4fd2-a888-e36ffc8ef0fe None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:28.382052 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374d671-e3a8-4fd2-a888-e36ffc8ef0fe None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:28.382427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374d671-e3a8-4fd2-a888-e36ffc8ef0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:28.407311 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c374d671-e3a8-4fd2-a888-e36ffc8ef0fe None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:28.408565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c374d671-e3a8-4fd2-a888-e36ffc8ef0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:28.420929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1347/2645] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:28.425169 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05502def-7bda-4d82-a8a0-977aeabcdeca None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:28.439629 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05502def-7bda-4d82-a8a0-977aeabcdeca None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:28.449386 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71774249-2e97-4168-8eaa-a8ee7452b570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:28.449386 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71774249-2e97-4168-8eaa-a8ee7452b570 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:28.449386 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71774249-2e97-4168-8eaa-a8ee7452b570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:28.450026 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71774249-2e97-4168-8eaa-a8ee7452b570 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:28.450560 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71774249-2e97-4168-8eaa-a8ee7452b570 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:30:28.450837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71774249-2e97-4168-8eaa-a8ee7452b570 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:28.452743 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71774249-2e97-4168-8eaa-a8ee7452b570 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:28.470739 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1299/2646] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:30:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:30:28.475048 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374d671-e3a8-4fd2-a888-e36ffc8ef0fe None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:28.485005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374d671-e3a8-4fd2-a888-e36ffc8ef0fe None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:28.491825 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca533102-5a28-40e2-a887-8d2797a879b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:28.492831 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca533102-5a28-40e2-a887-8d2797a879b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:28.493177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca533102-5a28-40e2-a887-8d2797a879b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:28.493517 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca533102-5a28-40e2-a887-8d2797a879b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:28.494649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca533102-5a28-40e2-a887-8d2797a879b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:28.497628 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca533102-5a28-40e2-a887-8d2797a879b6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:28.593124 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1348/2647] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:30:28 2022] POST /identity/v3/projects => generated 410 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:30:28.598334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71774249-2e97-4168-8eaa-a8ee7452b570 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:28.609597 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71774249-2e97-4168-8eaa-a8ee7452b570 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:28.689749 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84efa0-f09b-4ff0-a46d-6fbe29ce51b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:28.690625 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84efa0-f09b-4ff0-a46d-6fbe29ce51b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:28.691969 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84efa0-f09b-4ff0-a46d-6fbe29ce51b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:28.691969 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84efa0-f09b-4ff0-a46d-6fbe29ce51b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:28.692846 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84efa0-f09b-4ff0-a46d-6fbe29ce51b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:28.694966 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84efa0-f09b-4ff0-a46d-6fbe29ce51b6 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:28.847164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1300/2648] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:30:28 2022] POST /identity/v3/users => generated 306 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:30:28.852209 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca533102-5a28-40e2-a887-8d2797a879b6 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:28.868916 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca533102-5a28-40e2-a887-8d2797a879b6 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:28.876798 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb0eec-0f55-43c4-b248-a192c14bb8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:28.877872 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb0eec-0f55-43c4-b248-a192c14bb8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:28.878274 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb0eec-0f55-43c4-b248-a192c14bb8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:28.879439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb0eec-0f55-43c4-b248-a192c14bb8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:28.880558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb0eec-0f55-43c4-b248-a192c14bb8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:28.884382 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb0eec-0f55-43c4-b248-a192c14bb8a7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:28.896737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1349/2649] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:28 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:30:28.901524 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84efa0-f09b-4ff0-a46d-6fbe29ce51b6 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:28.913836 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84efa0-f09b-4ff0-a46d-6fbe29ce51b6 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:28.922486 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334473a-74fe-4827-82c2-dca1f1b775f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:28.923287 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334473a-74fe-4827-82c2-dca1f1b775f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:28.923926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334473a-74fe-4827-82c2-dca1f1b775f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:28.923926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334473a-74fe-4827-82c2-dca1f1b775f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:28.924556 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334473a-74fe-4827-82c2-dca1f1b775f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:28.926383 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334473a-74fe-4827-82c2-dca1f1b775f5 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:28.939666 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1301/2650] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:28 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:30:28.951504 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb0eec-0f55-43c4-b248-a192c14bb8a7 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:28.963965 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb0eec-0f55-43c4-b248-a192c14bb8a7 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:28.970152 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ff649-d4c4-4281-b310-ae99f615c61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:28.970972 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ff649-d4c4-4281-b310-ae99f615c61c admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:28.972058 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ff649-d4c4-4281-b310-ae99f615c61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:28.972328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ff649-d4c4-4281-b310-ae99f615c61c admin admin] PATH_INFO: `/v3/projects/bb6647573d4247c9ad327b6647f668e8/users/85f5879659684984a688f0c4bb75ba08/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:28.993064 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ff649-d4c4-4281-b310-ae99f615c61c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb6647573d4247c9ad327b6647f668e8, user_id=85f5879659684984a688f0c4bb75ba08, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:28.996285 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ff649-d4c4-4281-b310-ae99f615c61c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:29.082245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1350/2651] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:30:28 2022] PUT /identity/v3/projects/bb6647573d4247c9ad327b6647f668e8/users/85f5879659684984a688f0c4bb75ba08/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:29.088259 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410c06b-ae52-4ee6-a3a7-6fd4313b0624 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:29.088552 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410c06b-ae52-4ee6-a3a7-6fd4313b0624 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:29.088884 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410c06b-ae52-4ee6-a3a7-6fd4313b0624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:29.121356 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b410c06b-ae52-4ee6-a3a7-6fd4313b0624 None None] MFA Rules not processed for user `85f5879659684984a688f0c4bb75ba08`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:29.122612 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b410c06b-ae52-4ee6-a3a7-6fd4313b0624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:29.208046 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1302/2652] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:29 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:29.218906 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ff649-d4c4-4281-b310-ae99f615c61c admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:29.260134 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:29.304202 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ff649-d4c4-4281-b310-ae99f615c61c admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:29.311705 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8926bff-e308-4795-954c-6ae44d198abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:29.312342 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8926bff-e308-4795-954c-6ae44d198abb admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:29.312621 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8926bff-e308-4795-954c-6ae44d198abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:29.319046 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8926bff-e308-4795-954c-6ae44d198abb admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:29.319046 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8926bff-e308-4795-954c-6ae44d198abb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:29.319046 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8926bff-e308-4795-954c-6ae44d198abb admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:29.544759 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1351/2653] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:30:29 2022] POST /identity/v3/projects => generated 408 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:30:29.549359 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410c06b-ae52-4ee6-a3a7-6fd4313b0624 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:29.565738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410c06b-ae52-4ee6-a3a7-6fd4313b0624 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:29.599871 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:29.646301 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f998b4-2f10-47a9-96d8-53efa78ad9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:29.647184 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f998b4-2f10-47a9-96d8-53efa78ad9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:29.647487 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f998b4-2f10-47a9-96d8-53efa78ad9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:29.648036 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f998b4-2f10-47a9-96d8-53efa78ad9c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:29.648828 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f998b4-2f10-47a9-96d8-53efa78ad9c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:29.651259 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f998b4-2f10-47a9-96d8-53efa78ad9c0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:29.755948 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1303/2654] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:30:29 2022] POST /identity/v3/users => generated 311 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:30:29.760213 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8926bff-e308-4795-954c-6ae44d198abb admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:29.775231 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8926bff-e308-4795-954c-6ae44d198abb admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:29.785480 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd4571-8047-4592-bad5-d4f13d3be827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:29.786320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd4571-8047-4592-bad5-d4f13d3be827 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:29.786603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd4571-8047-4592-bad5-d4f13d3be827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:29.786884 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd4571-8047-4592-bad5-d4f13d3be827 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:29.787708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd4571-8047-4592-bad5-d4f13d3be827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:29.790697 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd4571-8047-4592-bad5-d4f13d3be827 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:29.810521 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1352/2655] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:29 2022] GET /identity/v3/roles => generated 1427 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:30:29.815016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f998b4-2f10-47a9-96d8-53efa78ad9c0 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:29.829194 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f998b4-2f10-47a9-96d8-53efa78ad9c0 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:29.841457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12767dd-a381-42ab-a76f-fa7d2221de8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:29.842398 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12767dd-a381-42ab-a76f-fa7d2221de8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:29.842843 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12767dd-a381-42ab-a76f-fa7d2221de8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:29.843265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12767dd-a381-42ab-a76f-fa7d2221de8f admin admin] PATH_INFO: `/v3/projects/4a52e71f9a3f4eca86b27530188add44/users/4cfbd834340149afadad4b32830420ac/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:29.870175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12767dd-a381-42ab-a76f-fa7d2221de8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a52e71f9a3f4eca86b27530188add44, user_id=4cfbd834340149afadad4b32830420ac, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:29.873718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12767dd-a381-42ab-a76f-fa7d2221de8f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:29.962847 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1304/2656] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:30:29 2022] PUT /identity/v3/projects/4a52e71f9a3f4eca86b27530188add44/users/4cfbd834340149afadad4b32830420ac/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:30:29.967005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd4571-8047-4592-bad5-d4f13d3be827 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:29.982154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd4571-8047-4592-bad5-d4f13d3be827 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:30.052247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55a6b1-681e-4ff4-8480-792aecc6b96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:30.052941 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55a6b1-681e-4ff4-8480-792aecc6b96c admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:30.053224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55a6b1-681e-4ff4-8480-792aecc6b96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:30.053499 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55a6b1-681e-4ff4-8480-792aecc6b96c admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:30.054330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55a6b1-681e-4ff4-8480-792aecc6b96c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:30.056087 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55a6b1-681e-4ff4-8480-792aecc6b96c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:30.072815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1353/2657] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:29 2022] GET /identity/v3/roles => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:30:30.074073 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12767dd-a381-42ab-a76f-fa7d2221de8f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:30.085706 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12767dd-a381-42ab-a76f-fa7d2221de8f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:30.090646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b18dc8-4a48-4cc6-8915-a7be9e6c6a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:30.091453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b18dc8-4a48-4cc6-8915-a7be9e6c6a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:30.091754 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b18dc8-4a48-4cc6-8915-a7be9e6c6a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:30.092069 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b18dc8-4a48-4cc6-8915-a7be9e6c6a42 admin admin] PATH_INFO: `/v3/projects/4a52e71f9a3f4eca86b27530188add44/users/4cfbd834340149afadad4b32830420ac/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:30.094412 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b18dc8-4a48-4cc6-8915-a7be9e6c6a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a52e71f9a3f4eca86b27530188add44, user_id=4cfbd834340149afadad4b32830420ac, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:30.097310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b18dc8-4a48-4cc6-8915-a7be9e6c6a42 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:30.110702 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1305/2658] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:30:30 2022] PUT /identity/v3/projects/4a52e71f9a3f4eca86b27530188add44/users/4cfbd834340149afadad4b32830420ac/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:30.125376 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebae3a-0022-4d29-be21-982c395ab4d0 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:30.125965 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebae3a-0022-4d29-be21-982c395ab4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:30.126245 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebae3a-0022-4d29-be21-982c395ab4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:30.165413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-87ebae3a-0022-4d29-be21-982c395ab4d0 None None] MFA Rules not processed for user `4cfbd834340149afadad4b32830420ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:30.166647 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-87ebae3a-0022-4d29-be21-982c395ab4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:30.256825 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1354/2659] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:30 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:30.269830 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b18dc8-4a48-4cc6-8915-a7be9e6c6a42 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:30.271656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-09b18dc8-4a48-4cc6-8915-a7be9e6c6a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:30.350177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b18dc8-4a48-4cc6-8915-a7be9e6c6a42 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:30.355064 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbd5f2-e99f-4729-b527-cdb5fa1326a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:30.355784 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbd5f2-e99f-4729-b527-cdb5fa1326a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:30.356073 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbd5f2-e99f-4729-b527-cdb5fa1326a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:30.356346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbd5f2-e99f-4729-b527-cdb5fa1326a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:30.368981 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbd5f2-e99f-4729-b527-cdb5fa1326a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:30.370708 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbd5f2-e99f-4729-b527-cdb5fa1326a5 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:30.391513 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1306/2660] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:30:30 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:30:30.984923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebae3a-0022-4d29-be21-982c395ab4d0 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:30.986476 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-87ebae3a-0022-4d29-be21-982c395ab4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:31.001478 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebae3a-0022-4d29-be21-982c395ab4d0 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:31.007201 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51cc74-ec5b-4f92-9ae7-0e8460d3bf5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:31.008706 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51cc74-ec5b-4f92-9ae7-0e8460d3bf5f service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:31.009050 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51cc74-ec5b-4f92-9ae7-0e8460d3bf5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:31.009326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51cc74-ec5b-4f92-9ae7-0e8460d3bf5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:31.031766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:31.078405 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51cc74-ec5b-4f92-9ae7-0e8460d3bf5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:31.079841 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51cc74-ec5b-4f92-9ae7-0e8460d3bf5f service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:31.090625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1355/2661] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:30:30 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:30:33.366445 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbd5f2-e99f-4729-b527-cdb5fa1326a5 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:33.367964 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fcbbd5f2-e99f-4729-b527-cdb5fa1326a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:33.444889 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbd5f2-e99f-4729-b527-cdb5fa1326a5 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:33.450692 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003373e7-608c-4232-bf90-157947806023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:33.451389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003373e7-608c-4232-bf90-157947806023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:33.451754 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003373e7-608c-4232-bf90-157947806023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:33.452095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003373e7-608c-4232-bf90-157947806023 admin admin] PATH_INFO: `/v3/users/8ec73f068a6548fea6f6bc05714554fa` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:33.453451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003373e7-608c-4232-bf90-157947806023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec73f068a6548fea6f6bc05714554fa)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:33.455881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003373e7-608c-4232-bf90-157947806023 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:33.584548 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:33.717786 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-003373e7-608c-4232-bf90-157947806023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec73f068a6548fea6f6bc05714554fa'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:33.718509 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-003373e7-608c-4232-bf90-157947806023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec73f068a6548fea6f6bc05714554fa'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:33.731735 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-003373e7-608c-4232-bf90-157947806023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec73f068a6548fea6f6bc05714554fa'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:33.739155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-003373e7-608c-4232-bf90-157947806023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec73f068a6548fea6f6bc05714554fa'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:33.853508 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-003373e7-608c-4232-bf90-157947806023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec73f068a6548fea6f6bc05714554fa'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:33.858135 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1307/2662] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:30:33 2022] DELETE /identity/v3/users/8ec73f068a6548fea6f6bc05714554fa => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:30:33.862390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02650eb1-8d92-4d2a-a8d3-6f3647efeb89 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:33.862899 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02650eb1-8d92-4d2a-a8d3-6f3647efeb89 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:33.863926 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02650eb1-8d92-4d2a-a8d3-6f3647efeb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:33.885628 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-02650eb1-8d92-4d2a-a8d3-6f3647efeb89 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:33.887122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-02650eb1-8d92-4d2a-a8d3-6f3647efeb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:33.966588 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1356/2663] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:33.978767 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003373e7-608c-4232-bf90-157947806023 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:33.980594 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-003373e7-608c-4232-bf90-157947806023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:34.062519 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003373e7-608c-4232-bf90-157947806023 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:34.067401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f8196-e910-4ad0-a994-c51ce7c969ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:34.068319 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f8196-e910-4ad0-a994-c51ce7c969ab service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:34.068800 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f8196-e910-4ad0-a994-c51ce7c969ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:34.069212 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f8196-e910-4ad0-a994-c51ce7c969ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:34.079874 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f8196-e910-4ad0-a994-c51ce7c969ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:34.084036 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f8196-e910-4ad0-a994-c51ce7c969ab service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:34.092995 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1308/2664] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:30:34.695910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02650eb1-8d92-4d2a-a8d3-6f3647efeb89 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:34.697580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-02650eb1-8d92-4d2a-a8d3-6f3647efeb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:34.710848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02650eb1-8d92-4d2a-a8d3-6f3647efeb89 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:34.716558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935ff7f-f167-4f37-a0a3-a9a4a05f6958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:34.717301 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935ff7f-f167-4f37-a0a3-a9a4a05f6958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:34.717588 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935ff7f-f167-4f37-a0a3-a9a4a05f6958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:34.718215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935ff7f-f167-4f37-a0a3-a9a4a05f6958 admin admin] PATH_INFO: `/v3/projects/7dc14b70ec184693b64ac2f25e79a3b1` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:34.720766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935ff7f-f167-4f37-a0a3-a9a4a05f6958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc14b70ec184693b64ac2f25e79a3b1)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:34.725401 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935ff7f-f167-4f37-a0a3-a9a4a05f6958 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:34.938488 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3935ff7f-f167-4f37-a0a3-a9a4a05f6958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc14b70ec184693b64ac2f25e79a3b1', 'request_id': 'req-3935ff7f-f167-4f37-a0a3-a9a4a05f6958'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:34.948344 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3935ff7f-f167-4f37-a0a3-a9a4a05f6958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc14b70ec184693b64ac2f25e79a3b1', 'request_id': 'req-3935ff7f-f167-4f37-a0a3-a9a4a05f6958'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:34.962711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3935ff7f-f167-4f37-a0a3-a9a4a05f6958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc14b70ec184693b64ac2f25e79a3b1', 'request_id': 'req-3935ff7f-f167-4f37-a0a3-a9a4a05f6958'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:35.087703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3935ff7f-f167-4f37-a0a3-a9a4a05f6958 admin admin] The token cache is being invalidate because project 7dc14b70ec184693b64ac2f25e79a3b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:30:35.088132 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3935ff7f-f167-4f37-a0a3-a9a4a05f6958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:35.089943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3935ff7f-f167-4f37-a0a3-a9a4a05f6958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:35.092709 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1357/2665] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:30:34 2022] DELETE /identity/v3/projects/7dc14b70ec184693b64ac2f25e79a3b1 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:35.098616 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f8196-e910-4ad0-a994-c51ce7c969ab service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:35.111014 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f8196-e910-4ad0-a994-c51ce7c969ab service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:35.195172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f17c3d-1a14-44d3-b622-32d0b896e27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:35.195750 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f17c3d-1a14-44d3-b622-32d0b896e27c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:35.196031 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f17c3d-1a14-44d3-b622-32d0b896e27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:35.196302 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f17c3d-1a14-44d3-b622-32d0b896e27c admin admin] PATH_INFO: `/v3/users/3bfe9f2ffcda43f380d3632ec70d8257` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:35.197622 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f17c3d-1a14-44d3-b622-32d0b896e27c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bfe9f2ffcda43f380d3632ec70d8257)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:35.199811 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f17c3d-1a14-44d3-b622-32d0b896e27c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:35.433231 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-75f17c3d-1a14-44d3-b622-32d0b896e27c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bfe9f2ffcda43f380d3632ec70d8257'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:35.438408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-75f17c3d-1a14-44d3-b622-32d0b896e27c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bfe9f2ffcda43f380d3632ec70d8257'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:35.438408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:35.452396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-75f17c3d-1a14-44d3-b622-32d0b896e27c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bfe9f2ffcda43f380d3632ec70d8257'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:35.460916 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-75f17c3d-1a14-44d3-b622-32d0b896e27c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bfe9f2ffcda43f380d3632ec70d8257'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:35.598141 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-75f17c3d-1a14-44d3-b622-32d0b896e27c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bfe9f2ffcda43f380d3632ec70d8257'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:35.606294 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1309/2666] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:30:35 2022] DELETE /identity/v3/users/3bfe9f2ffcda43f380d3632ec70d8257 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:36.247648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935ff7f-f167-4f37-a0a3-a9a4a05f6958 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:36.249142 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3935ff7f-f167-4f37-a0a3-a9a4a05f6958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:36.262565 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935ff7f-f167-4f37-a0a3-a9a4a05f6958 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:36.324988 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:36.344201 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f0de6-6268-4780-ae39-62e7971bb94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:36.345061 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f0de6-6268-4780-ae39-62e7971bb94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:36.352001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f0de6-6268-4780-ae39-62e7971bb94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:36.352001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f0de6-6268-4780-ae39-62e7971bb94a admin admin] PATH_INFO: `/v3/projects/92ca47de5291443a9d4e692601b325f3` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:36.352001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f0de6-6268-4780-ae39-62e7971bb94a admin admin] RBAC: Authorizing `identity:delete_project(project_id=92ca47de5291443a9d4e692601b325f3)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:36.352001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f0de6-6268-4780-ae39-62e7971bb94a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:36.504988 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c98f0de6-6268-4780-ae39-62e7971bb94a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92ca47de5291443a9d4e692601b325f3', 'request_id': 'req-c98f0de6-6268-4780-ae39-62e7971bb94a'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:36.511625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c98f0de6-6268-4780-ae39-62e7971bb94a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92ca47de5291443a9d4e692601b325f3', 'request_id': 'req-c98f0de6-6268-4780-ae39-62e7971bb94a'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:36.517261 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c98f0de6-6268-4780-ae39-62e7971bb94a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92ca47de5291443a9d4e692601b325f3', 'request_id': 'req-c98f0de6-6268-4780-ae39-62e7971bb94a'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:36.647795 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c98f0de6-6268-4780-ae39-62e7971bb94a admin admin] The token cache is being invalidate because project 92ca47de5291443a9d4e692601b325f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:30:36.651837 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c98f0de6-6268-4780-ae39-62e7971bb94a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:36.651837 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c98f0de6-6268-4780-ae39-62e7971bb94a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:36.651837 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1358/2667] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:30:36 2022] DELETE /identity/v3/projects/92ca47de5291443a9d4e692601b325f3 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:30:36.658031 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f45342-b4db-4a05-8dcf-b720c0fc9239 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:36.658552 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f45342-b4db-4a05-8dcf-b720c0fc9239 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:36.658680 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f45342-b4db-4a05-8dcf-b720c0fc9239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:36.681476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e6f45342-b4db-4a05-8dcf-b720c0fc9239 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:36.682748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e6f45342-b4db-4a05-8dcf-b720c0fc9239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:36.749869 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1310/2668] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:36.758396 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940f309-1902-422e-956f-00b084a40428 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:36.758771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940f309-1902-422e-956f-00b084a40428 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:36.759115 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940f309-1902-422e-956f-00b084a40428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:36.783051 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a940f309-1902-422e-956f-00b084a40428 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:36.784280 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a940f309-1902-422e-956f-00b084a40428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:36.794736 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1359/2669] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:36.799219 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f45342-b4db-4a05-8dcf-b720c0fc9239 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:36.809744 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f45342-b4db-4a05-8dcf-b720c0fc9239 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:36.815042 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f26d6-4a5e-46c9-96dc-898172912e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:36.815707 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f26d6-4a5e-46c9-96dc-898172912e37 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:36.816520 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f26d6-4a5e-46c9-96dc-898172912e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:36.816863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f26d6-4a5e-46c9-96dc-898172912e37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:36.817569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f26d6-4a5e-46c9-96dc-898172912e37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:30:36.832393 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f26d6-4a5e-46c9-96dc-898172912e37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:36.832393 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f26d6-4a5e-46c9-96dc-898172912e37 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:36.833577 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1311/2670] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:30:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:30:36.837478 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940f309-1902-422e-956f-00b084a40428 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:36.847390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940f309-1902-422e-956f-00b084a40428 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:36.852818 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3377cb7-5267-4a2a-9a06-0462c403a0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:36.853584 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3377cb7-5267-4a2a-9a06-0462c403a0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:36.853992 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3377cb7-5267-4a2a-9a06-0462c403a0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:36.854341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3377cb7-5267-4a2a-9a06-0462c403a0e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:36.855256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3377cb7-5267-4a2a-9a06-0462c403a0e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:36.857508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3377cb7-5267-4a2a-9a06-0462c403a0e5 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:36.961293 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1360/2671] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:30:36 2022] POST /identity/v3/projects => generated 392 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:30:36.965392 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f26d6-4a5e-46c9-96dc-898172912e37 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:36.980419 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f26d6-4a5e-46c9-96dc-898172912e37 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:37.045997 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051d1ec-7216-4442-b4e7-e3cdc98ad453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:37.046626 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051d1ec-7216-4442-b4e7-e3cdc98ad453 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:37.046901 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051d1ec-7216-4442-b4e7-e3cdc98ad453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:37.047175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051d1ec-7216-4442-b4e7-e3cdc98ad453 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:37.047847 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051d1ec-7216-4442-b4e7-e3cdc98ad453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:37.049812 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051d1ec-7216-4442-b4e7-e3cdc98ad453 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:37.219353 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1312/2672] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:30:36 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:30:37.224309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3377cb7-5267-4a2a-9a06-0462c403a0e5 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:37.235044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3377cb7-5267-4a2a-9a06-0462c403a0e5 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:37.242007 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b0d6d-c437-4d67-9190-91eb5d87c368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:37.242727 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b0d6d-c437-4d67-9190-91eb5d87c368 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:37.243014 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b0d6d-c437-4d67-9190-91eb5d87c368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:37.243434 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b0d6d-c437-4d67-9190-91eb5d87c368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:37.244150 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b0d6d-c437-4d67-9190-91eb5d87c368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:37.253072 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b0d6d-c437-4d67-9190-91eb5d87c368 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:37.267702 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1361/2673] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:37 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:30:37.272243 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051d1ec-7216-4442-b4e7-e3cdc98ad453 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:37.286982 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051d1ec-7216-4442-b4e7-e3cdc98ad453 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:37.292201 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae96572-ba58-427b-95c2-03137c6f7e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:37.304395 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae96572-ba58-427b-95c2-03137c6f7e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:37.304395 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae96572-ba58-427b-95c2-03137c6f7e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:37.304395 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae96572-ba58-427b-95c2-03137c6f7e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:37.304395 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae96572-ba58-427b-95c2-03137c6f7e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:37.304395 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae96572-ba58-427b-95c2-03137c6f7e54 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:37.308898 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1313/2674] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:37 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:30:37.312469 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b0d6d-c437-4d67-9190-91eb5d87c368 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:37.323073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b0d6d-c437-4d67-9190-91eb5d87c368 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:37.328851 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62175b-ef78-4145-8269-979b2016b5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:37.333162 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62175b-ef78-4145-8269-979b2016b5de admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:37.333162 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62175b-ef78-4145-8269-979b2016b5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:37.333162 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62175b-ef78-4145-8269-979b2016b5de admin admin] PATH_INFO: `/v3/projects/9d44c1ffe04c4e0db96cb3a969505841/users/90adc15d57fb43609846a60d849f6a8c/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:37.346497 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62175b-ef78-4145-8269-979b2016b5de admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d44c1ffe04c4e0db96cb3a969505841, user_id=90adc15d57fb43609846a60d849f6a8c, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:37.349876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62175b-ef78-4145-8269-979b2016b5de admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:37.437331 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1362/2675] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:30:37 2022] PUT /identity/v3/projects/9d44c1ffe04c4e0db96cb3a969505841/users/90adc15d57fb43609846a60d849f6a8c/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:30:37.449464 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070ce67-669a-46ed-8840-f443e7ef4b11 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:37.458037 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070ce67-669a-46ed-8840-f443e7ef4b11 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:37.458037 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070ce67-669a-46ed-8840-f443e7ef4b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:37.484740 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-7070ce67-669a-46ed-8840-f443e7ef4b11 None None] MFA Rules not processed for user `90adc15d57fb43609846a60d849f6a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:37.486400 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7070ce67-669a-46ed-8840-f443e7ef4b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:37.508968 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:37.561999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1314/2676] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:37.567343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62175b-ef78-4145-8269-979b2016b5de admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:37.642957 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62175b-ef78-4145-8269-979b2016b5de admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:37.650489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb502e-bda8-4786-8998-f3e2fd4d15f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:37.651459 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb502e-bda8-4786-8998-f3e2fd4d15f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:37.651743 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb502e-bda8-4786-8998-f3e2fd4d15f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:37.652605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb502e-bda8-4786-8998-f3e2fd4d15f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:37.653574 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb502e-bda8-4786-8998-f3e2fd4d15f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:37.655560 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb502e-bda8-4786-8998-f3e2fd4d15f4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:37.674912 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:37.819589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1363/2677] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:30:37 2022] POST /identity/v3/projects => generated 394 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:30:37.820781 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070ce67-669a-46ed-8840-f443e7ef4b11 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:37.837765 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070ce67-669a-46ed-8840-f443e7ef4b11 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:37.928051 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b50c07-f637-4426-b49d-c931940b743c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:37.928858 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b50c07-f637-4426-b49d-c931940b743c admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:37.929171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b50c07-f637-4426-b49d-c931940b743c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:37.929447 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b50c07-f637-4426-b49d-c931940b743c admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:37.930230 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b50c07-f637-4426-b49d-c931940b743c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:37.932639 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b50c07-f637-4426-b49d-c931940b743c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:38.069076 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1315/2678] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:30:37 2022] POST /identity/v3/users => generated 304 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:30:38.073269 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb502e-bda8-4786-8998-f3e2fd4d15f4 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:38.096118 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb502e-bda8-4786-8998-f3e2fd4d15f4 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:38.102334 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4696e89-4606-4c61-9b05-236f7916bd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:38.103288 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4696e89-4606-4c61-9b05-236f7916bd32 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:38.103781 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4696e89-4606-4c61-9b05-236f7916bd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:38.106827 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4696e89-4606-4c61-9b05-236f7916bd32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:38.107816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4696e89-4606-4c61-9b05-236f7916bd32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:38.109678 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4696e89-4606-4c61-9b05-236f7916bd32 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:38.123699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1364/2679] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:38 2022] GET /identity/v3/roles => generated 1427 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:30:38.127762 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b50c07-f637-4426-b49d-c931940b743c admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:38.142037 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b50c07-f637-4426-b49d-c931940b743c admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:38.148197 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aba1f3-cc98-444e-8ab4-643d791bbd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:38.149438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aba1f3-cc98-444e-8ab4-643d791bbd4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:38.149796 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aba1f3-cc98-444e-8ab4-643d791bbd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:38.154973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aba1f3-cc98-444e-8ab4-643d791bbd4d admin admin] PATH_INFO: `/v3/projects/e9c5a3e8158e447cbb0ddecaa8b2482c/users/0e370ed3832f43a7ba5c94e3705c6976/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:38.189698 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aba1f3-cc98-444e-8ab4-643d791bbd4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c5a3e8158e447cbb0ddecaa8b2482c, user_id=0e370ed3832f43a7ba5c94e3705c6976, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:38.193066 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aba1f3-cc98-444e-8ab4-643d791bbd4d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:38.278151 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1316/2680] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:30:38 2022] PUT /identity/v3/projects/e9c5a3e8158e447cbb0ddecaa8b2482c/users/0e370ed3832f43a7ba5c94e3705c6976/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:38.282222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4696e89-4606-4c61-9b05-236f7916bd32 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:38.295362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4696e89-4606-4c61-9b05-236f7916bd32 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:38.378040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08993de6-33c5-41c6-bf91-77f85ce446aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:38.379442 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08993de6-33c5-41c6-bf91-77f85ce446aa admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:38.379729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08993de6-33c5-41c6-bf91-77f85ce446aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:38.380008 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08993de6-33c5-41c6-bf91-77f85ce446aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:38.380786 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08993de6-33c5-41c6-bf91-77f85ce446aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:38.382588 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08993de6-33c5-41c6-bf91-77f85ce446aa admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:38.396767 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1365/2681] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:38 2022] GET /identity/v3/roles => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:30:38.398320 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aba1f3-cc98-444e-8ab4-643d791bbd4d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:38.411261 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aba1f3-cc98-444e-8ab4-643d791bbd4d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:38.416211 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef7963-fea2-4ef0-99ce-0e5b8138ef03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:38.419824 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef7963-fea2-4ef0-99ce-0e5b8138ef03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:38.419824 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef7963-fea2-4ef0-99ce-0e5b8138ef03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:38.419824 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef7963-fea2-4ef0-99ce-0e5b8138ef03 admin admin] PATH_INFO: `/v3/projects/e9c5a3e8158e447cbb0ddecaa8b2482c/users/0e370ed3832f43a7ba5c94e3705c6976/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:38.423319 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef7963-fea2-4ef0-99ce-0e5b8138ef03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c5a3e8158e447cbb0ddecaa8b2482c, user_id=0e370ed3832f43a7ba5c94e3705c6976, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:38.436706 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef7963-fea2-4ef0-99ce-0e5b8138ef03 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:38.466846 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1317/2682] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:30:38 2022] PUT /identity/v3/projects/e9c5a3e8158e447cbb0ddecaa8b2482c/users/0e370ed3832f43a7ba5c94e3705c6976/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:30:38.472729 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e8ac8-86c3-4b98-a492-b5280c2d5b12 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:38.472960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e8ac8-86c3-4b98-a492-b5280c2d5b12 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:38.473520 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e8ac8-86c3-4b98-a492-b5280c2d5b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:38.538535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-679e8ac8-86c3-4b98-a492-b5280c2d5b12 None None] MFA Rules not processed for user `0e370ed3832f43a7ba5c94e3705c6976`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:38.541151 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-679e8ac8-86c3-4b98-a492-b5280c2d5b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:38.760098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1366/2683] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:38 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:38.768247 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef7963-fea2-4ef0-99ce-0e5b8138ef03 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:38.771060 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-64ef7963-fea2-4ef0-99ce-0e5b8138ef03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:38.866711 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef7963-fea2-4ef0-99ce-0e5b8138ef03 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:38.870484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5d37a-eabb-4089-a6b6-3cd29d2f3779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:38.871138 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5d37a-eabb-4089-a6b6-3cd29d2f3779 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:38.871409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5d37a-eabb-4089-a6b6-3cd29d2f3779 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:38.871700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5d37a-eabb-4089-a6b6-3cd29d2f3779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:38.886324 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5d37a-eabb-4089-a6b6-3cd29d2f3779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:38.888031 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5d37a-eabb-4089-a6b6-3cd29d2f3779 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:38.899276 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1318/2684] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:30:38 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:30:38.969125 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e8ac8-86c3-4b98-a492-b5280c2d5b12 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:38.980373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e8ac8-86c3-4b98-a492-b5280c2d5b12 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:38.984088 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c20c61-cef3-414f-b1e4-36a210a7b89e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:38.984848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c20c61-cef3-414f-b1e4-36a210a7b89e service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:38.985132 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c20c61-cef3-414f-b1e4-36a210a7b89e service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:38.985408 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c20c61-cef3-414f-b1e4-36a210a7b89e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:39.072297 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c20c61-cef3-414f-b1e4-36a210a7b89e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:39.073880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c20c61-cef3-414f-b1e4-36a210a7b89e service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:39.085109 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1367/2685] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:30:38 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:30:39.372463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5d37a-eabb-4089-a6b6-3cd29d2f3779 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:39.374067 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-85e5d37a-eabb-4089-a6b6-3cd29d2f3779 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:39.400053 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:39.449454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5d37a-eabb-4089-a6b6-3cd29d2f3779 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:39.455448 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ab70e-8ccc-4802-a004-c02df36fda1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:39.456111 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ab70e-8ccc-4802-a004-c02df36fda1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:39.456397 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ab70e-8ccc-4802-a004-c02df36fda1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:39.457252 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ab70e-8ccc-4802-a004-c02df36fda1e admin admin] PATH_INFO: `/v3/users/85f5879659684984a688f0c4bb75ba08` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:39.458697 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ab70e-8ccc-4802-a004-c02df36fda1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=85f5879659684984a688f0c4bb75ba08)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:39.460732 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ab70e-8ccc-4802-a004-c02df36fda1e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:39.718545 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f38ab70e-8ccc-4802-a004-c02df36fda1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85f5879659684984a688f0c4bb75ba08'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:39.719502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f38ab70e-8ccc-4802-a004-c02df36fda1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85f5879659684984a688f0c4bb75ba08'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:39.736227 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f38ab70e-8ccc-4802-a004-c02df36fda1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85f5879659684984a688f0c4bb75ba08'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:39.745164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f38ab70e-8ccc-4802-a004-c02df36fda1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85f5879659684984a688f0c4bb75ba08'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:39.869854 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f38ab70e-8ccc-4802-a004-c02df36fda1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85f5879659684984a688f0c4bb75ba08'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:39.879432 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1319/2686] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:30:39 2022] DELETE /identity/v3/users/85f5879659684984a688f0c4bb75ba08 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:39.883776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac767572-2572-444a-b576-2a717ffcfd36 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:39.884238 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac767572-2572-444a-b576-2a717ffcfd36 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:39.884337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac767572-2572-444a-b576-2a717ffcfd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:39.898398 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:39.921700 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-ac767572-2572-444a-b576-2a717ffcfd36 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:39.923017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ac767572-2572-444a-b576-2a717ffcfd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:40.000700 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1368/2687] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:40.024257 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ab70e-8ccc-4802-a004-c02df36fda1e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:40.024257 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f38ab70e-8ccc-4802-a004-c02df36fda1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:40.076868 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ab70e-8ccc-4802-a004-c02df36fda1e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:40.080930 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac3e78-7152-4524-9588-cb1e4a354e96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:40.081599 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac3e78-7152-4524-9588-cb1e4a354e96 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:40.081882 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac3e78-7152-4524-9588-cb1e4a354e96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:40.082153 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac3e78-7152-4524-9588-cb1e4a354e96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:40.091774 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac3e78-7152-4524-9588-cb1e4a354e96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:40.093344 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac3e78-7152-4524-9588-cb1e4a354e96 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:40.105233 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1320/2688] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:30:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:30:40.670431 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac767572-2572-444a-b576-2a717ffcfd36 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:40.678586 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ac767572-2572-444a-b576-2a717ffcfd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:40.689660 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac767572-2572-444a-b576-2a717ffcfd36 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:40.697587 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f961a-3add-4217-b6d0-36ea6c9de781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:40.698355 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f961a-3add-4217-b6d0-36ea6c9de781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:40.698527 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f961a-3add-4217-b6d0-36ea6c9de781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:40.698807 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f961a-3add-4217-b6d0-36ea6c9de781 admin admin] PATH_INFO: `/v3/projects/bb6647573d4247c9ad327b6647f668e8` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:40.699984 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f961a-3add-4217-b6d0-36ea6c9de781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb6647573d4247c9ad327b6647f668e8)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:40.702027 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f961a-3add-4217-b6d0-36ea6c9de781 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:40.842967 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-509f961a-3add-4217-b6d0-36ea6c9de781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb6647573d4247c9ad327b6647f668e8', 'request_id': 'req-509f961a-3add-4217-b6d0-36ea6c9de781'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:40.850099 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-509f961a-3add-4217-b6d0-36ea6c9de781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb6647573d4247c9ad327b6647f668e8', 'request_id': 'req-509f961a-3add-4217-b6d0-36ea6c9de781'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:40.864960 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-509f961a-3add-4217-b6d0-36ea6c9de781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb6647573d4247c9ad327b6647f668e8', 'request_id': 'req-509f961a-3add-4217-b6d0-36ea6c9de781'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:40.992975 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-509f961a-3add-4217-b6d0-36ea6c9de781 admin admin] The token cache is being invalidate because project bb6647573d4247c9ad327b6647f668e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:30:40.992975 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-509f961a-3add-4217-b6d0-36ea6c9de781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:40.992975 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-509f961a-3add-4217-b6d0-36ea6c9de781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:40.995351 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1369/2689] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:30:40 2022] DELETE /identity/v3/projects/bb6647573d4247c9ad327b6647f668e8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:41.000202 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac3e78-7152-4524-9588-cb1e4a354e96 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:41.011525 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac3e78-7152-4524-9588-cb1e4a354e96 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:41.068540 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:41.088408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605f45b-cde8-4715-ab9f-388516f2f6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:41.089199 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605f45b-cde8-4715-ab9f-388516f2f6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:41.089481 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605f45b-cde8-4715-ab9f-388516f2f6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:41.089835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605f45b-cde8-4715-ab9f-388516f2f6aa admin admin] PATH_INFO: `/v3/users/4cfbd834340149afadad4b32830420ac` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:41.091375 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605f45b-cde8-4715-ab9f-388516f2f6aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cfbd834340149afadad4b32830420ac)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:41.093415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605f45b-cde8-4715-ab9f-388516f2f6aa admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:41.341823 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6605f45b-cde8-4715-ab9f-388516f2f6aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cfbd834340149afadad4b32830420ac'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:41.343138 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6605f45b-cde8-4715-ab9f-388516f2f6aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cfbd834340149afadad4b32830420ac'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:41.365409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6605f45b-cde8-4715-ab9f-388516f2f6aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cfbd834340149afadad4b32830420ac'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:41.371004 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6605f45b-cde8-4715-ab9f-388516f2f6aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cfbd834340149afadad4b32830420ac'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:41.467960 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6605f45b-cde8-4715-ab9f-388516f2f6aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cfbd834340149afadad4b32830420ac'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:41.477480 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1321/2690] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:30:40 2022] DELETE /identity/v3/users/4cfbd834340149afadad4b32830420ac => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:41.958571 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f961a-3add-4217-b6d0-36ea6c9de781 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:41.961521 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-509f961a-3add-4217-b6d0-36ea6c9de781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:41.990096 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f961a-3add-4217-b6d0-36ea6c9de781 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:42.067142 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2b143-6ab6-4f57-9e24-bb311b10da35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:42.068738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2b143-6ab6-4f57-9e24-bb311b10da35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:42.069021 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2b143-6ab6-4f57-9e24-bb311b10da35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:42.075498 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2b143-6ab6-4f57-9e24-bb311b10da35 admin admin] PATH_INFO: `/v3/projects/4a52e71f9a3f4eca86b27530188add44` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:42.075498 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2b143-6ab6-4f57-9e24-bb311b10da35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a52e71f9a3f4eca86b27530188add44)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:42.075498 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2b143-6ab6-4f57-9e24-bb311b10da35 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:42.225844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:42.241986 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8fe2b143-6ab6-4f57-9e24-bb311b10da35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a52e71f9a3f4eca86b27530188add44', 'request_id': 'req-8fe2b143-6ab6-4f57-9e24-bb311b10da35'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:42.256462 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8fe2b143-6ab6-4f57-9e24-bb311b10da35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a52e71f9a3f4eca86b27530188add44', 'request_id': 'req-8fe2b143-6ab6-4f57-9e24-bb311b10da35'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:42.262551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8fe2b143-6ab6-4f57-9e24-bb311b10da35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a52e71f9a3f4eca86b27530188add44', 'request_id': 'req-8fe2b143-6ab6-4f57-9e24-bb311b10da35'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:42.415995 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8fe2b143-6ab6-4f57-9e24-bb311b10da35 admin admin] The token cache is being invalidate because project 4a52e71f9a3f4eca86b27530188add44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:30:42.416384 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8fe2b143-6ab6-4f57-9e24-bb311b10da35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:42.417049 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8fe2b143-6ab6-4f57-9e24-bb311b10da35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:42.418574 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1370/2691] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:30:41 2022] DELETE /identity/v3/projects/4a52e71f9a3f4eca86b27530188add44 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:42.424227 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040dbbe-f5be-4947-8a0d-18dc7f5f4aae None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:42.424976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040dbbe-f5be-4947-8a0d-18dc7f5f4aae None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:42.424976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040dbbe-f5be-4947-8a0d-18dc7f5f4aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:42.447229 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c040dbbe-f5be-4947-8a0d-18dc7f5f4aae None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:42.448515 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c040dbbe-f5be-4947-8a0d-18dc7f5f4aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:42.526637 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1322/2692] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:42.536029 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374d21a-8dbd-436b-80bc-f33b9745ad69 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:42.536813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374d21a-8dbd-436b-80bc-f33b9745ad69 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:42.537283 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374d21a-8dbd-436b-80bc-f33b9745ad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:42.566916 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a374d21a-8dbd-436b-80bc-f33b9745ad69 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:42.568920 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a374d21a-8dbd-436b-80bc-f33b9745ad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:42.586564 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1371/2693] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:42.590901 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040dbbe-f5be-4947-8a0d-18dc7f5f4aae None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:42.605253 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040dbbe-f5be-4947-8a0d-18dc7f5f4aae None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:42.611931 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f3e1b-fad4-43dc-825e-511707b6c042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:42.613173 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f3e1b-fad4-43dc-825e-511707b6c042 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:42.613541 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f3e1b-fad4-43dc-825e-511707b6c042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:42.613811 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f3e1b-fad4-43dc-825e-511707b6c042 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:42.614531 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f3e1b-fad4-43dc-825e-511707b6c042 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:30:42.618255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f3e1b-fad4-43dc-825e-511707b6c042 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:42.618255 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f3e1b-fad4-43dc-825e-511707b6c042 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:42.635451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1323/2694] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:30:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:30:42.640230 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374d21a-8dbd-436b-80bc-f33b9745ad69 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:42.650693 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374d21a-8dbd-436b-80bc-f33b9745ad69 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:42.656260 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338dd03-e45c-4528-b111-e01152f9a06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:42.657056 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338dd03-e45c-4528-b111-e01152f9a06f admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:42.657448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338dd03-e45c-4528-b111-e01152f9a06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:42.657816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338dd03-e45c-4528-b111-e01152f9a06f admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:42.658649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338dd03-e45c-4528-b111-e01152f9a06f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:42.660732 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338dd03-e45c-4528-b111-e01152f9a06f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:42.809459 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1372/2695] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:30:42 2022] POST /identity/v3/projects => generated 384 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:30:42.815726 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f3e1b-fad4-43dc-825e-511707b6c042 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:42.826648 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f3e1b-fad4-43dc-825e-511707b6c042 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:42.877437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:42.890642 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ee5f4-491a-4858-9ddb-a605ff70044b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:42.891174 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ee5f4-491a-4858-9ddb-a605ff70044b admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:42.891457 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ee5f4-491a-4858-9ddb-a605ff70044b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:42.891724 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ee5f4-491a-4858-9ddb-a605ff70044b admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:42.892383 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ee5f4-491a-4858-9ddb-a605ff70044b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:42.894376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ee5f4-491a-4858-9ddb-a605ff70044b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:42.995623 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1324/2696] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:30:42 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:30:42.996488 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338dd03-e45c-4528-b111-e01152f9a06f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:43.010415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338dd03-e45c-4528-b111-e01152f9a06f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:43.015418 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592b6e7-d4dc-4cec-98ae-8fa6252ccd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:43.016158 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592b6e7-d4dc-4cec-98ae-8fa6252ccd8f admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:43.016322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592b6e7-d4dc-4cec-98ae-8fa6252ccd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:43.016569 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592b6e7-d4dc-4cec-98ae-8fa6252ccd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:43.017352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592b6e7-d4dc-4cec-98ae-8fa6252ccd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:43.018977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592b6e7-d4dc-4cec-98ae-8fa6252ccd8f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:43.029880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1373/2697] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:42 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:30:43.037616 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ee5f4-491a-4858-9ddb-a605ff70044b admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:43.051454 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ee5f4-491a-4858-9ddb-a605ff70044b admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:43.057852 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7f335-ba8d-4b81-aeec-07bb0ef518ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:43.058567 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7f335-ba8d-4b81-aeec-07bb0ef518ce admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:43.059107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7f335-ba8d-4b81-aeec-07bb0ef518ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:43.059107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7f335-ba8d-4b81-aeec-07bb0ef518ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:43.059804 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7f335-ba8d-4b81-aeec-07bb0ef518ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:43.061685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7f335-ba8d-4b81-aeec-07bb0ef518ce admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:43.076543 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1325/2698] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:43 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:30:43.083035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592b6e7-d4dc-4cec-98ae-8fa6252ccd8f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:43.094858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592b6e7-d4dc-4cec-98ae-8fa6252ccd8f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:43.100267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d613b-00e8-4388-ab3c-1aabb2408613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:43.101090 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d613b-00e8-4388-ab3c-1aabb2408613 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:43.101350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d613b-00e8-4388-ab3c-1aabb2408613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:43.106237 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d613b-00e8-4388-ab3c-1aabb2408613 admin admin] PATH_INFO: `/v3/projects/9c6dc8a87d8c452f9e7c414b47d8b14c/users/a9976e8a500a44729b9645a8884062de/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:43.121337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d613b-00e8-4388-ab3c-1aabb2408613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6dc8a87d8c452f9e7c414b47d8b14c, user_id=a9976e8a500a44729b9645a8884062de, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:43.124018 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d613b-00e8-4388-ab3c-1aabb2408613 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:43.212594 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1374/2699] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:30:43 2022] PUT /identity/v3/projects/9c6dc8a87d8c452f9e7c414b47d8b14c/users/a9976e8a500a44729b9645a8884062de/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:43.286213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ef5e8-47ae-4891-be67-53266c02e7fa None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:43.286506 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ef5e8-47ae-4891-be67-53266c02e7fa None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:43.286784 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ef5e8-47ae-4891-be67-53266c02e7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:43.316895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-535ef5e8-47ae-4891-be67-53266c02e7fa None None] MFA Rules not processed for user `a9976e8a500a44729b9645a8884062de`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:43.318181 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-535ef5e8-47ae-4891-be67-53266c02e7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:43.402424 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1326/2700] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:30:43.408123 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d613b-00e8-4388-ab3c-1aabb2408613 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:43.489243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d613b-00e8-4388-ab3c-1aabb2408613 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:43.494141 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b4f1c-c549-4c37-a36f-4ed3e19ec5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:43.494911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b4f1c-c549-4c37-a36f-4ed3e19ec5f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:43.495208 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b4f1c-c549-4c37-a36f-4ed3e19ec5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:43.503769 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b4f1c-c549-4c37-a36f-4ed3e19ec5f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:43.503769 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b4f1c-c549-4c37-a36f-4ed3e19ec5f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:43.503769 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b4f1c-c549-4c37-a36f-4ed3e19ec5f6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:43.615681 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1375/2701] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:30:43 2022] POST /identity/v3/projects => generated 386 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:30:43.621638 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ef5e8-47ae-4891-be67-53266c02e7fa None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:43.633749 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ef5e8-47ae-4891-be67-53266c02e7fa None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:43.701267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7435deb-0da7-440b-9d7e-03e474593872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:43.701891 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7435deb-0da7-440b-9d7e-03e474593872 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:43.702168 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7435deb-0da7-440b-9d7e-03e474593872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:43.702438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7435deb-0da7-440b-9d7e-03e474593872 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:43.703160 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7435deb-0da7-440b-9d7e-03e474593872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:43.706334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7435deb-0da7-440b-9d7e-03e474593872 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:43.807493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1327/2702] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:30:43 2022] POST /identity/v3/users => generated 300 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:30:43.812337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b4f1c-c549-4c37-a36f-4ed3e19ec5f6 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:43.824648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b4f1c-c549-4c37-a36f-4ed3e19ec5f6 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:43.829489 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2553a2-1724-4cba-bc43-e3c17ccc0e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:43.830125 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2553a2-1724-4cba-bc43-e3c17ccc0e15 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:43.830437 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2553a2-1724-4cba-bc43-e3c17ccc0e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:43.830711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2553a2-1724-4cba-bc43-e3c17ccc0e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:43.832133 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2553a2-1724-4cba-bc43-e3c17ccc0e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:43.833982 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2553a2-1724-4cba-bc43-e3c17ccc0e15 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:43.848467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1376/2703] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:43 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:30:43.852746 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7435deb-0da7-440b-9d7e-03e474593872 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:43.871116 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7435deb-0da7-440b-9d7e-03e474593872 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:43.879537 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c9943-817e-4e3f-bf72-3343fd81c798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:43.880741 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c9943-817e-4e3f-bf72-3343fd81c798 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:43.881254 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c9943-817e-4e3f-bf72-3343fd81c798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:43.881809 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c9943-817e-4e3f-bf72-3343fd81c798 admin admin] PATH_INFO: `/v3/projects/008810dd4405472b9ceaaf437a178e6e/users/6efb4d6d14db45008636297cf1a486bb/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:43.904395 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c9943-817e-4e3f-bf72-3343fd81c798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=008810dd4405472b9ceaaf437a178e6e, user_id=6efb4d6d14db45008636297cf1a486bb, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:43.907182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c9943-817e-4e3f-bf72-3343fd81c798 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:44.032500 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1328/2704] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:30:43 2022] PUT /identity/v3/projects/008810dd4405472b9ceaaf437a178e6e/users/6efb4d6d14db45008636297cf1a486bb/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:44.038837 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2553a2-1724-4cba-bc43-e3c17ccc0e15 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:44.060696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2553a2-1724-4cba-bc43-e3c17ccc0e15 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:44.105560 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:44.145955 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce2852-c075-41e6-821f-214a83d3c790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:44.146632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce2852-c075-41e6-821f-214a83d3c790 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:44.147121 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce2852-c075-41e6-821f-214a83d3c790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:44.147434 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce2852-c075-41e6-821f-214a83d3c790 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:44.148874 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce2852-c075-41e6-821f-214a83d3c790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:44.150933 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce2852-c075-41e6-821f-214a83d3c790 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:44.162999 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1377/2705] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:44 2022] GET /identity/v3/roles => generated 1427 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:30:44.169097 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c9943-817e-4e3f-bf72-3343fd81c798 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:44.182210 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c9943-817e-4e3f-bf72-3343fd81c798 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:44.187257 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58360de7-1e07-4a04-9256-35d69ed3ff3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:44.187993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58360de7-1e07-4a04-9256-35d69ed3ff3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:44.188222 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58360de7-1e07-4a04-9256-35d69ed3ff3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:44.188542 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58360de7-1e07-4a04-9256-35d69ed3ff3d admin admin] PATH_INFO: `/v3/projects/008810dd4405472b9ceaaf437a178e6e/users/6efb4d6d14db45008636297cf1a486bb/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:44.191504 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58360de7-1e07-4a04-9256-35d69ed3ff3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=008810dd4405472b9ceaaf437a178e6e, user_id=6efb4d6d14db45008636297cf1a486bb, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:44.197040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58360de7-1e07-4a04-9256-35d69ed3ff3d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:44.205568 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1329/2706] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:30:44 2022] PUT /identity/v3/projects/008810dd4405472b9ceaaf437a178e6e/users/6efb4d6d14db45008636297cf1a486bb/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:30:44.216288 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba61556-89b2-479c-9710-c86296cb3054 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:44.216599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba61556-89b2-479c-9710-c86296cb3054 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:44.216915 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba61556-89b2-479c-9710-c86296cb3054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:44.249329 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-aba61556-89b2-479c-9710-c86296cb3054 None None] MFA Rules not processed for user `6efb4d6d14db45008636297cf1a486bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:44.250589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-aba61556-89b2-479c-9710-c86296cb3054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:44.323923 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1378/2707] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:44.334608 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58360de7-1e07-4a04-9256-35d69ed3ff3d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:44.336385 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-58360de7-1e07-4a04-9256-35d69ed3ff3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:44.346337 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:44.398793 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58360de7-1e07-4a04-9256-35d69ed3ff3d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:44.406722 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f2273-c4e7-413a-a8f7-104cac97b616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:44.406722 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f2273-c4e7-413a-a8f7-104cac97b616 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:44.406722 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f2273-c4e7-413a-a8f7-104cac97b616 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:44.407141 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f2273-c4e7-413a-a8f7-104cac97b616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:44.473582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f2273-c4e7-413a-a8f7-104cac97b616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:44.475093 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f2273-c4e7-413a-a8f7-104cac97b616 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:44.485056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1330/2708] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:30:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:30:44.546224 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba61556-89b2-479c-9710-c86296cb3054 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:44.547771 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-aba61556-89b2-479c-9710-c86296cb3054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:44.630815 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba61556-89b2-479c-9710-c86296cb3054 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:44.637448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3271c2-6f0e-497b-bd55-e1d7d89c6d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:44.638563 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3271c2-6f0e-497b-bd55-e1d7d89c6d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:44.639055 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3271c2-6f0e-497b-bd55-e1d7d89c6d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:44.639531 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3271c2-6f0e-497b-bd55-e1d7d89c6d75 admin admin] PATH_INFO: `/v3/users/90adc15d57fb43609846a60d849f6a8c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:44.641589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3271c2-6f0e-497b-bd55-e1d7d89c6d75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90adc15d57fb43609846a60d849f6a8c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:44.644098 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3271c2-6f0e-497b-bd55-e1d7d89c6d75 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:44.881700 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ec3271c2-6f0e-497b-bd55-e1d7d89c6d75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90adc15d57fb43609846a60d849f6a8c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:44.882435 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ec3271c2-6f0e-497b-bd55-e1d7d89c6d75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90adc15d57fb43609846a60d849f6a8c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:44.885277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:44.961947 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ec3271c2-6f0e-497b-bd55-e1d7d89c6d75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90adc15d57fb43609846a60d849f6a8c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:44.977244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ec3271c2-6f0e-497b-bd55-e1d7d89c6d75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90adc15d57fb43609846a60d849f6a8c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:44.977995 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ec3271c2-6f0e-497b-bd55-e1d7d89c6d75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90adc15d57fb43609846a60d849f6a8c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:44.991337 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1379/2709] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:30:44 2022] DELETE /identity/v3/users/90adc15d57fb43609846a60d849f6a8c => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:44.995947 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670ab0d-df40-4ca0-945b-1d1d5455eb34 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:44.996476 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670ab0d-df40-4ca0-945b-1d1d5455eb34 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:44.996592 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670ab0d-df40-4ca0-945b-1d1d5455eb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:45.019063 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-3670ab0d-df40-4ca0-945b-1d1d5455eb34 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:45.020289 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3670ab0d-df40-4ca0-945b-1d1d5455eb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:45.086834 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1331/2710] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:30:45.101333 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3271c2-6f0e-497b-bd55-e1d7d89c6d75 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:45.102832 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ec3271c2-6f0e-497b-bd55-e1d7d89c6d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:45.164096 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3271c2-6f0e-497b-bd55-e1d7d89c6d75 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:45.167899 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c468b9a-8c60-4709-9b65-f73db12b482d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:45.168519 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c468b9a-8c60-4709-9b65-f73db12b482d service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:45.168852 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c468b9a-8c60-4709-9b65-f73db12b482d service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:45.169151 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c468b9a-8c60-4709-9b65-f73db12b482d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:45.180735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c468b9a-8c60-4709-9b65-f73db12b482d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:45.187119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c468b9a-8c60-4709-9b65-f73db12b482d service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:45.192396 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1380/2711] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:30:45.850023 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670ab0d-df40-4ca0-945b-1d1d5455eb34 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:45.854745 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3670ab0d-df40-4ca0-945b-1d1d5455eb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:45.868220 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670ab0d-df40-4ca0-945b-1d1d5455eb34 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:45.873514 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ebb2a-ffef-48ec-bc79-b9738c625799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:45.874265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ebb2a-ffef-48ec-bc79-b9738c625799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:45.874654 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ebb2a-ffef-48ec-bc79-b9738c625799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:45.874999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ebb2a-ffef-48ec-bc79-b9738c625799 admin admin] PATH_INFO: `/v3/projects/9d44c1ffe04c4e0db96cb3a969505841` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:45.876390 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ebb2a-ffef-48ec-bc79-b9738c625799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d44c1ffe04c4e0db96cb3a969505841)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:45.879068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ebb2a-ffef-48ec-bc79-b9738c625799 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:46.031169 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-755ebb2a-ffef-48ec-bc79-b9738c625799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d44c1ffe04c4e0db96cb3a969505841', 'request_id': 'req-755ebb2a-ffef-48ec-bc79-b9738c625799'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:46.038018 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-755ebb2a-ffef-48ec-bc79-b9738c625799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d44c1ffe04c4e0db96cb3a969505841', 'request_id': 'req-755ebb2a-ffef-48ec-bc79-b9738c625799'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:46.040085 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:46.043851 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-755ebb2a-ffef-48ec-bc79-b9738c625799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d44c1ffe04c4e0db96cb3a969505841', 'request_id': 'req-755ebb2a-ffef-48ec-bc79-b9738c625799'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:46.116395 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-755ebb2a-ffef-48ec-bc79-b9738c625799 admin admin] The token cache is being invalidate because project 9d44c1ffe04c4e0db96cb3a969505841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:30:46.116683 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-755ebb2a-ffef-48ec-bc79-b9738c625799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:46.120843 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-755ebb2a-ffef-48ec-bc79-b9738c625799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:46.120843 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1332/2712] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:30:45 2022] DELETE /identity/v3/projects/9d44c1ffe04c4e0db96cb3a969505841 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:46.123055 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c468b9a-8c60-4709-9b65-f73db12b482d service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:46.133802 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c468b9a-8c60-4709-9b65-f73db12b482d service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:46.208448 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76673b5f-65e8-424b-b186-24692fa02382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:46.209206 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76673b5f-65e8-424b-b186-24692fa02382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:46.209447 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76673b5f-65e8-424b-b186-24692fa02382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:46.209986 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76673b5f-65e8-424b-b186-24692fa02382 admin admin] PATH_INFO: `/v3/users/0e370ed3832f43a7ba5c94e3705c6976` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:46.211310 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76673b5f-65e8-424b-b186-24692fa02382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e370ed3832f43a7ba5c94e3705c6976)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:46.213396 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76673b5f-65e8-424b-b186-24692fa02382 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:46.505724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-76673b5f-65e8-424b-b186-24692fa02382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e370ed3832f43a7ba5c94e3705c6976'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:46.506648 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-76673b5f-65e8-424b-b186-24692fa02382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e370ed3832f43a7ba5c94e3705c6976'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:46.676011 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-76673b5f-65e8-424b-b186-24692fa02382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e370ed3832f43a7ba5c94e3705c6976'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:46.699005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-76673b5f-65e8-424b-b186-24692fa02382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e370ed3832f43a7ba5c94e3705c6976'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:46.700396 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-76673b5f-65e8-424b-b186-24692fa02382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e370ed3832f43a7ba5c94e3705c6976'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:46.702148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:46.716975 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1381/2713] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:30:46 2022] DELETE /identity/v3/users/0e370ed3832f43a7ba5c94e3705c6976 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:30:47.263579 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ebb2a-ffef-48ec-bc79-b9738c625799 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:47.265154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-755ebb2a-ffef-48ec-bc79-b9738c625799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:47.280517 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ebb2a-ffef-48ec-bc79-b9738c625799 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:47.357575 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ca6a6-b917-459b-bd7b-be177f1f9dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:47.358307 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ca6a6-b917-459b-bd7b-be177f1f9dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:47.358589 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ca6a6-b917-459b-bd7b-be177f1f9dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:47.358861 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ca6a6-b917-459b-bd7b-be177f1f9dcd admin admin] PATH_INFO: `/v3/projects/e9c5a3e8158e447cbb0ddecaa8b2482c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:47.360242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ca6a6-b917-459b-bd7b-be177f1f9dcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9c5a3e8158e447cbb0ddecaa8b2482c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:47.362135 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ca6a6-b917-459b-bd7b-be177f1f9dcd admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:47.490008 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b22ca6a6-b917-459b-bd7b-be177f1f9dcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9c5a3e8158e447cbb0ddecaa8b2482c', 'request_id': 'req-b22ca6a6-b917-459b-bd7b-be177f1f9dcd'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:47.496549 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b22ca6a6-b917-459b-bd7b-be177f1f9dcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9c5a3e8158e447cbb0ddecaa8b2482c', 'request_id': 'req-b22ca6a6-b917-459b-bd7b-be177f1f9dcd'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:47.504632 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b22ca6a6-b917-459b-bd7b-be177f1f9dcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9c5a3e8158e447cbb0ddecaa8b2482c', 'request_id': 'req-b22ca6a6-b917-459b-bd7b-be177f1f9dcd'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:47.610774 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b22ca6a6-b917-459b-bd7b-be177f1f9dcd admin admin] The token cache is being invalidate because project e9c5a3e8158e447cbb0ddecaa8b2482c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:30:47.611034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b22ca6a6-b917-459b-bd7b-be177f1f9dcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:47.611686 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b22ca6a6-b917-459b-bd7b-be177f1f9dcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:47.613463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1333/2714] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:30:47 2022] DELETE /identity/v3/projects/e9c5a3e8158e447cbb0ddecaa8b2482c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:47.618566 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accea5ea-f821-4336-bb6b-657a540fd8e5 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:47.619096 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accea5ea-f821-4336-bb6b-657a540fd8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:47.619279 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accea5ea-f821-4336-bb6b-657a540fd8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:47.641541 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-accea5ea-f821-4336-bb6b-657a540fd8e5 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:47.642769 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-accea5ea-f821-4336-bb6b-657a540fd8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:47.711860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1382/2715] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:47.720054 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657ac15-cd7a-439a-8774-e283a06d7f6f None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:47.720343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657ac15-cd7a-439a-8774-e283a06d7f6f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:47.720623 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657ac15-cd7a-439a-8774-e283a06d7f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:47.743957 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e657ac15-cd7a-439a-8774-e283a06d7f6f None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:47.746360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e657ac15-cd7a-439a-8774-e283a06d7f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:47.758204 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1334/2716] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:47.771034 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accea5ea-f821-4336-bb6b-657a540fd8e5 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:47.781728 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accea5ea-f821-4336-bb6b-657a540fd8e5 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:47.787742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3755e-39d7-4b40-ab4f-5ebab50ea53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:47.788625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3755e-39d7-4b40-ab4f-5ebab50ea53f admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:47.789035 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3755e-39d7-4b40-ab4f-5ebab50ea53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:47.789436 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3755e-39d7-4b40-ab4f-5ebab50ea53f admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:47.790291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3755e-39d7-4b40-ab4f-5ebab50ea53f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:30:47.790750 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3755e-39d7-4b40-ab4f-5ebab50ea53f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:47.792695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3755e-39d7-4b40-ab4f-5ebab50ea53f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:47.809546 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1383/2717] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:30:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:30:47.815204 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657ac15-cd7a-439a-8774-e283a06d7f6f None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:47.825850 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657ac15-cd7a-439a-8774-e283a06d7f6f None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:47.834408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72251c27-8e6f-414a-afe9-75411b532915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:47.834883 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72251c27-8e6f-414a-afe9-75411b532915 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:47.835166 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72251c27-8e6f-414a-afe9-75411b532915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:47.835446 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72251c27-8e6f-414a-afe9-75411b532915 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:47.836161 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72251c27-8e6f-414a-afe9-75411b532915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:47.838321 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72251c27-8e6f-414a-afe9-75411b532915 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:47.996216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1335/2718] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:30:47 2022] POST /identity/v3/projects => generated 378 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:30:48.000086 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3755e-39d7-4b40-ab4f-5ebab50ea53f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:48.011178 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3755e-39d7-4b40-ab4f-5ebab50ea53f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:48.072623 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2d825-8251-41d4-a4f2-c604bdff408e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:48.073266 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2d825-8251-41d4-a4f2-c604bdff408e admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:48.073543 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2d825-8251-41d4-a4f2-c604bdff408e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:48.073812 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2d825-8251-41d4-a4f2-c604bdff408e admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:48.074478 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2d825-8251-41d4-a4f2-c604bdff408e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:48.076573 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2d825-8251-41d4-a4f2-c604bdff408e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:48.155817 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1384/2719] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:30:47 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:30:48.162199 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72251c27-8e6f-414a-afe9-75411b532915 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:48.176052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72251c27-8e6f-414a-afe9-75411b532915 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:48.182749 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef6987-3c9d-4e13-a692-8cd01d5ac048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:48.183743 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef6987-3c9d-4e13-a692-8cd01d5ac048 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:48.184271 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef6987-3c9d-4e13-a692-8cd01d5ac048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:48.184646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef6987-3c9d-4e13-a692-8cd01d5ac048 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:48.185879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef6987-3c9d-4e13-a692-8cd01d5ac048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:48.189019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef6987-3c9d-4e13-a692-8cd01d5ac048 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:48.220015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1336/2720] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:48 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:30:48.224037 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2d825-8251-41d4-a4f2-c604bdff408e admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:48.234531 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2d825-8251-41d4-a4f2-c604bdff408e admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:48.241380 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba782204-b549-45db-b25c-040a29b557cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:48.242017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba782204-b549-45db-b25c-040a29b557cb admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:48.242350 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba782204-b549-45db-b25c-040a29b557cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:48.242632 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba782204-b549-45db-b25c-040a29b557cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:48.243372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba782204-b549-45db-b25c-040a29b557cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:48.245040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba782204-b549-45db-b25c-040a29b557cb admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:48.262761 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1385/2721] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:30:48 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:30:48.267043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef6987-3c9d-4e13-a692-8cd01d5ac048 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:48.285471 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef6987-3c9d-4e13-a692-8cd01d5ac048 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:48.295856 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf62a3-8b0b-4bc8-8513-1983d8549a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:48.295856 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf62a3-8b0b-4bc8-8513-1983d8549a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:48.295856 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf62a3-8b0b-4bc8-8513-1983d8549a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:48.295856 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf62a3-8b0b-4bc8-8513-1983d8549a16 admin admin] PATH_INFO: `/v3/projects/0d48fc83077d45c1a437dbce478552a0/users/9c7baef96887484ca542f45c61e13a54/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:48.313156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf62a3-8b0b-4bc8-8513-1983d8549a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d48fc83077d45c1a437dbce478552a0, user_id=9c7baef96887484ca542f45c61e13a54, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:48.316246 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf62a3-8b0b-4bc8-8513-1983d8549a16 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:48.403463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1337/2722] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:30:48 2022] PUT /identity/v3/projects/0d48fc83077d45c1a437dbce478552a0/users/9c7baef96887484ca542f45c61e13a54/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:48.414300 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478344e-6315-4070-b44a-e0192510d7e3 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:48.414677 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478344e-6315-4070-b44a-e0192510d7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:48.415370 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478344e-6315-4070-b44a-e0192510d7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:48.452309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c478344e-6315-4070-b44a-e0192510d7e3 None None] MFA Rules not processed for user `9c7baef96887484ca542f45c61e13a54`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:48.453595 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c478344e-6315-4070-b44a-e0192510d7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:48.513401 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:48.553222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1386/2723] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:48.574850 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf62a3-8b0b-4bc8-8513-1983d8549a16 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:48.576733 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fbdf62a3-8b0b-4bc8-8513-1983d8549a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:48.592541 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:48.654382 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf62a3-8b0b-4bc8-8513-1983d8549a16 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:48.662663 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d04bc9-0fd0-4979-9684-0e07c0ccca88 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d25aebc2bbc47b5adb7200275c98d90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:48.663439 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d04bc9-0fd0-4979-9684-0e07c0ccca88 service glance] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:48.663744 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d04bc9-0fd0-4979-9684-0e07c0ccca88 service glance] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:48.664013 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d04bc9-0fd0-4979-9684-0e07c0ccca88 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:48.673929 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d04bc9-0fd0-4979-9684-0e07c0ccca88 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:48.675477 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d04bc9-0fd0-4979-9684-0e07c0ccca88 service glance] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:48.686236 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1338/2724] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:30:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:30:50.173559 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478344e-6315-4070-b44a-e0192510d7e3 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:50.175433 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c478344e-6315-4070-b44a-e0192510d7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:50.254486 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478344e-6315-4070-b44a-e0192510d7e3 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:50.258239 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ba424-5084-45fa-9e43-68448ad8125f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:50.258902 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ba424-5084-45fa-9e43-68448ad8125f service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:50.259790 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ba424-5084-45fa-9e43-68448ad8125f service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:50.259790 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ba424-5084-45fa-9e43-68448ad8125f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:50.261438 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-725ba424-5084-45fa-9e43-68448ad8125f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:50.330777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ba424-5084-45fa-9e43-68448ad8125f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:50.332284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ba424-5084-45fa-9e43-68448ad8125f service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:50.344655 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1387/2725] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:30:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:30:52.209922 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbbf0f-66e5-4106-a9de-2aad0ea7c9dc None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:52.210369 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbbf0f-66e5-4106-a9de-2aad0ea7c9dc None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:52.210679 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbbf0f-66e5-4106-a9de-2aad0ea7c9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:52.233886 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-68bbbf0f-66e5-4106-a9de-2aad0ea7c9dc None None] MFA Rules not processed for user `8c83c9a2d38e460fb838ffc9f50fea8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:52.235405 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-68bbbf0f-66e5-4106-a9de-2aad0ea7c9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:52.305723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1339/2726] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:56.524216 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ba424-5084-45fa-9e43-68448ad8125f service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:56.526463 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-725ba424-5084-45fa-9e43-68448ad8125f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:56.622359 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ba424-5084-45fa-9e43-68448ad8125f service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:56.627916 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b69ff-39c3-4e37-b598-a7957b6c0753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:56.628781 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b69ff-39c3-4e37-b598-a7957b6c0753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:56.629199 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b69ff-39c3-4e37-b598-a7957b6c0753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:56.629547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b69ff-39c3-4e37-b598-a7957b6c0753 admin admin] PATH_INFO: `/v3/users/a9976e8a500a44729b9645a8884062de` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:56.641580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b69ff-39c3-4e37-b598-a7957b6c0753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9976e8a500a44729b9645a8884062de)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:56.643746 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b69ff-39c3-4e37-b598-a7957b6c0753 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:56.907877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:56.926569 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7a4b69ff-39c3-4e37-b598-a7957b6c0753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9976e8a500a44729b9645a8884062de'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:56.927614 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7a4b69ff-39c3-4e37-b598-a7957b6c0753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9976e8a500a44729b9645a8884062de'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:56.999285 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7a4b69ff-39c3-4e37-b598-a7957b6c0753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9976e8a500a44729b9645a8884062de'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:57.014343 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7a4b69ff-39c3-4e37-b598-a7957b6c0753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9976e8a500a44729b9645a8884062de'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:57.015709 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7a4b69ff-39c3-4e37-b598-a7957b6c0753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9976e8a500a44729b9645a8884062de'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:57.031371 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1388/2727] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:30:56 2022] DELETE /identity/v3/users/a9976e8a500a44729b9645a8884062de => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:57.037005 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1f79c-8406-4fea-bb31-3b8605ef0d89 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:57.037649 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1f79c-8406-4fea-bb31-3b8605ef0d89 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:57.037649 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1f79c-8406-4fea-bb31-3b8605ef0d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:57.058030 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-38f1f79c-8406-4fea-bb31-3b8605ef0d89 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:30:57.060569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-38f1f79c-8406-4fea-bb31-3b8605ef0d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:57.141510 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1340/2728] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:30:57.152420 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b69ff-39c3-4e37-b598-a7957b6c0753 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:57.154197 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7a4b69ff-39c3-4e37-b598-a7957b6c0753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:57.218890 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b69ff-39c3-4e37-b598-a7957b6c0753 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:57.222522 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f959e-9a51-49a6-b122-79a6cfbe5661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:57.223158 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f959e-9a51-49a6-b122-79a6cfbe5661 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:57.223444 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f959e-9a51-49a6-b122-79a6cfbe5661 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:57.223720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f959e-9a51-49a6-b122-79a6cfbe5661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:57.235327 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f959e-9a51-49a6-b122-79a6cfbe5661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:57.237991 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f959e-9a51-49a6-b122-79a6cfbe5661 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:57.248186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1389/2729] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:30:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:30:57.815179 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1f79c-8406-4fea-bb31-3b8605ef0d89 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:57.820511 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-38f1f79c-8406-4fea-bb31-3b8605ef0d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:57.833959 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1f79c-8406-4fea-bb31-3b8605ef0d89 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:57.841829 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1008c-4eb7-42a8-9424-5c661404cfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:57.845313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1008c-4eb7-42a8-9424-5c661404cfea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:57.845313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1008c-4eb7-42a8-9424-5c661404cfea admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:57.845908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1008c-4eb7-42a8-9424-5c661404cfea admin admin] PATH_INFO: `/v3/projects/9c6dc8a87d8c452f9e7c414b47d8b14c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:57.847623 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1008c-4eb7-42a8-9424-5c661404cfea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c6dc8a87d8c452f9e7c414b47d8b14c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:57.850063 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1008c-4eb7-42a8-9424-5c661404cfea admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:58.074976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-34b1008c-4eb7-42a8-9424-5c661404cfea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c6dc8a87d8c452f9e7c414b47d8b14c', 'request_id': 'req-34b1008c-4eb7-42a8-9424-5c661404cfea'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:58.082216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-34b1008c-4eb7-42a8-9424-5c661404cfea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c6dc8a87d8c452f9e7c414b47d8b14c', 'request_id': 'req-34b1008c-4eb7-42a8-9424-5c661404cfea'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:58.084127 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:58.089931 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-34b1008c-4eb7-42a8-9424-5c661404cfea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c6dc8a87d8c452f9e7c414b47d8b14c', 'request_id': 'req-34b1008c-4eb7-42a8-9424-5c661404cfea'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:58.184437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-34b1008c-4eb7-42a8-9424-5c661404cfea admin admin] The token cache is being invalidate because project 9c6dc8a87d8c452f9e7c414b47d8b14c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:30:58.184763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-34b1008c-4eb7-42a8-9424-5c661404cfea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:58.185428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-34b1008c-4eb7-42a8-9424-5c661404cfea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:58.187094 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1341/2730] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:30:57 2022] DELETE /identity/v3/projects/9c6dc8a87d8c452f9e7c414b47d8b14c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:58.191464 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f959e-9a51-49a6-b122-79a6cfbe5661 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:58.202064 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f959e-9a51-49a6-b122-79a6cfbe5661 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:58.270837 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76e5d3-be2e-45cc-869d-1cd9c14bb625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:58.271265 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e5d3-be2e-45cc-869d-1cd9c14bb625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:58.271571 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e5d3-be2e-45cc-869d-1cd9c14bb625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:58.271879 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e5d3-be2e-45cc-869d-1cd9c14bb625 admin admin] PATH_INFO: `/v3/users/6efb4d6d14db45008636297cf1a486bb` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:58.273092 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76e5d3-be2e-45cc-869d-1cd9c14bb625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6efb4d6d14db45008636297cf1a486bb)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:58.275036 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76e5d3-be2e-45cc-869d-1cd9c14bb625 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:58.500974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3c76e5d3-be2e-45cc-869d-1cd9c14bb625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6efb4d6d14db45008636297cf1a486bb'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:58.501686 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3c76e5d3-be2e-45cc-869d-1cd9c14bb625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6efb4d6d14db45008636297cf1a486bb'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:58.606853 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3c76e5d3-be2e-45cc-869d-1cd9c14bb625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6efb4d6d14db45008636297cf1a486bb'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:58.612703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:58.622091 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3c76e5d3-be2e-45cc-869d-1cd9c14bb625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6efb4d6d14db45008636297cf1a486bb'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:58.622841 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3c76e5d3-be2e-45cc-869d-1cd9c14bb625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6efb4d6d14db45008636297cf1a486bb'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:58.638838 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1390/2731] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:30:58 2022] DELETE /identity/v3/users/6efb4d6d14db45008636297cf1a486bb => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:30:59.185597 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1008c-4eb7-42a8-9424-5c661404cfea admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:30:59.187225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-34b1008c-4eb7-42a8-9424-5c661404cfea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:30:59.205559 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1008c-4eb7-42a8-9424-5c661404cfea admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:30:59.268366 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f2e8c-f791-4992-9b8a-9719e8cddc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:30:59.269046 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f2e8c-f791-4992-9b8a-9719e8cddc57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:30:59.269317 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f2e8c-f791-4992-9b8a-9719e8cddc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:30:59.269590 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f2e8c-f791-4992-9b8a-9719e8cddc57 admin admin] PATH_INFO: `/v3/projects/008810dd4405472b9ceaaf437a178e6e` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:30:59.271394 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f2e8c-f791-4992-9b8a-9719e8cddc57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=008810dd4405472b9ceaaf437a178e6e)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:30:59.273421 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f2e8c-f791-4992-9b8a-9719e8cddc57 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:30:59.404036 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-457f2e8c-f791-4992-9b8a-9719e8cddc57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '008810dd4405472b9ceaaf437a178e6e', 'request_id': 'req-457f2e8c-f791-4992-9b8a-9719e8cddc57'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:59.415971 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-457f2e8c-f791-4992-9b8a-9719e8cddc57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '008810dd4405472b9ceaaf437a178e6e', 'request_id': 'req-457f2e8c-f791-4992-9b8a-9719e8cddc57'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:59.422648 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-457f2e8c-f791-4992-9b8a-9719e8cddc57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '008810dd4405472b9ceaaf437a178e6e', 'request_id': 'req-457f2e8c-f791-4992-9b8a-9719e8cddc57'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:59.515647 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-457f2e8c-f791-4992-9b8a-9719e8cddc57 admin admin] The token cache is being invalidate because project 008810dd4405472b9ceaaf437a178e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:30:59.515937 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-457f2e8c-f791-4992-9b8a-9719e8cddc57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:59.516583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-457f2e8c-f791-4992-9b8a-9719e8cddc57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:30:59.518168 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1342/2732] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:30:59 2022] DELETE /identity/v3/projects/008810dd4405472b9ceaaf437a178e6e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:31:06.482730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76e5d3-be2e-45cc-869d-1cd9c14bb625 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:06.484535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3c76e5d3-be2e-45cc-869d-1cd9c14bb625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:06.498522 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76e5d3-be2e-45cc-869d-1cd9c14bb625 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:06.560620 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f9c8b-3027-49e9-a622-c9709d2a28a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:06.561326 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f9c8b-3027-49e9-a622-c9709d2a28a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:06.561607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f9c8b-3027-49e9-a622-c9709d2a28a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:06.561886 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f9c8b-3027-49e9-a622-c9709d2a28a9 admin admin] PATH_INFO: `/v3/users/9c7baef96887484ca542f45c61e13a54` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:06.563324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f9c8b-3027-49e9-a622-c9709d2a28a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c7baef96887484ca542f45c61e13a54)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:06.566555 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f9c8b-3027-49e9-a622-c9709d2a28a9 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:06.800236 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5f6f9c8b-3027-49e9-a622-c9709d2a28a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c7baef96887484ca542f45c61e13a54'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:06.801053 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5f6f9c8b-3027-49e9-a622-c9709d2a28a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c7baef96887484ca542f45c61e13a54'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:06.869289 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5f6f9c8b-3027-49e9-a622-c9709d2a28a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c7baef96887484ca542f45c61e13a54'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:06.884294 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5f6f9c8b-3027-49e9-a622-c9709d2a28a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c7baef96887484ca542f45c61e13a54'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:06.885168 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5f6f9c8b-3027-49e9-a622-c9709d2a28a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c7baef96887484ca542f45c61e13a54'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:06.904015 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1391/2733] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:31:06 2022] DELETE /identity/v3/users/9c7baef96887484ca542f45c61e13a54 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:31:06.909628 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0b140-41a4-4f1b-9fe8-accf17a0f674 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:06.910153 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0b140-41a4-4f1b-9fe8-accf17a0f674 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:06.910550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0b140-41a4-4f1b-9fe8-accf17a0f674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:06.938231 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-89c0b140-41a4-4f1b-9fe8-accf17a0f674 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:31:06.938231 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-89c0b140-41a4-4f1b-9fe8-accf17a0f674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:07.008446 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1343/2734] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:31:07.019577 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f9c8b-3027-49e9-a622-c9709d2a28a9 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:07.021177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5f6f9c8b-3027-49e9-a622-c9709d2a28a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:07.085363 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f9c8b-3027-49e9-a622-c9709d2a28a9 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:07.088959 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8880156-3fca-4091-8422-07b8c886541e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:07.089594 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8880156-3fca-4091-8422-07b8c886541e service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:07.089873 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8880156-3fca-4091-8422-07b8c886541e service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:07.090148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8880156-3fca-4091-8422-07b8c886541e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:07.100109 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8880156-3fca-4091-8422-07b8c886541e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:07.101685 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8880156-3fca-4091-8422-07b8c886541e service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:07.106069 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:31:07.113333 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1392/2735] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:31:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:31:07.692873 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0b140-41a4-4f1b-9fe8-accf17a0f674 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:07.698401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-89c0b140-41a4-4f1b-9fe8-accf17a0f674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:07.708323 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0b140-41a4-4f1b-9fe8-accf17a0f674 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:07.719864 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2158d42-b1fb-4cd3-9647-1c1d81006de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:07.720629 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2158d42-b1fb-4cd3-9647-1c1d81006de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:07.720945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2158d42-b1fb-4cd3-9647-1c1d81006de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:07.721743 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2158d42-b1fb-4cd3-9647-1c1d81006de8 admin admin] PATH_INFO: `/v3/projects/0d48fc83077d45c1a437dbce478552a0` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:07.722896 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2158d42-b1fb-4cd3-9647-1c1d81006de8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d48fc83077d45c1a437dbce478552a0)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:07.725025 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2158d42-b1fb-4cd3-9647-1c1d81006de8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:07.735684 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:31:07.855916 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e2158d42-b1fb-4cd3-9647-1c1d81006de8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d48fc83077d45c1a437dbce478552a0', 'request_id': 'req-e2158d42-b1fb-4cd3-9647-1c1d81006de8'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:07.865025 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e2158d42-b1fb-4cd3-9647-1c1d81006de8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d48fc83077d45c1a437dbce478552a0', 'request_id': 'req-e2158d42-b1fb-4cd3-9647-1c1d81006de8'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:07.880052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e2158d42-b1fb-4cd3-9647-1c1d81006de8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d48fc83077d45c1a437dbce478552a0', 'request_id': 'req-e2158d42-b1fb-4cd3-9647-1c1d81006de8'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:07.985842 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e2158d42-b1fb-4cd3-9647-1c1d81006de8 admin admin] The token cache is being invalidate because project 0d48fc83077d45c1a437dbce478552a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:31:07.986486 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e2158d42-b1fb-4cd3-9647-1c1d81006de8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:07.987575 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e2158d42-b1fb-4cd3-9647-1c1d81006de8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:07.989429 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1344/2736] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:31:07 2022] DELETE /identity/v3/projects/0d48fc83077d45c1a437dbce478552a0 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:31:07.994622 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8387a12-b349-4928-94af-0149d34cebc2 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:07.995322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8387a12-b349-4928-94af-0149d34cebc2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:07.995658 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8387a12-b349-4928-94af-0149d34cebc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:08.093532 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a8387a12-b349-4928-94af-0149d34cebc2 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:31:08.096069 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a8387a12-b349-4928-94af-0149d34cebc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:08.211848 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1393/2737] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:31:08.220932 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2851455-fc4b-41cc-b8fd-066e391e9d09 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:08.221763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2851455-fc4b-41cc-b8fd-066e391e9d09 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:08.222050 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2851455-fc4b-41cc-b8fd-066e391e9d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:08.242996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d2851455-fc4b-41cc-b8fd-066e391e9d09 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:31:08.244249 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d2851455-fc4b-41cc-b8fd-066e391e9d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:08.254015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1345/2738] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:31:08.258492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8387a12-b349-4928-94af-0149d34cebc2 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:08.269657 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8387a12-b349-4928-94af-0149d34cebc2 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:08.275374 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac9b9b-e499-4c09-9d4c-c0d860e243dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:08.276144 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac9b9b-e499-4c09-9d4c-c0d860e243dc admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:08.276426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac9b9b-e499-4c09-9d4c-c0d860e243dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:08.276726 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac9b9b-e499-4c09-9d4c-c0d860e243dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:08.277504 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac9b9b-e499-4c09-9d4c-c0d860e243dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:31:08.277854 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac9b9b-e499-4c09-9d4c-c0d860e243dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:08.279698 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac9b9b-e499-4c09-9d4c-c0d860e243dc admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:08.293278 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1394/2739] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:31:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:31:08.299970 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2851455-fc4b-41cc-b8fd-066e391e9d09 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:08.309894 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2851455-fc4b-41cc-b8fd-066e391e9d09 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:08.314857 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc6327-47cc-4fb0-a46b-d5d584ae0964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:08.316040 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc6327-47cc-4fb0-a46b-d5d584ae0964 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:08.316327 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc6327-47cc-4fb0-a46b-d5d584ae0964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:08.316602 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc6327-47cc-4fb0-a46b-d5d584ae0964 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:08.317386 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc6327-47cc-4fb0-a46b-d5d584ae0964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:08.319407 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc6327-47cc-4fb0-a46b-d5d584ae0964 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:08.431908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1346/2740] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:31:08 2022] POST /identity/v3/projects => generated 362 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:31:08.436547 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac9b9b-e499-4c09-9d4c-c0d860e243dc admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:08.450243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac9b9b-e499-4c09-9d4c-c0d860e243dc admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:08.528073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a309859-7211-498c-9a83-9efe44126f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:08.528611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a309859-7211-498c-9a83-9efe44126f94 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:08.528918 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a309859-7211-498c-9a83-9efe44126f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:08.529197 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a309859-7211-498c-9a83-9efe44126f94 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:08.529865 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a309859-7211-498c-9a83-9efe44126f94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:08.531794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a309859-7211-498c-9a83-9efe44126f94 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:08.543124 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:31:08.659766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1395/2741] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:31:08 2022] POST /identity/v3/users => generated 282 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:31:08.663918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc6327-47cc-4fb0-a46b-d5d584ae0964 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:08.676173 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc6327-47cc-4fb0-a46b-d5d584ae0964 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:08.681178 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c1172-1fcb-4da0-b326-73953814a200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:08.682065 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c1172-1fcb-4da0-b326-73953814a200 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:08.682379 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c1172-1fcb-4da0-b326-73953814a200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:08.682662 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c1172-1fcb-4da0-b326-73953814a200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:08.683640 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c1172-1fcb-4da0-b326-73953814a200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:08.685465 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c1172-1fcb-4da0-b326-73953814a200 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:08.696385 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1347/2742] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:31:08 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:31:08.700386 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a309859-7211-498c-9a83-9efe44126f94 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:08.711446 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a309859-7211-498c-9a83-9efe44126f94 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:08.716141 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13daf3-fd60-45ce-b8d3-2a339d2976b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:08.716784 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13daf3-fd60-45ce-b8d3-2a339d2976b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:08.717069 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13daf3-fd60-45ce-b8d3-2a339d2976b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:08.717348 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13daf3-fd60-45ce-b8d3-2a339d2976b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:08.718044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13daf3-fd60-45ce-b8d3-2a339d2976b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:08.719700 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13daf3-fd60-45ce-b8d3-2a339d2976b8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:08.732762 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1396/2743] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:31:08 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:31:08.736977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c1172-1fcb-4da0-b326-73953814a200 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:08.747265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c1172-1fcb-4da0-b326-73953814a200 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:08.751903 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758adfc3-f928-4916-b0b0-f5c1de3d958d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:08.752599 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758adfc3-f928-4916-b0b0-f5c1de3d958d admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:08.752916 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758adfc3-f928-4916-b0b0-f5c1de3d958d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:08.753196 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758adfc3-f928-4916-b0b0-f5c1de3d958d admin admin] PATH_INFO: `/v3/projects/7ee78318adcd421b9f7d6cec77f070f1/users/5a940a0c70074690b125fd19d4393625/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:08.776339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758adfc3-f928-4916-b0b0-f5c1de3d958d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee78318adcd421b9f7d6cec77f070f1, user_id=5a940a0c70074690b125fd19d4393625, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:08.779221 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758adfc3-f928-4916-b0b0-f5c1de3d958d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:08.868241 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1348/2744] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:31:08 2022] PUT /identity/v3/projects/7ee78318adcd421b9f7d6cec77f070f1/users/5a940a0c70074690b125fd19d4393625/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:31:08.878651 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44c0ad-9865-4dcd-94bd-9dd9175d2361 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:08.878944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44c0ad-9865-4dcd-94bd-9dd9175d2361 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:08.879221 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44c0ad-9865-4dcd-94bd-9dd9175d2361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:08.907579 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6e44c0ad-9865-4dcd-94bd-9dd9175d2361 None None] MFA Rules not processed for user `5a940a0c70074690b125fd19d4393625`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:31:08.909468 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6e44c0ad-9865-4dcd-94bd-9dd9175d2361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:08.978378 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1397/2745] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:31:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:31:09.012069 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758adfc3-f928-4916-b0b0-f5c1de3d958d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:09.014014 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-758adfc3-f928-4916-b0b0-f5c1de3d958d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:09.091839 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758adfc3-f928-4916-b0b0-f5c1de3d958d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:09.096103 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2850ac9-99a1-46f9-8f82-1a9d59652eda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:09.096767 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2850ac9-99a1-46f9-8f82-1a9d59652eda service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:09.097052 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2850ac9-99a1-46f9-8f82-1a9d59652eda service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:09.097333 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2850ac9-99a1-46f9-8f82-1a9d59652eda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:09.106555 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2850ac9-99a1-46f9-8f82-1a9d59652eda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:09.107993 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2850ac9-99a1-46f9-8f82-1a9d59652eda service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:09.118817 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1349/2746] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:31:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:31:09.133235 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44c0ad-9865-4dcd-94bd-9dd9175d2361 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:09.197413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44c0ad-9865-4dcd-94bd-9dd9175d2361 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:09.202087 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b69da-bd7c-422b-a5bd-e270d7d47f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:09.202720 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b69da-bd7c-422b-a5bd-e270d7d47f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:09.203004 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b69da-bd7c-422b-a5bd-e270d7d47f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:09.203284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b69da-bd7c-422b-a5bd-e270d7d47f35 admin admin] PATH_INFO: `/v3/users/5a940a0c70074690b125fd19d4393625` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:09.204481 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b69da-bd7c-422b-a5bd-e270d7d47f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a940a0c70074690b125fd19d4393625)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:09.207186 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b69da-bd7c-422b-a5bd-e270d7d47f35 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:09.358691 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6c7b69da-bd7c-422b-a5bd-e270d7d47f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a940a0c70074690b125fd19d4393625'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:09.359273 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6c7b69da-bd7c-422b-a5bd-e270d7d47f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a940a0c70074690b125fd19d4393625'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:09.456564 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6c7b69da-bd7c-422b-a5bd-e270d7d47f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a940a0c70074690b125fd19d4393625'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:09.469583 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6c7b69da-bd7c-422b-a5bd-e270d7d47f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a940a0c70074690b125fd19d4393625'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:09.473324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6c7b69da-bd7c-422b-a5bd-e270d7d47f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a940a0c70074690b125fd19d4393625'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:09.473324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:31:09.484147 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1398/2747] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:31:09 2022] DELETE /identity/v3/users/5a940a0c70074690b125fd19d4393625 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:31:09.489121 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302119fb-d421-462f-82ef-1038f111d9a3 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:09.489410 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302119fb-d421-462f-82ef-1038f111d9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:09.489742 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302119fb-d421-462f-82ef-1038f111d9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:09.510191 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-302119fb-d421-462f-82ef-1038f111d9a3 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:31:09.511420 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-302119fb-d421-462f-82ef-1038f111d9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:09.515367 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:31:09.570502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1350/2748] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:31:09.582829 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b69da-bd7c-422b-a5bd-e270d7d47f35 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:09.582829 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6c7b69da-bd7c-422b-a5bd-e270d7d47f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:09.641495 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b69da-bd7c-422b-a5bd-e270d7d47f35 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:09.645701 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45820767-f3c4-45ec-9409-fb1deb76c72c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:09.646310 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45820767-f3c4-45ec-9409-fb1deb76c72c service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:09.646587 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45820767-f3c4-45ec-9409-fb1deb76c72c service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:09.646940 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45820767-f3c4-45ec-9409-fb1deb76c72c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:09.656786 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45820767-f3c4-45ec-9409-fb1deb76c72c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:09.658307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45820767-f3c4-45ec-9409-fb1deb76c72c service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:09.668542 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1399/2749] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:31:10.120759 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302119fb-d421-462f-82ef-1038f111d9a3 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:10.126853 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-302119fb-d421-462f-82ef-1038f111d9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:10.135357 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302119fb-d421-462f-82ef-1038f111d9a3 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:10.140958 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc4b1c-829e-409d-8842-c1f4ce59989f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:10.141693 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc4b1c-829e-409d-8842-c1f4ce59989f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:10.142516 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc4b1c-829e-409d-8842-c1f4ce59989f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:10.142807 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc4b1c-829e-409d-8842-c1f4ce59989f admin admin] PATH_INFO: `/v3/projects/7ee78318adcd421b9f7d6cec77f070f1` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:10.145181 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc4b1c-829e-409d-8842-c1f4ce59989f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ee78318adcd421b9f7d6cec77f070f1)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:10.147986 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc4b1c-829e-409d-8842-c1f4ce59989f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:10.282730 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e2cc4b1c-829e-409d-8842-c1f4ce59989f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ee78318adcd421b9f7d6cec77f070f1', 'request_id': 'req-e2cc4b1c-829e-409d-8842-c1f4ce59989f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:10.289185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e2cc4b1c-829e-409d-8842-c1f4ce59989f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ee78318adcd421b9f7d6cec77f070f1', 'request_id': 'req-e2cc4b1c-829e-409d-8842-c1f4ce59989f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:10.294738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e2cc4b1c-829e-409d-8842-c1f4ce59989f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ee78318adcd421b9f7d6cec77f070f1', 'request_id': 'req-e2cc4b1c-829e-409d-8842-c1f4ce59989f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:10.383796 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e2cc4b1c-829e-409d-8842-c1f4ce59989f admin admin] The token cache is being invalidate because project 7ee78318adcd421b9f7d6cec77f070f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:31:10.384059 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e2cc4b1c-829e-409d-8842-c1f4ce59989f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:10.384709 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e2cc4b1c-829e-409d-8842-c1f4ce59989f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:10.386284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1351/2750] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:31:10 2022] DELETE /identity/v3/projects/7ee78318adcd421b9f7d6cec77f070f1 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:31:10.391395 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b4191-8bc6-4fb2-9b53-2c8c9abd741f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:10.391879 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b4191-8bc6-4fb2-9b53-2c8c9abd741f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:10.391976 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b4191-8bc6-4fb2-9b53-2c8c9abd741f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:10.412546 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a82b4191-8bc6-4fb2-9b53-2c8c9abd741f None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:31:10.413808 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a82b4191-8bc6-4fb2-9b53-2c8c9abd741f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:10.474399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1400/2751] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:31:10.482460 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d3343-59fd-49cf-8cac-ff1ad86be01b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:10.482747 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d3343-59fd-49cf-8cac-ff1ad86be01b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:10.483030 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d3343-59fd-49cf-8cac-ff1ad86be01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:10.503582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-3c8d3343-59fd-49cf-8cac-ff1ad86be01b None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:31:10.504826 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3c8d3343-59fd-49cf-8cac-ff1ad86be01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:10.512925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1352/2752] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:31:10.517129 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b4191-8bc6-4fb2-9b53-2c8c9abd741f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:10.526901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b4191-8bc6-4fb2-9b53-2c8c9abd741f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:10.531798 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c953e80-565c-44c1-a1dc-821cca05aac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:10.532392 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c953e80-565c-44c1-a1dc-821cca05aac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:10.532678 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c953e80-565c-44c1-a1dc-821cca05aac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:10.533022 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c953e80-565c-44c1-a1dc-821cca05aac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:10.533742 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c953e80-565c-44c1-a1dc-821cca05aac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:31:10.534049 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c953e80-565c-44c1-a1dc-821cca05aac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:10.535626 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c953e80-565c-44c1-a1dc-821cca05aac2 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:10.547379 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1401/2753] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:31:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:31:10.552182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d3343-59fd-49cf-8cac-ff1ad86be01b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:10.561807 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d3343-59fd-49cf-8cac-ff1ad86be01b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:10.567227 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540cbf4-630c-4a41-a45b-f8a446287f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:10.567862 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540cbf4-630c-4a41-a45b-f8a446287f8f admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:10.568222 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540cbf4-630c-4a41-a45b-f8a446287f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:10.568222 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540cbf4-630c-4a41-a45b-f8a446287f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:10.569292 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540cbf4-630c-4a41-a45b-f8a446287f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:10.570950 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540cbf4-630c-4a41-a45b-f8a446287f8f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:10.724242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1353/2754] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:31:10 2022] POST /identity/v3/projects => generated 366 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:31:10.728709 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c953e80-565c-44c1-a1dc-821cca05aac2 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:10.739508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c953e80-565c-44c1-a1dc-821cca05aac2 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:10.798230 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca88525-d028-409e-9007-f0d8858926e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:10.798751 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca88525-d028-409e-9007-f0d8858926e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:10.799034 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca88525-d028-409e-9007-f0d8858926e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:10.799995 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca88525-d028-409e-9007-f0d8858926e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:10.800627 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca88525-d028-409e-9007-f0d8858926e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:10.802608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca88525-d028-409e-9007-f0d8858926e3 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:10.915654 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1402/2755] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:31:10 2022] POST /identity/v3/users => generated 284 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:31:10.919756 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540cbf4-630c-4a41-a45b-f8a446287f8f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:10.931409 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540cbf4-630c-4a41-a45b-f8a446287f8f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:10.936099 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fc730-b56d-46c4-8e2f-87fdc42a5921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:10.936855 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fc730-b56d-46c4-8e2f-87fdc42a5921 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:10.937139 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fc730-b56d-46c4-8e2f-87fdc42a5921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:10.937414 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fc730-b56d-46c4-8e2f-87fdc42a5921 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:10.938149 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fc730-b56d-46c4-8e2f-87fdc42a5921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:10.939763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fc730-b56d-46c4-8e2f-87fdc42a5921 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:10.950469 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1354/2756] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:31:10 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:31:10.956039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca88525-d028-409e-9007-f0d8858926e3 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:10.967375 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca88525-d028-409e-9007-f0d8858926e3 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:10.972879 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35426733-8084-4e9a-998d-b882b80b8a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:10.973500 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35426733-8084-4e9a-998d-b882b80b8a9b admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:10.973777 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35426733-8084-4e9a-998d-b882b80b8a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:10.974047 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35426733-8084-4e9a-998d-b882b80b8a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:10.976735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35426733-8084-4e9a-998d-b882b80b8a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:10.976735 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35426733-8084-4e9a-998d-b882b80b8a9b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:10.981981 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:31:10.987889 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1403/2757] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:31:10 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:31:10.992435 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fc730-b56d-46c4-8e2f-87fdc42a5921 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:11.003234 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fc730-b56d-46c4-8e2f-87fdc42a5921 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:11.008739 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658953d-aa38-420f-a6fe-eb1bcda17ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:11.011148 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658953d-aa38-420f-a6fe-eb1bcda17ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:11.011148 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658953d-aa38-420f-a6fe-eb1bcda17ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:11.011148 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658953d-aa38-420f-a6fe-eb1bcda17ee1 admin admin] PATH_INFO: `/v3/projects/e142b010eea24035ae4f5211c8418d48/users/e58edc3eb7c54796a8efcc1fd8130397/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:11.026096 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658953d-aa38-420f-a6fe-eb1bcda17ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e142b010eea24035ae4f5211c8418d48, user_id=e58edc3eb7c54796a8efcc1fd8130397, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:11.028888 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658953d-aa38-420f-a6fe-eb1bcda17ee1 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:11.100048 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1355/2758] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:31:10 2022] PUT /identity/v3/projects/e142b010eea24035ae4f5211c8418d48/users/e58edc3eb7c54796a8efcc1fd8130397/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:31:11.171039 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e7431-fedd-481a-a3e4-f20a63ca1acb None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:11.171313 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e7431-fedd-481a-a3e4-f20a63ca1acb None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:11.171595 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e7431-fedd-481a-a3e4-f20a63ca1acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:11.202752 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-344e7431-fedd-481a-a3e4-f20a63ca1acb None None] MFA Rules not processed for user `e58edc3eb7c54796a8efcc1fd8130397`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:31:11.203983 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-344e7431-fedd-481a-a3e4-f20a63ca1acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:11.272998 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1404/2759] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:31:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:31:11.285879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658953d-aa38-420f-a6fe-eb1bcda17ee1 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:11.287702 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3658953d-aa38-420f-a6fe-eb1bcda17ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:11.319700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:31:11.345755 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658953d-aa38-420f-a6fe-eb1bcda17ee1 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:11.350493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9a864-2762-4334-9615-70e775f2c3ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:11.351049 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9a864-2762-4334-9615-70e775f2c3ef service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:11.351327 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9a864-2762-4334-9615-70e775f2c3ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:11.351598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9a864-2762-4334-9615-70e775f2c3ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:11.360923 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9a864-2762-4334-9615-70e775f2c3ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:11.362141 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9a864-2762-4334-9615-70e775f2c3ef service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:11.371503 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1356/2760] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:31:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:31:21.269870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=32 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:31:21.423152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=13 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:31:33.346417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e7431-fedd-481a-a3e4-f20a63ca1acb None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:33.347936 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-344e7431-fedd-481a-a3e4-f20a63ca1acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:33.447108 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e7431-fedd-481a-a3e4-f20a63ca1acb None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:33.452454 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd5e46-246e-48a8-ab9a-1f7643bbd63a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda05b7b9675423e992470819d1c150a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:33.453108 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd5e46-246e-48a8-ab9a-1f7643bbd63a service placement] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:33.453391 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd5e46-246e-48a8-ab9a-1f7643bbd63a service placement] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:33.453703 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd5e46-246e-48a8-ab9a-1f7643bbd63a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:33.455456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e6dd5e46-246e-48a8-ab9a-1f7643bbd63a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:33.467006 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd5e46-246e-48a8-ab9a-1f7643bbd63a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:33.468592 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd5e46-246e-48a8-ab9a-1f7643bbd63a service placement] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:33.480126 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1405/2761] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:31:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:31:35.074826 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9a864-2762-4334-9615-70e775f2c3ef service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:35.076253 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b1e9a864-2762-4334-9615-70e775f2c3ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:35.157750 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9a864-2762-4334-9615-70e775f2c3ef service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:35.161626 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ba701-987e-4a50-861e-9f1e34b7f41e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:35.162244 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ba701-987e-4a50-861e-9f1e34b7f41e service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:35.162559 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ba701-987e-4a50-861e-9f1e34b7f41e service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:35.162837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ba701-987e-4a50-861e-9f1e34b7f41e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:35.165242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-302ba701-987e-4a50-861e-9f1e34b7f41e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:35.232116 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ba701-987e-4a50-861e-9f1e34b7f41e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:35.233529 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ba701-987e-4a50-861e-9f1e34b7f41e service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:35.243889 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1357/2762] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:31:42.442652 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd5e46-246e-48a8-ab9a-1f7643bbd63a service placement] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:42.444214 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e6dd5e46-246e-48a8-ab9a-1f7643bbd63a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:42.457816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd5e46-246e-48a8-ab9a-1f7643bbd63a service placement] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:42.464431 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c6723-413b-4508-8468-97ecf9b52b4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda05b7b9675423e992470819d1c150a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:42.465104 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c6723-413b-4508-8468-97ecf9b52b4e service placement] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:42.467354 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c6723-413b-4508-8468-97ecf9b52b4e service placement] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:42.468241 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c6723-413b-4508-8468-97ecf9b52b4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:42.471196 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-611c6723-413b-4508-8468-97ecf9b52b4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:42.485169 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c6723-413b-4508-8468-97ecf9b52b4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:42.486787 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c6723-413b-4508-8468-97ecf9b52b4e service placement] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:42.497736 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1406/2763] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:31:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:31:42.584694 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ba701-987e-4a50-861e-9f1e34b7f41e service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:42.586417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-302ba701-987e-4a50-861e-9f1e34b7f41e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:42.599556 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ba701-987e-4a50-861e-9f1e34b7f41e service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:42.604820 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bc439-b8ef-4b81-ae77-1fd0151e8f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:42.605461 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bc439-b8ef-4b81-ae77-1fd0151e8f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:42.605744 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bc439-b8ef-4b81-ae77-1fd0151e8f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:42.606036 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bc439-b8ef-4b81-ae77-1fd0151e8f84 admin admin] PATH_INFO: `/v3/users/c5e540b13bd84385b9332bfe10e30a92` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:42.607193 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bc439-b8ef-4b81-ae77-1fd0151e8f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5e540b13bd84385b9332bfe10e30a92)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:42.609213 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bc439-b8ef-4b81-ae77-1fd0151e8f84 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:42.789235 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f88bc439-b8ef-4b81-ae77-1fd0151e8f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5e540b13bd84385b9332bfe10e30a92'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:42.790437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f88bc439-b8ef-4b81-ae77-1fd0151e8f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5e540b13bd84385b9332bfe10e30a92'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:42.802689 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f88bc439-b8ef-4b81-ae77-1fd0151e8f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5e540b13bd84385b9332bfe10e30a92'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:42.810832 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f88bc439-b8ef-4b81-ae77-1fd0151e8f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5e540b13bd84385b9332bfe10e30a92'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:42.912909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f88bc439-b8ef-4b81-ae77-1fd0151e8f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5e540b13bd84385b9332bfe10e30a92'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:42.920186 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1358/2764] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:31:42 2022] DELETE /identity/v3/users/c5e540b13bd84385b9332bfe10e30a92 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:31:43.189529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c6723-413b-4508-8468-97ecf9b52b4e service placement] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:43.202395 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c6723-413b-4508-8468-97ecf9b52b4e service placement] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:43.262734 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d986e5-0fa7-4d74-9384-7ae603e02d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:43.263413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d986e5-0fa7-4d74-9384-7ae603e02d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:43.263689 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d986e5-0fa7-4d74-9384-7ae603e02d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:43.263966 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d986e5-0fa7-4d74-9384-7ae603e02d6a admin admin] PATH_INFO: `/v3/projects/61e408d4206a4f0cb19e409d49d1a210` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:43.265166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d986e5-0fa7-4d74-9384-7ae603e02d6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e408d4206a4f0cb19e409d49d1a210)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:43.267097 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d986e5-0fa7-4d74-9384-7ae603e02d6a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:43.385724 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-48d986e5-0fa7-4d74-9384-7ae603e02d6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e408d4206a4f0cb19e409d49d1a210', 'request_id': 'req-48d986e5-0fa7-4d74-9384-7ae603e02d6a'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:43.392073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-48d986e5-0fa7-4d74-9384-7ae603e02d6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e408d4206a4f0cb19e409d49d1a210', 'request_id': 'req-48d986e5-0fa7-4d74-9384-7ae603e02d6a'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:43.404954 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:31:43.404954 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-48d986e5-0fa7-4d74-9384-7ae603e02d6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e408d4206a4f0cb19e409d49d1a210', 'request_id': 'req-48d986e5-0fa7-4d74-9384-7ae603e02d6a'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:43.531606 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-48d986e5-0fa7-4d74-9384-7ae603e02d6a admin admin] The token cache is being invalidate because project 61e408d4206a4f0cb19e409d49d1a210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:31:43.532306 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-48d986e5-0fa7-4d74-9384-7ae603e02d6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:43.532408 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-48d986e5-0fa7-4d74-9384-7ae603e02d6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:43.533944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1407/2765] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:31:43 2022] DELETE /identity/v3/projects/61e408d4206a4f0cb19e409d49d1a210 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:31:43.538318 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bc439-b8ef-4b81-ae77-1fd0151e8f84 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:43.539872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f88bc439-b8ef-4b81-ae77-1fd0151e8f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:43.548549 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:31:43.554148 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bc439-b8ef-4b81-ae77-1fd0151e8f84 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:43.611173 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b9f80-34d2-4aeb-a1c9-cf58c1f69608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:43.611865 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b9f80-34d2-4aeb-a1c9-cf58c1f69608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:43.612100 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b9f80-34d2-4aeb-a1c9-cf58c1f69608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:43.612374 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b9f80-34d2-4aeb-a1c9-cf58c1f69608 admin admin] PATH_INFO: `/v3/users/e8c36ee011894790bc29d6db6774ec0d` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:43.613622 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b9f80-34d2-4aeb-a1c9-cf58c1f69608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8c36ee011894790bc29d6db6774ec0d)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:43.615573 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b9f80-34d2-4aeb-a1c9-cf58c1f69608 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:43.843099 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f80b9f80-34d2-4aeb-a1c9-cf58c1f69608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8c36ee011894790bc29d6db6774ec0d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:43.843756 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f80b9f80-34d2-4aeb-a1c9-cf58c1f69608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8c36ee011894790bc29d6db6774ec0d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:43.857596 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f80b9f80-34d2-4aeb-a1c9-cf58c1f69608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8c36ee011894790bc29d6db6774ec0d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:43.864929 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f80b9f80-34d2-4aeb-a1c9-cf58c1f69608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8c36ee011894790bc29d6db6774ec0d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:43.987931 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f80b9f80-34d2-4aeb-a1c9-cf58c1f69608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8c36ee011894790bc29d6db6774ec0d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:43.995245 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1359/2766] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:31:43 2022] DELETE /identity/v3/users/e8c36ee011894790bc29d6db6774ec0d => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:31:44.249802 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d986e5-0fa7-4d74-9384-7ae603e02d6a admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:44.252273 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-48d986e5-0fa7-4d74-9384-7ae603e02d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:44.271850 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d986e5-0fa7-4d74-9384-7ae603e02d6a admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:44.364766 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918dfc1a-55bf-4147-9c20-7183389dbc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:44.365529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dfc1a-55bf-4147-9c20-7183389dbc3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:44.365898 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dfc1a-55bf-4147-9c20-7183389dbc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:44.366244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dfc1a-55bf-4147-9c20-7183389dbc3d admin admin] PATH_INFO: `/v3/projects/071693c97e8f44e5ad07ead404f83884` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:44.367827 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918dfc1a-55bf-4147-9c20-7183389dbc3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=071693c97e8f44e5ad07ead404f83884)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:44.369946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918dfc1a-55bf-4147-9c20-7183389dbc3d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:44.500411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-918dfc1a-55bf-4147-9c20-7183389dbc3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '071693c97e8f44e5ad07ead404f83884', 'request_id': 'req-918dfc1a-55bf-4147-9c20-7183389dbc3d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:44.507654 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-918dfc1a-55bf-4147-9c20-7183389dbc3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '071693c97e8f44e5ad07ead404f83884', 'request_id': 'req-918dfc1a-55bf-4147-9c20-7183389dbc3d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:44.513949 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-918dfc1a-55bf-4147-9c20-7183389dbc3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '071693c97e8f44e5ad07ead404f83884', 'request_id': 'req-918dfc1a-55bf-4147-9c20-7183389dbc3d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:44.594438 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-918dfc1a-55bf-4147-9c20-7183389dbc3d admin admin] The token cache is being invalidate because project 071693c97e8f44e5ad07ead404f83884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:31:44.595070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-918dfc1a-55bf-4147-9c20-7183389dbc3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:44.595363 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-918dfc1a-55bf-4147-9c20-7183389dbc3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:44.596935 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1408/2767] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:31:44 2022] DELETE /identity/v3/projects/071693c97e8f44e5ad07ead404f83884 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:31:47.262215 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b9f80-34d2-4aeb-a1c9-cf58c1f69608 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:47.264466 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f80b9f80-34d2-4aeb-a1c9-cf58c1f69608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:47.284446 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b9f80-34d2-4aeb-a1c9-cf58c1f69608 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:47.346504 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a321a-7b00-4228-b1bc-15f1da6491c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:47.347154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a321a-7b00-4228-b1bc-15f1da6491c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:47.347432 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a321a-7b00-4228-b1bc-15f1da6491c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:47.347706 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a321a-7b00-4228-b1bc-15f1da6491c6 admin admin] PATH_INFO: `/v3/users/e58edc3eb7c54796a8efcc1fd8130397` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:47.348913 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a321a-7b00-4228-b1bc-15f1da6491c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e58edc3eb7c54796a8efcc1fd8130397)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:47.350833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a321a-7b00-4228-b1bc-15f1da6491c6 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:47.376062 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:31:47.545931 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a06a321a-7b00-4228-b1bc-15f1da6491c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e58edc3eb7c54796a8efcc1fd8130397'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:47.546612 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a06a321a-7b00-4228-b1bc-15f1da6491c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e58edc3eb7c54796a8efcc1fd8130397'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:47.559889 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a06a321a-7b00-4228-b1bc-15f1da6491c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e58edc3eb7c54796a8efcc1fd8130397'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:47.567045 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a06a321a-7b00-4228-b1bc-15f1da6491c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e58edc3eb7c54796a8efcc1fd8130397'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:47.680244 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a06a321a-7b00-4228-b1bc-15f1da6491c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e58edc3eb7c54796a8efcc1fd8130397'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:47.687081 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1360/2768] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:31:47 2022] DELETE /identity/v3/users/e58edc3eb7c54796a8efcc1fd8130397 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:31:47.691868 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f894b-37fa-4a64-a0da-6c77cc175adf None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:47.692401 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f894b-37fa-4a64-a0da-6c77cc175adf None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:47.692500 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f894b-37fa-4a64-a0da-6c77cc175adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:47.713105 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-088f894b-37fa-4a64-a0da-6c77cc175adf None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:31:47.714344 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-088f894b-37fa-4a64-a0da-6c77cc175adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:47.777138 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1409/2769] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:31:47.787371 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a321a-7b00-4228-b1bc-15f1da6491c6 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:47.788949 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a06a321a-7b00-4228-b1bc-15f1da6491c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:47.851911 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a321a-7b00-4228-b1bc-15f1da6491c6 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:47.855591 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e4b50-e602-411d-b3e2-1817394e93f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:47.856214 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e4b50-e602-411d-b3e2-1817394e93f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:47.856495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e4b50-e602-411d-b3e2-1817394e93f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:47.856796 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e4b50-e602-411d-b3e2-1817394e93f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:47.866812 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e4b50-e602-411d-b3e2-1817394e93f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:47.868415 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e4b50-e602-411d-b3e2-1817394e93f8 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:47.878498 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1361/2770] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:31:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:31:48.390349 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f894b-37fa-4a64-a0da-6c77cc175adf None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:31:48.391790 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-088f894b-37fa-4a64-a0da-6c77cc175adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:48.407072 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f894b-37fa-4a64-a0da-6c77cc175adf None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:31:48.409407 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb90908-c8ed-43c3-b3d9-41e5cd39863c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:31:48.410069 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb90908-c8ed-43c3-b3d9-41e5cd39863c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:48.410352 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb90908-c8ed-43c3-b3d9-41e5cd39863c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:48.410625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb90908-c8ed-43c3-b3d9-41e5cd39863c admin admin] PATH_INFO: `/v3/projects/e142b010eea24035ae4f5211c8418d48` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:48.411844 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb90908-c8ed-43c3-b3d9-41e5cd39863c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e142b010eea24035ae4f5211c8418d48)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:31:48.413864 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb90908-c8ed-43c3-b3d9-41e5cd39863c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:31:48.428217 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:31:48.559041 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2bb90908-c8ed-43c3-b3d9-41e5cd39863c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e142b010eea24035ae4f5211c8418d48', 'request_id': 'req-2bb90908-c8ed-43c3-b3d9-41e5cd39863c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:48.566119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2bb90908-c8ed-43c3-b3d9-41e5cd39863c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e142b010eea24035ae4f5211c8418d48', 'request_id': 'req-2bb90908-c8ed-43c3-b3d9-41e5cd39863c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:48.571803 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2bb90908-c8ed-43c3-b3d9-41e5cd39863c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e142b010eea24035ae4f5211c8418d48', 'request_id': 'req-2bb90908-c8ed-43c3-b3d9-41e5cd39863c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:48.649620 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2bb90908-c8ed-43c3-b3d9-41e5cd39863c admin admin] The token cache is being invalidate because project e142b010eea24035ae4f5211c8418d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:31:48.649966 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2bb90908-c8ed-43c3-b3d9-41e5cd39863c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:48.650613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2bb90908-c8ed-43c3-b3d9-41e5cd39863c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:31:48.652168 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1410/2771] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:31:48 2022] DELETE /identity/v3/projects/e142b010eea24035ae4f5211c8418d48 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:31:57.874017 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=46,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:31:58.367821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997cc1b-1a26-462e-848a-042c1a13d569 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:31:58.368312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997cc1b-1a26-462e-848a-042c1a13d569 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:31:58.368764 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997cc1b-1a26-462e-848a-042c1a13d569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:31:58.388172 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-9997cc1b-1a26-462e-848a-042c1a13d569 None None] MFA Rules not processed for user `8c83c9a2d38e460fb838ffc9f50fea8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:31:58.389453 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9997cc1b-1a26-462e-848a-042c1a13d569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:31:58.446916 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1362/2772] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:31:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:31:58.731529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:32:08.440111 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=25 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:07.564392 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb90908-c8ed-43c3-b3d9-41e5cd39863c admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:07.565996 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2bb90908-c8ed-43c3-b3d9-41e5cd39863c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:07.635056 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb90908-c8ed-43c3-b3d9-41e5cd39863c admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:07.639769 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee686d2-5d33-4f9f-886e-d0c40759e526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:07.640405 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee686d2-5d33-4f9f-886e-d0c40759e526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:07.640712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee686d2-5d33-4f9f-886e-d0c40759e526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:07.640987 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee686d2-5d33-4f9f-886e-d0c40759e526 admin admin] PATH_INFO: `/v3/users/8c83c9a2d38e460fb838ffc9f50fea8b` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:07.642218 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee686d2-5d33-4f9f-886e-d0c40759e526 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c83c9a2d38e460fb838ffc9f50fea8b)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:07.644127 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee686d2-5d33-4f9f-886e-d0c40759e526 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:07.866185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8ee686d2-5d33-4f9f-886e-d0c40759e526 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c83c9a2d38e460fb838ffc9f50fea8b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:07.866767 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8ee686d2-5d33-4f9f-886e-d0c40759e526 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c83c9a2d38e460fb838ffc9f50fea8b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:07.941234 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8ee686d2-5d33-4f9f-886e-d0c40759e526 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c83c9a2d38e460fb838ffc9f50fea8b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:07.955040 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8ee686d2-5d33-4f9f-886e-d0c40759e526 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c83c9a2d38e460fb838ffc9f50fea8b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:07.955774 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8ee686d2-5d33-4f9f-886e-d0c40759e526 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c83c9a2d38e460fb838ffc9f50fea8b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:07.969827 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1411/2773] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:33:07 2022] DELETE /identity/v3/users/8c83c9a2d38e460fb838ffc9f50fea8b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:08.240386 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997cc1b-1a26-462e-848a-042c1a13d569 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:08.252167 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997cc1b-1a26-462e-848a-042c1a13d569 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:08.313034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327542e1-6ff2-4876-9412-7ad5fb894cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:08.313831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327542e1-6ff2-4876-9412-7ad5fb894cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:08.314116 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327542e1-6ff2-4876-9412-7ad5fb894cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:08.314396 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327542e1-6ff2-4876-9412-7ad5fb894cf4 admin admin] PATH_INFO: `/v3/projects/63f595fcb1144892a5a741e5d7367b7e` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:08.315580 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327542e1-6ff2-4876-9412-7ad5fb894cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f595fcb1144892a5a741e5d7367b7e)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:08.317601 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327542e1-6ff2-4876-9412-7ad5fb894cf4 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:08.410926 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-327542e1-6ff2-4876-9412-7ad5fb894cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f595fcb1144892a5a741e5d7367b7e', 'request_id': 'req-327542e1-6ff2-4876-9412-7ad5fb894cf4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:08.417710 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-327542e1-6ff2-4876-9412-7ad5fb894cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f595fcb1144892a5a741e5d7367b7e', 'request_id': 'req-327542e1-6ff2-4876-9412-7ad5fb894cf4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:08.423642 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-327542e1-6ff2-4876-9412-7ad5fb894cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f595fcb1144892a5a741e5d7367b7e', 'request_id': 'req-327542e1-6ff2-4876-9412-7ad5fb894cf4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:08.478428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-327542e1-6ff2-4876-9412-7ad5fb894cf4 admin admin] The token cache is being invalidate because project 63f595fcb1144892a5a741e5d7367b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:33:08.478717 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-327542e1-6ff2-4876-9412-7ad5fb894cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:08.479341 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-327542e1-6ff2-4876-9412-7ad5fb894cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:08.480976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1363/2774] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:33:08 2022] DELETE /identity/v3/projects/63f595fcb1144892a5a741e5d7367b7e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:08.486396 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d6056-30c5-4de5-b834-1338cdeadafa None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:08.486935 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d6056-30c5-4de5-b834-1338cdeadafa None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:08.487270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d6056-30c5-4de5-b834-1338cdeadafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:08.508483 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-1e9d6056-30c5-4de5-b834-1338cdeadafa None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:08.509793 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1e9d6056-30c5-4de5-b834-1338cdeadafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:08.570338 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1412/2775] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:08.578232 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb309f-dc9c-4a58-86b7-50c549af5ba4 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:08.578519 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb309f-dc9c-4a58-86b7-50c549af5ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:08.578794 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb309f-dc9c-4a58-86b7-50c549af5ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:08.598761 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-6bcb309f-dc9c-4a58-86b7-50c549af5ba4 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:08.599983 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6bcb309f-dc9c-4a58-86b7-50c549af5ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:08.608945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1364/2776] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:08.613150 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d6056-30c5-4de5-b834-1338cdeadafa None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:08.623684 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d6056-30c5-4de5-b834-1338cdeadafa None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:08.628497 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81556d6a-782f-416b-95c3-4498036f056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:08.629153 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81556d6a-782f-416b-95c3-4498036f056c admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:08.629433 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81556d6a-782f-416b-95c3-4498036f056c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:08.629708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81556d6a-782f-416b-95c3-4498036f056c admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:08.630419 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81556d6a-782f-416b-95c3-4498036f056c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:33:08.630706 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81556d6a-782f-416b-95c3-4498036f056c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:08.632331 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81556d6a-782f-416b-95c3-4498036f056c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:08.644683 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1413/2777] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:33:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:33:08.649459 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb309f-dc9c-4a58-86b7-50c549af5ba4 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:08.659350 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb309f-dc9c-4a58-86b7-50c549af5ba4 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:08.664229 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3362fec-94b8-44f7-aaf7-e01a641bbbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:08.664821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3362fec-94b8-44f7-aaf7-e01a641bbbe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:08.665670 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3362fec-94b8-44f7-aaf7-e01a641bbbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:08.665946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3362fec-94b8-44f7-aaf7-e01a641bbbe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:08.666608 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3362fec-94b8-44f7-aaf7-e01a641bbbe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:08.668516 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3362fec-94b8-44f7-aaf7-e01a641bbbe0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:08.764636 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1365/2778] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:33:08 2022] POST /identity/v3/projects => generated 368 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:33:08.768824 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81556d6a-782f-416b-95c3-4498036f056c admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:08.779372 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81556d6a-782f-416b-95c3-4498036f056c admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:08.783296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:08.858254 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2928a5-e2d3-48ee-8806-a4f5f2faad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:08.858881 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2928a5-e2d3-48ee-8806-a4f5f2faad7d admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:08.859161 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2928a5-e2d3-48ee-8806-a4f5f2faad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:08.859434 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2928a5-e2d3-48ee-8806-a4f5f2faad7d admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:08.860111 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2928a5-e2d3-48ee-8806-a4f5f2faad7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:08.862100 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2928a5-e2d3-48ee-8806-a4f5f2faad7d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:08.986258 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1414/2779] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:33:08 2022] POST /identity/v3/users => generated 285 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:33:08.990970 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3362fec-94b8-44f7-aaf7-e01a641bbbe0 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:09.001391 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3362fec-94b8-44f7-aaf7-e01a641bbbe0 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:09.005969 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a94789-0fb9-4281-979a-e300a15d9750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:09.006583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a94789-0fb9-4281-979a-e300a15d9750 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:09.012312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a94789-0fb9-4281-979a-e300a15d9750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:09.012312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a94789-0fb9-4281-979a-e300a15d9750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:09.012312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a94789-0fb9-4281-979a-e300a15d9750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:09.012312 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a94789-0fb9-4281-979a-e300a15d9750 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:09.019821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1366/2780] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:33:08 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:33:09.024001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2928a5-e2d3-48ee-8806-a4f5f2faad7d admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:09.035181 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2928a5-e2d3-48ee-8806-a4f5f2faad7d admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:09.043271 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f943f-fe7d-4532-a40c-864abd0237b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:09.043913 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f943f-fe7d-4532-a40c-864abd0237b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:09.044190 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f943f-fe7d-4532-a40c-864abd0237b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:09.044464 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f943f-fe7d-4532-a40c-864abd0237b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:09.045192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f943f-fe7d-4532-a40c-864abd0237b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:09.047046 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f943f-fe7d-4532-a40c-864abd0237b6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:09.058273 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1415/2781] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:33:09 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:33:09.062478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a94789-0fb9-4281-979a-e300a15d9750 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:09.072750 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a94789-0fb9-4281-979a-e300a15d9750 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:09.077372 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507fc42-3cfb-4080-b853-36d16dd6fb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:09.078037 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507fc42-3cfb-4080-b853-36d16dd6fb59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:09.078325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507fc42-3cfb-4080-b853-36d16dd6fb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:09.078597 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507fc42-3cfb-4080-b853-36d16dd6fb59 admin admin] PATH_INFO: `/v3/projects/b78303f4d3684b59a429a0084dc5ea6a/users/4ef1b10c4ab64775a07f8d6c92b3a83e/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:09.094812 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507fc42-3cfb-4080-b853-36d16dd6fb59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78303f4d3684b59a429a0084dc5ea6a, user_id=4ef1b10c4ab64775a07f8d6c92b3a83e, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:09.097554 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507fc42-3cfb-4080-b853-36d16dd6fb59 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:09.199187 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1367/2782] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:33:09 2022] PUT /identity/v3/projects/b78303f4d3684b59a429a0084dc5ea6a/users/4ef1b10c4ab64775a07f8d6c92b3a83e/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:09.210390 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2a77c-2379-44ee-b713-7c8e6fbe6167 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:09.210671 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2a77c-2379-44ee-b713-7c8e6fbe6167 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:09.210953 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2a77c-2379-44ee-b713-7c8e6fbe6167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:09.243377 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a7e2a77c-2379-44ee-b713-7c8e6fbe6167 None None] MFA Rules not processed for user `4ef1b10c4ab64775a07f8d6c92b3a83e`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:09.244597 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a7e2a77c-2379-44ee-b713-7c8e6fbe6167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:09.308495 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1416/2783] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:09.313027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507fc42-3cfb-4080-b853-36d16dd6fb59 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:09.332603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:09.375269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507fc42-3cfb-4080-b853-36d16dd6fb59 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:09.379990 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf624a2-da3f-474c-97a3-1570888043b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:09.380598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf624a2-da3f-474c-97a3-1570888043b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:09.380904 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf624a2-da3f-474c-97a3-1570888043b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:09.381177 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf624a2-da3f-474c-97a3-1570888043b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:09.381829 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf624a2-da3f-474c-97a3-1570888043b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:09.384269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf624a2-da3f-474c-97a3-1570888043b8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:09.536210 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1368/2784] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:33:09 2022] POST /identity/v3/projects => generated 368 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:33:09.540730 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2a77c-2379-44ee-b713-7c8e6fbe6167 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:09.551966 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2a77c-2379-44ee-b713-7c8e6fbe6167 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:09.610019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500bcd1-8dff-42ec-92b2-fe090f0b765b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:09.611538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500bcd1-8dff-42ec-92b2-fe090f0b765b admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:09.611538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500bcd1-8dff-42ec-92b2-fe090f0b765b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:09.611538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500bcd1-8dff-42ec-92b2-fe090f0b765b admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:09.611876 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500bcd1-8dff-42ec-92b2-fe090f0b765b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:09.613798 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500bcd1-8dff-42ec-92b2-fe090f0b765b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:09.729034 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1417/2785] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:33:09 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:33:09.733376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf624a2-da3f-474c-97a3-1570888043b8 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:09.744717 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf624a2-da3f-474c-97a3-1570888043b8 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:09.749642 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfd832-a32b-471c-9b15-c3694623eeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:09.750269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfd832-a32b-471c-9b15-c3694623eeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:09.750552 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfd832-a32b-471c-9b15-c3694623eeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:09.750831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfd832-a32b-471c-9b15-c3694623eeb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:09.751697 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfd832-a32b-471c-9b15-c3694623eeb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:09.753362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfd832-a32b-471c-9b15-c3694623eeb0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:09.764818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1369/2786] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:33:09 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:33:09.769344 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500bcd1-8dff-42ec-92b2-fe090f0b765b admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:09.776478 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:09.780639 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500bcd1-8dff-42ec-92b2-fe090f0b765b admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:09.785951 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9b476-d003-43a2-81df-26061c5f2c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:09.789564 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9b476-d003-43a2-81df-26061c5f2c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:09.789564 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9b476-d003-43a2-81df-26061c5f2c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:09.789564 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9b476-d003-43a2-81df-26061c5f2c48 admin admin] PATH_INFO: `/v3/projects/34a0c7075e6a439a8d0d9aa34320d8cf/users/663522396420483e9e99d94894ea289f/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:09.804019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9b476-d003-43a2-81df-26061c5f2c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a0c7075e6a439a8d0d9aa34320d8cf, user_id=663522396420483e9e99d94894ea289f, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:09.806835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9b476-d003-43a2-81df-26061c5f2c48 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:09.895482 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1418/2787] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:33:09 2022] PUT /identity/v3/projects/34a0c7075e6a439a8d0d9aa34320d8cf/users/663522396420483e9e99d94894ea289f/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:09.900249 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfd832-a32b-471c-9b15-c3694623eeb0 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:09.911855 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfd832-a32b-471c-9b15-c3694623eeb0 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:09.978442 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76289c9-ec94-4cbc-9431-380c084b3439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:09.979095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76289c9-ec94-4cbc-9431-380c084b3439 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:09.979374 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76289c9-ec94-4cbc-9431-380c084b3439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:09.979651 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76289c9-ec94-4cbc-9431-380c084b3439 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:09.980346 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76289c9-ec94-4cbc-9431-380c084b3439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:09.982101 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76289c9-ec94-4cbc-9431-380c084b3439 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:09.993417 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1370/2788] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:33:09 2022] GET /identity/v3/roles => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:33:09.997870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9b476-d003-43a2-81df-26061c5f2c48 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:10.009266 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9b476-d003-43a2-81df-26061c5f2c48 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:10.014095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1a46c-946c-4a5f-80bd-bbeb1c6aabc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:10.014769 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1a46c-946c-4a5f-80bd-bbeb1c6aabc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:10.015054 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1a46c-946c-4a5f-80bd-bbeb1c6aabc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:10.015338 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1a46c-946c-4a5f-80bd-bbeb1c6aabc1 admin admin] PATH_INFO: `/v3/projects/34a0c7075e6a439a8d0d9aa34320d8cf/users/663522396420483e9e99d94894ea289f/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:10.017551 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1a46c-946c-4a5f-80bd-bbeb1c6aabc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a0c7075e6a439a8d0d9aa34320d8cf, user_id=663522396420483e9e99d94894ea289f, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:10.020207 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1a46c-946c-4a5f-80bd-bbeb1c6aabc1 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:10.032312 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1419/2789] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:33:09 2022] PUT /identity/v3/projects/34a0c7075e6a439a8d0d9aa34320d8cf/users/663522396420483e9e99d94894ea289f/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:10.043020 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fff803-313c-4ae9-9eb2-c42953d1c65e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:10.043226 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fff803-313c-4ae9-9eb2-c42953d1c65e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:10.043504 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fff803-313c-4ae9-9eb2-c42953d1c65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:10.072717 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-77fff803-313c-4ae9-9eb2-c42953d1c65e None None] MFA Rules not processed for user `663522396420483e9e99d94894ea289f`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:10.073946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-77fff803-313c-4ae9-9eb2-c42953d1c65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:10.144654 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1371/2790] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:10.156508 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1a46c-946c-4a5f-80bd-bbeb1c6aabc1 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:10.158259 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1bb1a46c-946c-4a5f-80bd-bbeb1c6aabc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:10.242712 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1a46c-946c-4a5f-80bd-bbeb1c6aabc1 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:10.246454 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f9920-a1eb-4f3e-b4f1-4f98ee85aec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:10.247068 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f9920-a1eb-4f3e-b4f1-4f98ee85aec3 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:10.247362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f9920-a1eb-4f3e-b4f1-4f98ee85aec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:10.247613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f9920-a1eb-4f3e-b4f1-4f98ee85aec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:10.257687 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f9920-a1eb-4f3e-b4f1-4f98ee85aec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:10.259732 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f9920-a1eb-4f3e-b4f1-4f98ee85aec3 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:10.270154 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1420/2791] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:33:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:33:13.210666 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fff803-313c-4ae9-9eb2-c42953d1c65e None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:13.225813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:13.280544 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fff803-313c-4ae9-9eb2-c42953d1c65e None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:13.285334 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece2d51-0756-47f2-9ed4-f73e7e1bf3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:13.285998 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece2d51-0756-47f2-9ed4-f73e7e1bf3df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:13.286282 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece2d51-0756-47f2-9ed4-f73e7e1bf3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:13.286561 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece2d51-0756-47f2-9ed4-f73e7e1bf3df admin admin] PATH_INFO: `/v3/users/4ef1b10c4ab64775a07f8d6c92b3a83e` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:13.287763 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece2d51-0756-47f2-9ed4-f73e7e1bf3df admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ef1b10c4ab64775a07f8d6c92b3a83e)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:13.290071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece2d51-0756-47f2-9ed4-f73e7e1bf3df admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:13.492553 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-dece2d51-0756-47f2-9ed4-f73e7e1bf3df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ef1b10c4ab64775a07f8d6c92b3a83e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:13.493750 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-dece2d51-0756-47f2-9ed4-f73e7e1bf3df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ef1b10c4ab64775a07f8d6c92b3a83e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:13.506461 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-dece2d51-0756-47f2-9ed4-f73e7e1bf3df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ef1b10c4ab64775a07f8d6c92b3a83e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:13.514555 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-dece2d51-0756-47f2-9ed4-f73e7e1bf3df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ef1b10c4ab64775a07f8d6c92b3a83e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:13.592319 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-dece2d51-0756-47f2-9ed4-f73e7e1bf3df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ef1b10c4ab64775a07f8d6c92b3a83e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:13.598863 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1372/2792] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:33:13 2022] DELETE /identity/v3/users/4ef1b10c4ab64775a07f8d6c92b3a83e => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:13.606931 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cd91e-d6bf-46a6-86b6-ec62dcbb4682 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:13.607464 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cd91e-d6bf-46a6-86b6-ec62dcbb4682 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:13.607464 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cd91e-d6bf-46a6-86b6-ec62dcbb4682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:13.626856 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2a0cd91e-d6bf-46a6-86b6-ec62dcbb4682 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:13.628044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2a0cd91e-d6bf-46a6-86b6-ec62dcbb4682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:13.698118 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1421/2793] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:13.709160 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece2d51-0756-47f2-9ed4-f73e7e1bf3df admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:13.710649 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-dece2d51-0756-47f2-9ed4-f73e7e1bf3df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:13.784532 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece2d51-0756-47f2-9ed4-f73e7e1bf3df admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:13.788117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49dcf5-e5ec-4b9c-b376-22f502f527f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:13.788776 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49dcf5-e5ec-4b9c-b376-22f502f527f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:13.789061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49dcf5-e5ec-4b9c-b376-22f502f527f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:13.789333 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49dcf5-e5ec-4b9c-b376-22f502f527f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:13.799837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49dcf5-e5ec-4b9c-b376-22f502f527f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:13.801319 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49dcf5-e5ec-4b9c-b376-22f502f527f6 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:13.811880 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1373/2794] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:33:14.205988 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cd91e-d6bf-46a6-86b6-ec62dcbb4682 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:14.207544 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2a0cd91e-d6bf-46a6-86b6-ec62dcbb4682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:14.221146 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cd91e-d6bf-46a6-86b6-ec62dcbb4682 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:14.226144 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4b351-1286-4848-9f85-81f815398f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:14.226805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4b351-1286-4848-9f85-81f815398f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:14.227090 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4b351-1286-4848-9f85-81f815398f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:14.227987 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4b351-1286-4848-9f85-81f815398f5e admin admin] PATH_INFO: `/v3/projects/b78303f4d3684b59a429a0084dc5ea6a` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:14.229311 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4b351-1286-4848-9f85-81f815398f5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b78303f4d3684b59a429a0084dc5ea6a)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:14.231342 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4b351-1286-4848-9f85-81f815398f5e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:14.331721 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:14.334827 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b1f4b351-1286-4848-9f85-81f815398f5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b78303f4d3684b59a429a0084dc5ea6a', 'request_id': 'req-b1f4b351-1286-4848-9f85-81f815398f5e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:14.341830 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b1f4b351-1286-4848-9f85-81f815398f5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b78303f4d3684b59a429a0084dc5ea6a', 'request_id': 'req-b1f4b351-1286-4848-9f85-81f815398f5e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:14.347867 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b1f4b351-1286-4848-9f85-81f815398f5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b78303f4d3684b59a429a0084dc5ea6a', 'request_id': 'req-b1f4b351-1286-4848-9f85-81f815398f5e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:14.407732 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b1f4b351-1286-4848-9f85-81f815398f5e admin admin] The token cache is being invalidate because project b78303f4d3684b59a429a0084dc5ea6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:33:14.408026 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b1f4b351-1286-4848-9f85-81f815398f5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:14.408743 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b1f4b351-1286-4848-9f85-81f815398f5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:14.410411 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1422/2795] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:33:14 2022] DELETE /identity/v3/projects/b78303f4d3684b59a429a0084dc5ea6a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:14.415541 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49dcf5-e5ec-4b9c-b376-22f502f527f6 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:14.427143 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49dcf5-e5ec-4b9c-b376-22f502f527f6 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:14.462849 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:14.490814 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadcb26f-dbe3-4ce6-9ec1-2f6b4fc7fda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:14.491463 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcb26f-dbe3-4ce6-9ec1-2f6b4fc7fda1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:14.491752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcb26f-dbe3-4ce6-9ec1-2f6b4fc7fda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:14.492029 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcb26f-dbe3-4ce6-9ec1-2f6b4fc7fda1 admin admin] PATH_INFO: `/v3/users/663522396420483e9e99d94894ea289f` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:14.493271 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcb26f-dbe3-4ce6-9ec1-2f6b4fc7fda1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=663522396420483e9e99d94894ea289f)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:14.495242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcb26f-dbe3-4ce6-9ec1-2f6b4fc7fda1 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:14.691771 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-aadcb26f-dbe3-4ce6-9ec1-2f6b4fc7fda1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '663522396420483e9e99d94894ea289f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:14.692470 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-aadcb26f-dbe3-4ce6-9ec1-2f6b4fc7fda1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '663522396420483e9e99d94894ea289f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:14.705254 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-aadcb26f-dbe3-4ce6-9ec1-2f6b4fc7fda1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '663522396420483e9e99d94894ea289f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:14.716037 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-aadcb26f-dbe3-4ce6-9ec1-2f6b4fc7fda1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '663522396420483e9e99d94894ea289f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:14.798087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-aadcb26f-dbe3-4ce6-9ec1-2f6b4fc7fda1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '663522396420483e9e99d94894ea289f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:14.805248 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1374/2796] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:33:14 2022] DELETE /identity/v3/users/663522396420483e9e99d94894ea289f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:15.291631 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4b351-1286-4848-9f85-81f815398f5e admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:15.293307 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b1f4b351-1286-4848-9f85-81f815398f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:15.311258 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4b351-1286-4848-9f85-81f815398f5e admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:15.383144 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4afe56-90ed-4bb5-bcc3-8effede9666f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:15.384320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4afe56-90ed-4bb5-bcc3-8effede9666f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:15.384616 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4afe56-90ed-4bb5-bcc3-8effede9666f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:15.384996 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4afe56-90ed-4bb5-bcc3-8effede9666f admin admin] PATH_INFO: `/v3/projects/34a0c7075e6a439a8d0d9aa34320d8cf` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:15.386223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4afe56-90ed-4bb5-bcc3-8effede9666f admin admin] RBAC: Authorizing `identity:delete_project(project_id=34a0c7075e6a439a8d0d9aa34320d8cf)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:15.388162 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4afe56-90ed-4bb5-bcc3-8effede9666f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:15.507948 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ff4afe56-90ed-4bb5-bcc3-8effede9666f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34a0c7075e6a439a8d0d9aa34320d8cf', 'request_id': 'req-ff4afe56-90ed-4bb5-bcc3-8effede9666f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:15.515011 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ff4afe56-90ed-4bb5-bcc3-8effede9666f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34a0c7075e6a439a8d0d9aa34320d8cf', 'request_id': 'req-ff4afe56-90ed-4bb5-bcc3-8effede9666f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:15.521849 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ff4afe56-90ed-4bb5-bcc3-8effede9666f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34a0c7075e6a439a8d0d9aa34320d8cf', 'request_id': 'req-ff4afe56-90ed-4bb5-bcc3-8effede9666f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:15.597985 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ff4afe56-90ed-4bb5-bcc3-8effede9666f admin admin] The token cache is being invalidate because project 34a0c7075e6a439a8d0d9aa34320d8cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:33:15.598233 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ff4afe56-90ed-4bb5-bcc3-8effede9666f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:15.598800 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ff4afe56-90ed-4bb5-bcc3-8effede9666f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:15.600538 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1423/2797] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:33:15 2022] DELETE /identity/v3/projects/34a0c7075e6a439a8d0d9aa34320d8cf => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:15.606214 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285cce0-e288-496c-8fdf-4ae7b71b8a36 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:15.606695 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285cce0-e288-496c-8fdf-4ae7b71b8a36 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:15.606877 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285cce0-e288-496c-8fdf-4ae7b71b8a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:15.628111 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c285cce0-e288-496c-8fdf-4ae7b71b8a36 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:15.629370 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c285cce0-e288-496c-8fdf-4ae7b71b8a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:15.695480 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1375/2798] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:15.704310 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f510ca-8c6c-4f2d-848f-e37b233775ee None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:15.704589 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f510ca-8c6c-4f2d-848f-e37b233775ee None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:15.705299 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f510ca-8c6c-4f2d-848f-e37b233775ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:15.725695 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-b4f510ca-8c6c-4f2d-848f-e37b233775ee None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:15.726908 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b4f510ca-8c6c-4f2d-848f-e37b233775ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:15.735341 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1424/2799] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:15.739767 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285cce0-e288-496c-8fdf-4ae7b71b8a36 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:15.750200 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285cce0-e288-496c-8fdf-4ae7b71b8a36 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:15.754938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ead34-9df8-438b-a4ec-275fa030d8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:15.755596 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ead34-9df8-438b-a4ec-275fa030d8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:15.755872 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ead34-9df8-438b-a4ec-275fa030d8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:15.756149 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ead34-9df8-438b-a4ec-275fa030d8d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:15.756882 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ead34-9df8-438b-a4ec-275fa030d8d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:33:15.757188 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ead34-9df8-438b-a4ec-275fa030d8d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:15.759470 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ead34-9df8-438b-a4ec-275fa030d8d4 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:15.771682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1376/2800] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:33:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:33:15.776173 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f510ca-8c6c-4f2d-848f-e37b233775ee None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:15.785601 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f510ca-8c6c-4f2d-848f-e37b233775ee None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:15.790506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cf8f5-241e-4655-af91-c03f45c0db23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:15.791118 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cf8f5-241e-4655-af91-c03f45c0db23 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:15.791413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cf8f5-241e-4655-af91-c03f45c0db23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:15.791683 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cf8f5-241e-4655-af91-c03f45c0db23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:15.792342 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7cf8f5-241e-4655-af91-c03f45c0db23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:15.794272 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7cf8f5-241e-4655-af91-c03f45c0db23 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:15.886452 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1425/2801] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:33:15 2022] POST /identity/v3/projects => generated 390 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:33:15.890940 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ead34-9df8-438b-a4ec-275fa030d8d4 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:15.901301 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ead34-9df8-438b-a4ec-275fa030d8d4 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:15.944086 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:15.960998 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be6894-fe52-413d-be4b-843e299b7d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:15.961669 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be6894-fe52-413d-be4b-843e299b7d9d admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:15.961957 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be6894-fe52-413d-be4b-843e299b7d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:15.962348 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be6894-fe52-413d-be4b-843e299b7d9d admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:15.963029 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be6894-fe52-413d-be4b-843e299b7d9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:15.964996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be6894-fe52-413d-be4b-843e299b7d9d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:16.090365 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1377/2802] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:33:15 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:33:16.094754 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cf8f5-241e-4655-af91-c03f45c0db23 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:16.105664 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cf8f5-241e-4655-af91-c03f45c0db23 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:16.110207 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828d73b-fe40-46c8-afe3-aa5583ed057a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:16.110809 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828d73b-fe40-46c8-afe3-aa5583ed057a admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:16.111086 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828d73b-fe40-46c8-afe3-aa5583ed057a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:16.111373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828d73b-fe40-46c8-afe3-aa5583ed057a admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:16.112094 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828d73b-fe40-46c8-afe3-aa5583ed057a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:16.113711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828d73b-fe40-46c8-afe3-aa5583ed057a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:16.124399 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1426/2803] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:33:16 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:33:16.129435 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be6894-fe52-413d-be4b-843e299b7d9d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:16.140011 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be6894-fe52-413d-be4b-843e299b7d9d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:16.145220 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0707814-af8d-49a4-bd0e-6d44e9120162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:16.146056 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0707814-af8d-49a4-bd0e-6d44e9120162 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:16.146399 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0707814-af8d-49a4-bd0e-6d44e9120162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:16.146977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0707814-af8d-49a4-bd0e-6d44e9120162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:16.147666 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0707814-af8d-49a4-bd0e-6d44e9120162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:16.149342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0707814-af8d-49a4-bd0e-6d44e9120162 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:16.160339 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1378/2804] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:33:16 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:33:16.165146 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828d73b-fe40-46c8-afe3-aa5583ed057a admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:16.175649 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828d73b-fe40-46c8-afe3-aa5583ed057a admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:16.180920 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda1b37-2d4e-4f44-a15a-e78fa8935e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:16.181595 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda1b37-2d4e-4f44-a15a-e78fa8935e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:16.181875 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda1b37-2d4e-4f44-a15a-e78fa8935e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:16.182148 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda1b37-2d4e-4f44-a15a-e78fa8935e34 admin admin] PATH_INFO: `/v3/projects/533f2afcdaad4db1b8c8beecb078f217/users/e66d13e4c49d4663a2996e589c4554a4/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:16.203568 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda1b37-2d4e-4f44-a15a-e78fa8935e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=533f2afcdaad4db1b8c8beecb078f217, user_id=e66d13e4c49d4663a2996e589c4554a4, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:16.206359 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda1b37-2d4e-4f44-a15a-e78fa8935e34 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:16.278837 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:16.284837 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1427/2805] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:33:16 2022] PUT /identity/v3/projects/533f2afcdaad4db1b8c8beecb078f217/users/e66d13e4c49d4663a2996e589c4554a4/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:16.353919 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b4f9d-0518-4172-b5ff-fe194285433e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:16.354206 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b4f9d-0518-4172-b5ff-fe194285433e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:16.354490 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b4f9d-0518-4172-b5ff-fe194285433e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:16.386130 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-482b4f9d-0518-4172-b5ff-fe194285433e None None] MFA Rules not processed for user `e66d13e4c49d4663a2996e589c4554a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:16.387363 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-482b4f9d-0518-4172-b5ff-fe194285433e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:16.452635 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1379/2806] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:16.457069 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda1b37-2d4e-4f44-a15a-e78fa8935e34 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:16.520005 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda1b37-2d4e-4f44-a15a-e78fa8935e34 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:16.525223 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb07b0-705f-4341-84f8-cec7c6422b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:16.525857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb07b0-705f-4341-84f8-cec7c6422b70 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:16.526135 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb07b0-705f-4341-84f8-cec7c6422b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:16.526405 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb07b0-705f-4341-84f8-cec7c6422b70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:16.527069 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb07b0-705f-4341-84f8-cec7c6422b70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:16.529076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb07b0-705f-4341-84f8-cec7c6422b70 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:16.674760 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1428/2807] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:33:16 2022] POST /identity/v3/projects => generated 390 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:33:16.678738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b4f9d-0518-4172-b5ff-fe194285433e None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:16.690076 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b4f9d-0518-4172-b5ff-fe194285433e None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:16.753582 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623851c4-3cfe-4bd4-8a99-62e951eeddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:16.754117 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623851c4-3cfe-4bd4-8a99-62e951eeddf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:16.754394 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623851c4-3cfe-4bd4-8a99-62e951eeddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:16.754665 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623851c4-3cfe-4bd4-8a99-62e951eeddf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:16.755322 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623851c4-3cfe-4bd4-8a99-62e951eeddf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:16.757314 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623851c4-3cfe-4bd4-8a99-62e951eeddf4 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:16.850978 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1380/2808] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:33:16 2022] POST /identity/v3/users => generated 302 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:33:16.855454 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb07b0-705f-4341-84f8-cec7c6422b70 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:16.866125 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb07b0-705f-4341-84f8-cec7c6422b70 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:16.870788 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8e11c-81e9-47f3-9921-9c87bb2b439c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:16.871466 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8e11c-81e9-47f3-9921-9c87bb2b439c admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:16.871740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8e11c-81e9-47f3-9921-9c87bb2b439c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:16.872010 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8e11c-81e9-47f3-9921-9c87bb2b439c admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:16.872726 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8e11c-81e9-47f3-9921-9c87bb2b439c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:16.874325 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8e11c-81e9-47f3-9921-9c87bb2b439c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:16.886679 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1429/2809] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:33:16 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:33:16.893477 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623851c4-3cfe-4bd4-8a99-62e951eeddf4 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:16.904901 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623851c4-3cfe-4bd4-8a99-62e951eeddf4 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:16.909732 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6e301-e941-4751-8b05-41bea241888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:16.910406 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6e301-e941-4751-8b05-41bea241888f admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:16.910700 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6e301-e941-4751-8b05-41bea241888f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:16.910974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6e301-e941-4751-8b05-41bea241888f admin admin] PATH_INFO: `/v3/projects/13d2e9b47ff247bd8aa472ba641939f3/users/c7834a8f6cc24c7996fa46c0d2f354a7/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:16.927738 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6e301-e941-4751-8b05-41bea241888f admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d2e9b47ff247bd8aa472ba641939f3, user_id=c7834a8f6cc24c7996fa46c0d2f354a7, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:16.930520 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6e301-e941-4751-8b05-41bea241888f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:17.012308 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1381/2810] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:33:16 2022] PUT /identity/v3/projects/13d2e9b47ff247bd8aa472ba641939f3/users/c7834a8f6cc24c7996fa46c0d2f354a7/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:17.016486 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8e11c-81e9-47f3-9921-9c87bb2b439c admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:17.027756 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8e11c-81e9-47f3-9921-9c87bb2b439c admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:17.091394 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5648ab-6b7f-4c68-beb4-16bde5d88356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:17.092021 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5648ab-6b7f-4c68-beb4-16bde5d88356 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:17.092305 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5648ab-6b7f-4c68-beb4-16bde5d88356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:17.092580 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5648ab-6b7f-4c68-beb4-16bde5d88356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:17.093353 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5648ab-6b7f-4c68-beb4-16bde5d88356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:17.094959 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5648ab-6b7f-4c68-beb4-16bde5d88356 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:17.109768 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1430/2811] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:33:17 2022] GET /identity/v3/roles => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:33:17.114208 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6e301-e941-4751-8b05-41bea241888f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:17.128569 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6e301-e941-4751-8b05-41bea241888f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:17.136851 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de121f4-0174-4555-bd0e-2cc8c1fa2560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:17.137996 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de121f4-0174-4555-bd0e-2cc8c1fa2560 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:17.138502 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de121f4-0174-4555-bd0e-2cc8c1fa2560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:17.138987 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de121f4-0174-4555-bd0e-2cc8c1fa2560 admin admin] PATH_INFO: `/v3/projects/13d2e9b47ff247bd8aa472ba641939f3/users/c7834a8f6cc24c7996fa46c0d2f354a7/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:17.142386 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de121f4-0174-4555-bd0e-2cc8c1fa2560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d2e9b47ff247bd8aa472ba641939f3, user_id=c7834a8f6cc24c7996fa46c0d2f354a7, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:17.147687 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de121f4-0174-4555-bd0e-2cc8c1fa2560 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:17.162578 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1382/2812] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:33:17 2022] PUT /identity/v3/projects/13d2e9b47ff247bd8aa472ba641939f3/users/c7834a8f6cc24c7996fa46c0d2f354a7/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:17.173339 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33059b-7185-4c65-a6b7-6b930b83df2f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:17.173719 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33059b-7185-4c65-a6b7-6b930b83df2f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:17.174056 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33059b-7185-4c65-a6b7-6b930b83df2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:17.204342 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-ba33059b-7185-4c65-a6b7-6b930b83df2f None None] MFA Rules not processed for user `c7834a8f6cc24c7996fa46c0d2f354a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:17.205608 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ba33059b-7185-4c65-a6b7-6b930b83df2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:17.273423 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:17.282862 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1431/2813] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:17 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:33:17.294066 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de121f4-0174-4555-bd0e-2cc8c1fa2560 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:17.296034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4de121f4-0174-4555-bd0e-2cc8c1fa2560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:17.301679 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:17.366821 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de121f4-0174-4555-bd0e-2cc8c1fa2560 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:17.371096 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd7064-b221-494f-8d12-d99267bd818b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:17.371723 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd7064-b221-494f-8d12-d99267bd818b service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:17.372006 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd7064-b221-494f-8d12-d99267bd818b service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:17.372287 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd7064-b221-494f-8d12-d99267bd818b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:17.382041 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd7064-b221-494f-8d12-d99267bd818b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:17.384198 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd7064-b221-494f-8d12-d99267bd818b service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:17.394620 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1383/2814] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:33:17 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:33:17.542291 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33059b-7185-4c65-a6b7-6b930b83df2f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:17.608739 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33059b-7185-4c65-a6b7-6b930b83df2f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:17.613492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d1eeb-f3ec-42a3-acea-a09b0bdea425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:17.614103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d1eeb-f3ec-42a3-acea-a09b0bdea425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:17.614385 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d1eeb-f3ec-42a3-acea-a09b0bdea425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:17.614662 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d1eeb-f3ec-42a3-acea-a09b0bdea425 admin admin] PATH_INFO: `/v3/users/e66d13e4c49d4663a2996e589c4554a4` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:17.615827 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d1eeb-f3ec-42a3-acea-a09b0bdea425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e66d13e4c49d4663a2996e589c4554a4)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:17.618330 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d1eeb-f3ec-42a3-acea-a09b0bdea425 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:17.790540 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-9c2d1eeb-f3ec-42a3-acea-a09b0bdea425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e66d13e4c49d4663a2996e589c4554a4'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:17.791195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-9c2d1eeb-f3ec-42a3-acea-a09b0bdea425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e66d13e4c49d4663a2996e589c4554a4'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:17.855321 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-9c2d1eeb-f3ec-42a3-acea-a09b0bdea425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e66d13e4c49d4663a2996e589c4554a4'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:17.870645 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-9c2d1eeb-f3ec-42a3-acea-a09b0bdea425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e66d13e4c49d4663a2996e589c4554a4'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:17.871488 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-9c2d1eeb-f3ec-42a3-acea-a09b0bdea425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e66d13e4c49d4663a2996e589c4554a4'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:17.885324 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1432/2815] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:33:17 2022] DELETE /identity/v3/users/e66d13e4c49d4663a2996e589c4554a4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:33:17.890042 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f35013-df25-479b-afa0-e92025d1351a None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:17.890570 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f35013-df25-479b-afa0-e92025d1351a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:17.890685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f35013-df25-479b-afa0-e92025d1351a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:17.914249 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-59f35013-df25-479b-afa0-e92025d1351a None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:17.916647 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-59f35013-df25-479b-afa0-e92025d1351a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:18.004067 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1384/2816] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:18.013741 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d1eeb-f3ec-42a3-acea-a09b0bdea425 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:18.015182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9c2d1eeb-f3ec-42a3-acea-a09b0bdea425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:18.081498 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d1eeb-f3ec-42a3-acea-a09b0bdea425 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:18.085160 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd3d3c-252d-4b5b-a4a0-693901048812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:18.085795 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd3d3c-252d-4b5b-a4a0-693901048812 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:18.086078 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd3d3c-252d-4b5b-a4a0-693901048812 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:18.086857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd3d3c-252d-4b5b-a4a0-693901048812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:18.096625 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd3d3c-252d-4b5b-a4a0-693901048812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:18.098097 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd3d3c-252d-4b5b-a4a0-693901048812 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:18.108781 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1433/2817] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:33:18.539525 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f35013-df25-479b-afa0-e92025d1351a None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:18.541240 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-59f35013-df25-479b-afa0-e92025d1351a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:18.556395 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f35013-df25-479b-afa0-e92025d1351a None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:18.561918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa259b3-b37e-4160-bb98-4bb463cc9545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:18.562833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa259b3-b37e-4160-bb98-4bb463cc9545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:18.563443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa259b3-b37e-4160-bb98-4bb463cc9545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:18.563917 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa259b3-b37e-4160-bb98-4bb463cc9545 admin admin] PATH_INFO: `/v3/projects/533f2afcdaad4db1b8c8beecb078f217` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:18.565871 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa259b3-b37e-4160-bb98-4bb463cc9545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=533f2afcdaad4db1b8c8beecb078f217)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:18.569622 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa259b3-b37e-4160-bb98-4bb463cc9545 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:18.692262 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1aa259b3-b37e-4160-bb98-4bb463cc9545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '533f2afcdaad4db1b8c8beecb078f217', 'request_id': 'req-1aa259b3-b37e-4160-bb98-4bb463cc9545'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:18.699489 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1aa259b3-b37e-4160-bb98-4bb463cc9545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '533f2afcdaad4db1b8c8beecb078f217', 'request_id': 'req-1aa259b3-b37e-4160-bb98-4bb463cc9545'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:18.705229 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1aa259b3-b37e-4160-bb98-4bb463cc9545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '533f2afcdaad4db1b8c8beecb078f217', 'request_id': 'req-1aa259b3-b37e-4160-bb98-4bb463cc9545'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:18.775440 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1aa259b3-b37e-4160-bb98-4bb463cc9545 admin admin] The token cache is being invalidate because project 533f2afcdaad4db1b8c8beecb078f217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:33:18.775748 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1aa259b3-b37e-4160-bb98-4bb463cc9545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:18.776408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1aa259b3-b37e-4160-bb98-4bb463cc9545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:18.777952 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1385/2818] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:33:18 2022] DELETE /identity/v3/projects/533f2afcdaad4db1b8c8beecb078f217 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:18.782279 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd3d3c-252d-4b5b-a4a0-693901048812 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:18.792373 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd3d3c-252d-4b5b-a4a0-693901048812 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:18.807517 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:18.854954 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e55f4c-88f8-4e0b-80ae-9b0e39148f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:18.855600 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e55f4c-88f8-4e0b-80ae-9b0e39148f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:18.855887 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e55f4c-88f8-4e0b-80ae-9b0e39148f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:18.856159 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e55f4c-88f8-4e0b-80ae-9b0e39148f46 admin admin] PATH_INFO: `/v3/users/c7834a8f6cc24c7996fa46c0d2f354a7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:18.857383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e55f4c-88f8-4e0b-80ae-9b0e39148f46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7834a8f6cc24c7996fa46c0d2f354a7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:18.859316 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e55f4c-88f8-4e0b-80ae-9b0e39148f46 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:19.116431 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-81e55f4c-88f8-4e0b-80ae-9b0e39148f46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7834a8f6cc24c7996fa46c0d2f354a7'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:19.117167 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-81e55f4c-88f8-4e0b-80ae-9b0e39148f46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7834a8f6cc24c7996fa46c0d2f354a7'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:19.209541 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-81e55f4c-88f8-4e0b-80ae-9b0e39148f46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7834a8f6cc24c7996fa46c0d2f354a7'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:19.223243 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-81e55f4c-88f8-4e0b-80ae-9b0e39148f46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7834a8f6cc24c7996fa46c0d2f354a7'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:19.224004 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-81e55f4c-88f8-4e0b-80ae-9b0e39148f46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7834a8f6cc24c7996fa46c0d2f354a7'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:19.240314 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1434/2819] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:33:18 2022] DELETE /identity/v3/users/c7834a8f6cc24c7996fa46c0d2f354a7 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:19.686776 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa259b3-b37e-4160-bb98-4bb463cc9545 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:19.688355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1aa259b3-b37e-4160-bb98-4bb463cc9545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:19.702654 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa259b3-b37e-4160-bb98-4bb463cc9545 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:19.734494 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:19.765951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca3b02-fc1e-47c0-8e9c-1fd648ca94f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:19.766631 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca3b02-fc1e-47c0-8e9c-1fd648ca94f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:19.767107 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca3b02-fc1e-47c0-8e9c-1fd648ca94f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:19.767575 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca3b02-fc1e-47c0-8e9c-1fd648ca94f7 admin admin] PATH_INFO: `/v3/projects/13d2e9b47ff247bd8aa472ba641939f3` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:19.771057 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca3b02-fc1e-47c0-8e9c-1fd648ca94f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d2e9b47ff247bd8aa472ba641939f3)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:19.773109 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca3b02-fc1e-47c0-8e9c-1fd648ca94f7 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:19.989998 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-32ca3b02-fc1e-47c0-8e9c-1fd648ca94f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d2e9b47ff247bd8aa472ba641939f3', 'request_id': 'req-32ca3b02-fc1e-47c0-8e9c-1fd648ca94f7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:19.996588 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-32ca3b02-fc1e-47c0-8e9c-1fd648ca94f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d2e9b47ff247bd8aa472ba641939f3', 'request_id': 'req-32ca3b02-fc1e-47c0-8e9c-1fd648ca94f7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:20.002414 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-32ca3b02-fc1e-47c0-8e9c-1fd648ca94f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d2e9b47ff247bd8aa472ba641939f3', 'request_id': 'req-32ca3b02-fc1e-47c0-8e9c-1fd648ca94f7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:20.066768 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-32ca3b02-fc1e-47c0-8e9c-1fd648ca94f7 admin admin] The token cache is being invalidate because project 13d2e9b47ff247bd8aa472ba641939f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:33:20.067059 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-32ca3b02-fc1e-47c0-8e9c-1fd648ca94f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:20.067732 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-32ca3b02-fc1e-47c0-8e9c-1fd648ca94f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:20.072936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1386/2820] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:33:19 2022] DELETE /identity/v3/projects/13d2e9b47ff247bd8aa472ba641939f3 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:20.075070 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107ea35-7553-42ec-9a5d-f4119c0570b3 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:20.075544 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107ea35-7553-42ec-9a5d-f4119c0570b3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:20.075638 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107ea35-7553-42ec-9a5d-f4119c0570b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:20.097369 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5107ea35-7553-42ec-9a5d-f4119c0570b3 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:20.098617 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5107ea35-7553-42ec-9a5d-f4119c0570b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:20.161536 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1435/2821] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:20.169555 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c8f13-171d-413b-b0cf-38ba1b39987b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:20.169928 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c8f13-171d-413b-b0cf-38ba1b39987b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:20.170275 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c8f13-171d-413b-b0cf-38ba1b39987b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:20.198228 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-da5c8f13-171d-413b-b0cf-38ba1b39987b None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:20.199972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-da5c8f13-171d-413b-b0cf-38ba1b39987b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:20.211238 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1387/2822] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:20.215665 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107ea35-7553-42ec-9a5d-f4119c0570b3 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:20.226945 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107ea35-7553-42ec-9a5d-f4119c0570b3 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:20.238044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83179ae8-1853-41f2-90fe-55cc955dead6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:20.238044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83179ae8-1853-41f2-90fe-55cc955dead6 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:20.238044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83179ae8-1853-41f2-90fe-55cc955dead6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:20.238044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83179ae8-1853-41f2-90fe-55cc955dead6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:20.238563 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83179ae8-1853-41f2-90fe-55cc955dead6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:33:20.238563 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83179ae8-1853-41f2-90fe-55cc955dead6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:20.238563 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83179ae8-1853-41f2-90fe-55cc955dead6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:20.249277 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1436/2823] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:33:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:33:20.253844 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c8f13-171d-413b-b0cf-38ba1b39987b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:20.264732 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c8f13-171d-413b-b0cf-38ba1b39987b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:20.271972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e414c-e7cc-4523-a72c-4fc5911a2759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:20.271972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e414c-e7cc-4523-a72c-4fc5911a2759 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:20.271972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e414c-e7cc-4523-a72c-4fc5911a2759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:20.271972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e414c-e7cc-4523-a72c-4fc5911a2759 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:20.272398 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e414c-e7cc-4523-a72c-4fc5911a2759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:20.273403 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e414c-e7cc-4523-a72c-4fc5911a2759 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:20.389436 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1388/2824] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:33:20 2022] POST /identity/v3/projects => generated 384 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:33:20.393636 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83179ae8-1853-41f2-90fe-55cc955dead6 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:20.403908 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83179ae8-1853-41f2-90fe-55cc955dead6 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:20.424751 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:20.463424 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244efbe-34e2-4d48-a4b7-0f284889a983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:20.463971 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244efbe-34e2-4d48-a4b7-0f284889a983 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:20.464256 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244efbe-34e2-4d48-a4b7-0f284889a983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:20.464535 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244efbe-34e2-4d48-a4b7-0f284889a983 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:20.465244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244efbe-34e2-4d48-a4b7-0f284889a983 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:20.467325 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244efbe-34e2-4d48-a4b7-0f284889a983 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:20.575910 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1437/2825] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:33:20 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:33:20.581977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e414c-e7cc-4523-a72c-4fc5911a2759 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:20.592702 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e414c-e7cc-4523-a72c-4fc5911a2759 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:20.597395 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a67e88-0ed7-492d-8f48-65d711b5453e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:20.598061 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a67e88-0ed7-492d-8f48-65d711b5453e admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:20.598343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a67e88-0ed7-492d-8f48-65d711b5453e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:20.598616 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a67e88-0ed7-492d-8f48-65d711b5453e admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:20.599305 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a67e88-0ed7-492d-8f48-65d711b5453e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:20.601045 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a67e88-0ed7-492d-8f48-65d711b5453e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:20.616640 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1389/2826] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:33:20 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:33:20.621558 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244efbe-34e2-4d48-a4b7-0f284889a983 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:20.632024 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244efbe-34e2-4d48-a4b7-0f284889a983 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:20.637110 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eea709-6a6e-49ae-aa97-effd180f730f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:20.637740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eea709-6a6e-49ae-aa97-effd180f730f admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:20.638023 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eea709-6a6e-49ae-aa97-effd180f730f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:20.638299 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eea709-6a6e-49ae-aa97-effd180f730f admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:20.638998 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eea709-6a6e-49ae-aa97-effd180f730f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:20.640647 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eea709-6a6e-49ae-aa97-effd180f730f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:20.651124 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1438/2827] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:33:20 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:33:20.655370 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a67e88-0ed7-492d-8f48-65d711b5453e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:20.665911 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a67e88-0ed7-492d-8f48-65d711b5453e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:20.670721 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fbc3e-53cd-441a-8c24-1a141b49bb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:20.671384 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fbc3e-53cd-441a-8c24-1a141b49bb07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:20.671656 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fbc3e-53cd-441a-8c24-1a141b49bb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:20.671929 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fbc3e-53cd-441a-8c24-1a141b49bb07 admin admin] PATH_INFO: `/v3/projects/b33915b27cc947648b2941cfbf78e5c1/users/a2cf72ea1c044988afc3e5f3b6d63c86/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:20.689585 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fbc3e-53cd-441a-8c24-1a141b49bb07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b33915b27cc947648b2941cfbf78e5c1, user_id=a2cf72ea1c044988afc3e5f3b6d63c86, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:20.692290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fbc3e-53cd-441a-8c24-1a141b49bb07 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:20.770591 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1390/2828] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:33:20 2022] PUT /identity/v3/projects/b33915b27cc947648b2941cfbf78e5c1/users/a2cf72ea1c044988afc3e5f3b6d63c86/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:20.781328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ef717-2b8c-4171-a33d-324b12ee5105 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:20.781617 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ef717-2b8c-4171-a33d-324b12ee5105 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:20.781897 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ef717-2b8c-4171-a33d-324b12ee5105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:20.812503 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-bc7ef717-2b8c-4171-a33d-324b12ee5105 None None] MFA Rules not processed for user `a2cf72ea1c044988afc3e5f3b6d63c86`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:20.814182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-bc7ef717-2b8c-4171-a33d-324b12ee5105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:20.880493 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1439/2829] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:20.893195 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fbc3e-53cd-441a-8c24-1a141b49bb07 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:20.894941 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c12fbc3e-53cd-441a-8c24-1a141b49bb07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:20.954960 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fbc3e-53cd-441a-8c24-1a141b49bb07 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:20.958953 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f9287-3cab-4afc-883f-43d214d4690c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:20.959592 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f9287-3cab-4afc-883f-43d214d4690c service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:20.959870 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f9287-3cab-4afc-883f-43d214d4690c service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:20.960145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f9287-3cab-4afc-883f-43d214d4690c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:20.970437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f9287-3cab-4afc-883f-43d214d4690c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:20.971906 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f9287-3cab-4afc-883f-43d214d4690c service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:20.975781 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:20.983057 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1391/2830] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:33:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:33:21.002607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ef717-2b8c-4171-a33d-324b12ee5105 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:21.067284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ef717-2b8c-4171-a33d-324b12ee5105 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:21.072072 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbad8a-f1e0-4925-91ac-3917657bdb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:21.072740 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbad8a-f1e0-4925-91ac-3917657bdb9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:21.073024 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbad8a-f1e0-4925-91ac-3917657bdb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:21.073300 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbad8a-f1e0-4925-91ac-3917657bdb9a admin admin] PATH_INFO: `/v3/users/a2cf72ea1c044988afc3e5f3b6d63c86` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:21.074468 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dbad8a-f1e0-4925-91ac-3917657bdb9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2cf72ea1c044988afc3e5f3b6d63c86)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:21.076556 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dbad8a-f1e0-4925-91ac-3917657bdb9a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:21.232629 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:21.242165 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-55dbad8a-f1e0-4925-91ac-3917657bdb9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2cf72ea1c044988afc3e5f3b6d63c86'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:21.242860 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-55dbad8a-f1e0-4925-91ac-3917657bdb9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2cf72ea1c044988afc3e5f3b6d63c86'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:21.324242 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-55dbad8a-f1e0-4925-91ac-3917657bdb9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2cf72ea1c044988afc3e5f3b6d63c86'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:21.338500 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-55dbad8a-f1e0-4925-91ac-3917657bdb9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2cf72ea1c044988afc3e5f3b6d63c86'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:21.339239 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-55dbad8a-f1e0-4925-91ac-3917657bdb9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2cf72ea1c044988afc3e5f3b6d63c86'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:21.351835 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1440/2831] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:33:21 2022] DELETE /identity/v3/users/a2cf72ea1c044988afc3e5f3b6d63c86 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:21.356489 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd69d32-8a1e-4275-92c6-6c756481d6fb None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:21.356806 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd69d32-8a1e-4275-92c6-6c756481d6fb None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:21.357087 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd69d32-8a1e-4275-92c6-6c756481d6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:21.376487 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-5dd69d32-8a1e-4275-92c6-6c756481d6fb None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:21.377752 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5dd69d32-8a1e-4275-92c6-6c756481d6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:21.453915 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1392/2832] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:21.464490 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbad8a-f1e0-4925-91ac-3917657bdb9a admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:21.466107 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-55dbad8a-f1e0-4925-91ac-3917657bdb9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:21.526170 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbad8a-f1e0-4925-91ac-3917657bdb9a admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:21.529993 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfc78b-3610-4912-8f38-910bc0f18f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:21.530620 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfc78b-3610-4912-8f38-910bc0f18f3e service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:21.530944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfc78b-3610-4912-8f38-910bc0f18f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:21.531222 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfc78b-3610-4912-8f38-910bc0f18f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:21.542020 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfc78b-3610-4912-8f38-910bc0f18f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:21.543548 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfc78b-3610-4912-8f38-910bc0f18f3e service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:21.554340 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1441/2833] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:33:22.029161 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd69d32-8a1e-4275-92c6-6c756481d6fb None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:22.030664 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5dd69d32-8a1e-4275-92c6-6c756481d6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:22.043564 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd69d32-8a1e-4275-92c6-6c756481d6fb None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:22.049268 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d113a-5ae9-4ca2-96c1-aafc0563c709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:22.050025 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d113a-5ae9-4ca2-96c1-aafc0563c709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:22.050289 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d113a-5ae9-4ca2-96c1-aafc0563c709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:22.050568 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d113a-5ae9-4ca2-96c1-aafc0563c709 admin admin] PATH_INFO: `/v3/projects/b33915b27cc947648b2941cfbf78e5c1` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:22.051778 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d113a-5ae9-4ca2-96c1-aafc0563c709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b33915b27cc947648b2941cfbf78e5c1)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:22.053874 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d113a-5ae9-4ca2-96c1-aafc0563c709 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:22.154313 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0e2d113a-5ae9-4ca2-96c1-aafc0563c709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b33915b27cc947648b2941cfbf78e5c1', 'request_id': 'req-0e2d113a-5ae9-4ca2-96c1-aafc0563c709'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:22.160789 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0e2d113a-5ae9-4ca2-96c1-aafc0563c709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b33915b27cc947648b2941cfbf78e5c1', 'request_id': 'req-0e2d113a-5ae9-4ca2-96c1-aafc0563c709'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:22.167038 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0e2d113a-5ae9-4ca2-96c1-aafc0563c709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b33915b27cc947648b2941cfbf78e5c1', 'request_id': 'req-0e2d113a-5ae9-4ca2-96c1-aafc0563c709'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:22.282565 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0e2d113a-5ae9-4ca2-96c1-aafc0563c709 admin admin] The token cache is being invalidate because project b33915b27cc947648b2941cfbf78e5c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:33:22.282850 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0e2d113a-5ae9-4ca2-96c1-aafc0563c709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:22.283472 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0e2d113a-5ae9-4ca2-96c1-aafc0563c709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:22.285014 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1393/2834] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:33:22 2022] DELETE /identity/v3/projects/b33915b27cc947648b2941cfbf78e5c1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:22.290574 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecb1b9-97c2-48ed-9699-4b5e760e7205 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:22.291095 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecb1b9-97c2-48ed-9699-4b5e760e7205 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:22.291195 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecb1b9-97c2-48ed-9699-4b5e760e7205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:22.311989 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-59ecb1b9-97c2-48ed-9699-4b5e760e7205 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:22.313244 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-59ecb1b9-97c2-48ed-9699-4b5e760e7205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:22.375025 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1442/2835] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:22.382977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23ef22-9fc4-4e1b-84be-24eb257c9317 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:22.383467 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23ef22-9fc4-4e1b-84be-24eb257c9317 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:22.383659 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23ef22-9fc4-4e1b-84be-24eb257c9317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:22.405256 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-5e23ef22-9fc4-4e1b-84be-24eb257c9317 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:22.406504 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5e23ef22-9fc4-4e1b-84be-24eb257c9317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:22.415360 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1394/2836] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:22.420284 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecb1b9-97c2-48ed-9699-4b5e760e7205 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:22.430772 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecb1b9-97c2-48ed-9699-4b5e760e7205 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:22.435427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072986b-f40e-4b85-85d2-e06b0b55119e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:22.436047 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072986b-f40e-4b85-85d2-e06b0b55119e admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:22.436329 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072986b-f40e-4b85-85d2-e06b0b55119e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:22.436603 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072986b-f40e-4b85-85d2-e06b0b55119e admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:22.437333 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072986b-f40e-4b85-85d2-e06b0b55119e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:33:22.437636 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072986b-f40e-4b85-85d2-e06b0b55119e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:22.439226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072986b-f40e-4b85-85d2-e06b0b55119e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:22.451194 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1443/2837] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:33:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:33:22.455784 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23ef22-9fc4-4e1b-84be-24eb257c9317 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:22.465896 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23ef22-9fc4-4e1b-84be-24eb257c9317 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:22.470643 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77826cd7-2b1b-4dab-b3af-39a519ca34ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:22.471362 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77826cd7-2b1b-4dab-b3af-39a519ca34ca admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:22.471642 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77826cd7-2b1b-4dab-b3af-39a519ca34ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:22.471919 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77826cd7-2b1b-4dab-b3af-39a519ca34ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:22.472583 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77826cd7-2b1b-4dab-b3af-39a519ca34ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:22.474533 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77826cd7-2b1b-4dab-b3af-39a519ca34ca admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:22.568214 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1395/2838] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:33:22 2022] POST /identity/v3/projects => generated 372 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:33:22.572271 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072986b-f40e-4b85-85d2-e06b0b55119e admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:22.584890 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072986b-f40e-4b85-85d2-e06b0b55119e admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:22.632776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:22.651932 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be4c5d-d07b-47c4-8350-7debd6815f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:22.652561 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be4c5d-d07b-47c4-8350-7debd6815f68 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:22.652864 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be4c5d-d07b-47c4-8350-7debd6815f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:22.653139 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be4c5d-d07b-47c4-8350-7debd6815f68 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:22.653814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be4c5d-d07b-47c4-8350-7debd6815f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:22.655744 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be4c5d-d07b-47c4-8350-7debd6815f68 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:22.776506 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1444/2839] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:33:22 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:33:22.780606 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77826cd7-2b1b-4dab-b3af-39a519ca34ca admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:22.791187 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77826cd7-2b1b-4dab-b3af-39a519ca34ca admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:22.796175 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79636ada-1ebb-4bc6-9e59-20214baed386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:22.796871 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79636ada-1ebb-4bc6-9e59-20214baed386 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:22.797155 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79636ada-1ebb-4bc6-9e59-20214baed386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:22.797435 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79636ada-1ebb-4bc6-9e59-20214baed386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:22.798271 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79636ada-1ebb-4bc6-9e59-20214baed386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:22.799982 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79636ada-1ebb-4bc6-9e59-20214baed386 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:22.814179 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1396/2840] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:33:22 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:33:22.818433 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be4c5d-d07b-47c4-8350-7debd6815f68 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:22.829849 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be4c5d-d07b-47c4-8350-7debd6815f68 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:22.834816 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae179976-540f-459a-930c-d28c16fcb0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:22.837202 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae179976-540f-459a-930c-d28c16fcb0cf admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:22.837202 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae179976-540f-459a-930c-d28c16fcb0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:22.837202 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae179976-540f-459a-930c-d28c16fcb0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:22.837202 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae179976-540f-459a-930c-d28c16fcb0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:22.839130 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae179976-540f-459a-930c-d28c16fcb0cf admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:22.851177 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1445/2841] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:33:22 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 16:33:22.856437 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79636ada-1ebb-4bc6-9e59-20214baed386 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:22.867563 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79636ada-1ebb-4bc6-9e59-20214baed386 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:22.875043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774478a-6b6d-4e78-8909-49ff1578215f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:22.876208 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774478a-6b6d-4e78-8909-49ff1578215f admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:22.876902 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774478a-6b6d-4e78-8909-49ff1578215f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:22.877434 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774478a-6b6d-4e78-8909-49ff1578215f admin admin] PATH_INFO: `/v3/projects/91bf57d4fb76404785ec101acbb989e9/users/105a2dd93632462e8e18b7d65ae73b1e/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:22.900307 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774478a-6b6d-4e78-8909-49ff1578215f admin admin] RBAC: Authorizing `identity:create_grant(project_id=91bf57d4fb76404785ec101acbb989e9, user_id=105a2dd93632462e8e18b7d65ae73b1e, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:22.901735 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774478a-6b6d-4e78-8909-49ff1578215f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:23.000300 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1397/2842] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:33:22 2022] PUT /identity/v3/projects/91bf57d4fb76404785ec101acbb989e9/users/105a2dd93632462e8e18b7d65ae73b1e/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:23.012871 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c2417-b156-4e1d-9ed5-0ffa0ed46fa6 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:23.013157 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c2417-b156-4e1d-9ed5-0ffa0ed46fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:23.013464 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c2417-b156-4e1d-9ed5-0ffa0ed46fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:23.043574 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f33c2417-b156-4e1d-9ed5-0ffa0ed46fa6 None None] MFA Rules not processed for user `105a2dd93632462e8e18b7d65ae73b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:23.044727 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f33c2417-b156-4e1d-9ed5-0ffa0ed46fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:23.120135 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1446/2843] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:23.131734 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774478a-6b6d-4e78-8909-49ff1578215f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:23.133683 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8774478a-6b6d-4e78-8909-49ff1578215f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:23.159074 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:23.198661 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774478a-6b6d-4e78-8909-49ff1578215f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:23.205092 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344cf75-8daf-4ab6-829d-2e14b7bc0386 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:23.205716 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344cf75-8daf-4ab6-829d-2e14b7bc0386 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:23.205999 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344cf75-8daf-4ab6-829d-2e14b7bc0386 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:23.206273 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344cf75-8daf-4ab6-829d-2e14b7bc0386 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:23.217015 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344cf75-8daf-4ab6-829d-2e14b7bc0386 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:23.218493 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344cf75-8daf-4ab6-829d-2e14b7bc0386 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:23.229443 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1398/2844] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:33:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:33:23.255328 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c2417-b156-4e1d-9ed5-0ffa0ed46fa6 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:23.325723 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c2417-b156-4e1d-9ed5-0ffa0ed46fa6 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:23.330477 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d1072-8f32-4e86-ba2f-d63e6ab0e6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:23.331147 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d1072-8f32-4e86-ba2f-d63e6ab0e6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:23.331432 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d1072-8f32-4e86-ba2f-d63e6ab0e6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:23.331767 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d1072-8f32-4e86-ba2f-d63e6ab0e6bc admin admin] PATH_INFO: `/v3/users/105a2dd93632462e8e18b7d65ae73b1e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:23.332955 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d1072-8f32-4e86-ba2f-d63e6ab0e6bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=105a2dd93632462e8e18b7d65ae73b1e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:23.335019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d1072-8f32-4e86-ba2f-d63e6ab0e6bc admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:23.510302 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1d8d1072-8f32-4e86-ba2f-d63e6ab0e6bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '105a2dd93632462e8e18b7d65ae73b1e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:23.511045 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1d8d1072-8f32-4e86-ba2f-d63e6ab0e6bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '105a2dd93632462e8e18b7d65ae73b1e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:23.514976 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:23.564217 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1d8d1072-8f32-4e86-ba2f-d63e6ab0e6bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '105a2dd93632462e8e18b7d65ae73b1e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:23.580780 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1d8d1072-8f32-4e86-ba2f-d63e6ab0e6bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '105a2dd93632462e8e18b7d65ae73b1e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:23.581659 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1d8d1072-8f32-4e86-ba2f-d63e6ab0e6bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '105a2dd93632462e8e18b7d65ae73b1e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:23.594362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1447/2845] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:33:23 2022] DELETE /identity/v3/users/105a2dd93632462e8e18b7d65ae73b1e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:23.599112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3574ca3-cd60-4ae1-b829-36f87d3061f0 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:23.599401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3574ca3-cd60-4ae1-b829-36f87d3061f0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:23.599701 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3574ca3-cd60-4ae1-b829-36f87d3061f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:23.620952 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c3574ca3-cd60-4ae1-b829-36f87d3061f0 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:23.622316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c3574ca3-cd60-4ae1-b829-36f87d3061f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:23.686153 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1399/2846] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:23.696049 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d1072-8f32-4e86-ba2f-d63e6ab0e6bc admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:23.697604 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1d8d1072-8f32-4e86-ba2f-d63e6ab0e6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:23.777332 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d1072-8f32-4e86-ba2f-d63e6ab0e6bc admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:23.781355 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5ac27-9e08-45b3-aa45-25bd2676f546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:23.782109 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5ac27-9e08-45b3-aa45-25bd2676f546 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:23.782384 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5ac27-9e08-45b3-aa45-25bd2676f546 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:23.782654 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5ac27-9e08-45b3-aa45-25bd2676f546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:23.794124 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5ac27-9e08-45b3-aa45-25bd2676f546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:23.797017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5ac27-9e08-45b3-aa45-25bd2676f546 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:23.809544 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1448/2847] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:33:24.272781 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3574ca3-cd60-4ae1-b829-36f87d3061f0 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:24.274343 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c3574ca3-cd60-4ae1-b829-36f87d3061f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:24.287973 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3574ca3-cd60-4ae1-b829-36f87d3061f0 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:24.293603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba0c7a-b953-4fe5-b9cf-88805712fb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:24.294920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba0c7a-b953-4fe5-b9cf-88805712fb5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:24.295318 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba0c7a-b953-4fe5-b9cf-88805712fb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:24.296034 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba0c7a-b953-4fe5-b9cf-88805712fb5e admin admin] PATH_INFO: `/v3/projects/91bf57d4fb76404785ec101acbb989e9` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:24.297830 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba0c7a-b953-4fe5-b9cf-88805712fb5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=91bf57d4fb76404785ec101acbb989e9)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:24.299908 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba0c7a-b953-4fe5-b9cf-88805712fb5e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:24.417269 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-64ba0c7a-b953-4fe5-b9cf-88805712fb5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91bf57d4fb76404785ec101acbb989e9', 'request_id': 'req-64ba0c7a-b953-4fe5-b9cf-88805712fb5e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:24.424029 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-64ba0c7a-b953-4fe5-b9cf-88805712fb5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91bf57d4fb76404785ec101acbb989e9', 'request_id': 'req-64ba0c7a-b953-4fe5-b9cf-88805712fb5e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:24.430284 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-64ba0c7a-b953-4fe5-b9cf-88805712fb5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91bf57d4fb76404785ec101acbb989e9', 'request_id': 'req-64ba0c7a-b953-4fe5-b9cf-88805712fb5e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:24.513833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-64ba0c7a-b953-4fe5-b9cf-88805712fb5e admin admin] The token cache is being invalidate because project 91bf57d4fb76404785ec101acbb989e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:33:24.514142 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-64ba0c7a-b953-4fe5-b9cf-88805712fb5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:24.514977 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-64ba0c7a-b953-4fe5-b9cf-88805712fb5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:24.520971 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1400/2848] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:33:24 2022] DELETE /identity/v3/projects/91bf57d4fb76404785ec101acbb989e9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:24.523877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47675b18-dd7e-48e6-a172-9e61a5ec12f2 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:24.524413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47675b18-dd7e-48e6-a172-9e61a5ec12f2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:24.524514 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47675b18-dd7e-48e6-a172-9e61a5ec12f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:24.546082 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-47675b18-dd7e-48e6-a172-9e61a5ec12f2 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:24.547319 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-47675b18-dd7e-48e6-a172-9e61a5ec12f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:24.623110 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1449/2849] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:24.631112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19910d9-3e4e-4b82-abbc-62b0d5f6b712 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:24.631394 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19910d9-3e4e-4b82-abbc-62b0d5f6b712 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:24.631667 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19910d9-3e4e-4b82-abbc-62b0d5f6b712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:24.651835 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c19910d9-3e4e-4b82-abbc-62b0d5f6b712 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:24.653112 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c19910d9-3e4e-4b82-abbc-62b0d5f6b712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:24.661238 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1401/2850] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:33:24.668877 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47675b18-dd7e-48e6-a172-9e61a5ec12f2 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:24.683480 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47675b18-dd7e-48e6-a172-9e61a5ec12f2 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:24.688520 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef2c6e-cee2-4201-b1a2-1e252913e0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:24.689182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef2c6e-cee2-4201-b1a2-1e252913e0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:24.689465 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef2c6e-cee2-4201-b1a2-1e252913e0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:24.689747 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef2c6e-cee2-4201-b1a2-1e252913e0d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:24.690478 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef2c6e-cee2-4201-b1a2-1e252913e0d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:33:24.690788 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef2c6e-cee2-4201-b1a2-1e252913e0d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:24.692436 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef2c6e-cee2-4201-b1a2-1e252913e0d9 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:24.706476 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1450/2851] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:33:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:33:24.711027 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19910d9-3e4e-4b82-abbc-62b0d5f6b712 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:24.720927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19910d9-3e4e-4b82-abbc-62b0d5f6b712 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:24.725721 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee92cc-8350-4c8c-a365-b936db0981fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:24.726355 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee92cc-8350-4c8c-a365-b936db0981fe admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:24.726627 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee92cc-8350-4c8c-a365-b936db0981fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:24.726893 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee92cc-8350-4c8c-a365-b936db0981fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:24.727567 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee92cc-8350-4c8c-a365-b936db0981fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:24.729603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee92cc-8350-4c8c-a365-b936db0981fe admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:24.829166 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1402/2852] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:33:24 2022] POST /identity/v3/projects => generated 376 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:33:24.833443 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef2c6e-cee2-4201-b1a2-1e252913e0d9 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:24.843783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef2c6e-cee2-4201-b1a2-1e252913e0d9 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:24.906597 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16330c89-5ee3-4173-8a35-eeea84f74beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:24.907216 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16330c89-5ee3-4173-8a35-eeea84f74beb admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:24.907496 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16330c89-5ee3-4173-8a35-eeea84f74beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:24.907767 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16330c89-5ee3-4173-8a35-eeea84f74beb admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:24.908426 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16330c89-5ee3-4173-8a35-eeea84f74beb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:24.910467 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16330c89-5ee3-4173-8a35-eeea84f74beb admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:24.918717 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:25.008800 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1451/2853] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:33:24 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:33:25.012992 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee92cc-8350-4c8c-a365-b936db0981fe admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:25.023543 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee92cc-8350-4c8c-a365-b936db0981fe admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:25.028398 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704d2d4-3cc9-48f3-885f-0127d9e2c4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:25.029037 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704d2d4-3cc9-48f3-885f-0127d9e2c4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:25.029321 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704d2d4-3cc9-48f3-885f-0127d9e2c4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:25.029598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704d2d4-3cc9-48f3-885f-0127d9e2c4a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:25.030291 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704d2d4-3cc9-48f3-885f-0127d9e2c4a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:25.031895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704d2d4-3cc9-48f3-885f-0127d9e2c4a4 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:25.042654 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1403/2854] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:33:25 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:33:25.047185 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16330c89-5ee3-4173-8a35-eeea84f74beb admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:25.057958 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16330c89-5ee3-4173-8a35-eeea84f74beb admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:25.062679 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a76216-be25-4354-9d40-9cbc890a1038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:25.063288 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a76216-be25-4354-9d40-9cbc890a1038 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:25.063578 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a76216-be25-4354-9d40-9cbc890a1038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:25.063851 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a76216-be25-4354-9d40-9cbc890a1038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:25.064531 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a76216-be25-4354-9d40-9cbc890a1038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:25.066149 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a76216-be25-4354-9d40-9cbc890a1038 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:25.076952 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1452/2855] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:33:25 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:33:25.081478 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704d2d4-3cc9-48f3-885f-0127d9e2c4a4 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:25.088279 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:25.092002 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704d2d4-3cc9-48f3-885f-0127d9e2c4a4 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:25.096841 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc415bbe-f5a5-46c2-825c-41e5b46f5b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:25.097584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc415bbe-f5a5-46c2-825c-41e5b46f5b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:25.097949 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc415bbe-f5a5-46c2-825c-41e5b46f5b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:25.098228 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc415bbe-f5a5-46c2-825c-41e5b46f5b9d admin admin] PATH_INFO: `/v3/projects/ab50c562c42746a5be0e432d19dcf823/users/b9ca79e3708d471faa96297f63f6f03e/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:25.113805 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc415bbe-f5a5-46c2-825c-41e5b46f5b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab50c562c42746a5be0e432d19dcf823, user_id=b9ca79e3708d471faa96297f63f6f03e, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:25.116481 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc415bbe-f5a5-46c2-825c-41e5b46f5b9d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:25.180833 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1404/2856] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:33:25 2022] PUT /identity/v3/projects/ab50c562c42746a5be0e432d19dcf823/users/b9ca79e3708d471faa96297f63f6f03e/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:25.199583 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edc0ad-944e-452b-8b05-b7aa20523f5c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:25.200062 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edc0ad-944e-452b-8b05-b7aa20523f5c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:25.200450 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edc0ad-944e-452b-8b05-b7aa20523f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:25.232607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-34edc0ad-944e-452b-8b05-b7aa20523f5c None None] MFA Rules not processed for user `b9ca79e3708d471faa96297f63f6f03e`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:25.233986 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-34edc0ad-944e-452b-8b05-b7aa20523f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:25.317174 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1453/2857] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:25.325120 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc415bbe-f5a5-46c2-825c-41e5b46f5b9d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:25.326958 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fc415bbe-f5a5-46c2-825c-41e5b46f5b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:25.410507 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc415bbe-f5a5-46c2-825c-41e5b46f5b9d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:25.417121 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620843c-7850-4599-a7e9-1156d3fefcbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:25.418156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620843c-7850-4599-a7e9-1156d3fefcbe service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:25.418639 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620843c-7850-4599-a7e9-1156d3fefcbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:25.419138 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620843c-7850-4599-a7e9-1156d3fefcbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:25.431862 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620843c-7850-4599-a7e9-1156d3fefcbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:25.433359 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620843c-7850-4599-a7e9-1156d3fefcbe service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:25.443376 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1405/2858] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:33:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:33:35.308830 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:35.438630 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=34,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:37.272044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edc0ad-944e-452b-8b05-b7aa20523f5c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:37.342696 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edc0ad-944e-452b-8b05-b7aa20523f5c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:37.347628 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60141a-0695-4250-aed7-3735c4672b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:37.348278 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60141a-0695-4250-aed7-3735c4672b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:37.348556 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60141a-0695-4250-aed7-3735c4672b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:37.348858 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60141a-0695-4250-aed7-3735c4672b53 admin admin] PATH_INFO: `/v3/users/b9ca79e3708d471faa96297f63f6f03e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:37.350073 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60141a-0695-4250-aed7-3735c4672b53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ca79e3708d471faa96297f63f6f03e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:37.352019 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60141a-0695-4250-aed7-3735c4672b53 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:37.556969 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3b60141a-0695-4250-aed7-3735c4672b53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ca79e3708d471faa96297f63f6f03e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:37.557599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3b60141a-0695-4250-aed7-3735c4672b53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ca79e3708d471faa96297f63f6f03e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:37.632030 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3b60141a-0695-4250-aed7-3735c4672b53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ca79e3708d471faa96297f63f6f03e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:37.656737 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3b60141a-0695-4250-aed7-3735c4672b53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ca79e3708d471faa96297f63f6f03e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:37.657492 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3b60141a-0695-4250-aed7-3735c4672b53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ca79e3708d471faa96297f63f6f03e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:37.671456 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1454/2859] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:33:37 2022] DELETE /identity/v3/users/b9ca79e3708d471faa96297f63f6f03e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:37.676329 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8c775-2b03-4e9b-8d17-068f940781f8 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:37.677209 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8c775-2b03-4e9b-8d17-068f940781f8 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:37.677401 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8c775-2b03-4e9b-8d17-068f940781f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:37.698301 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a2b8c775-2b03-4e9b-8d17-068f940781f8 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:37.699550 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a2b8c775-2b03-4e9b-8d17-068f940781f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:37.763095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1406/2860] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:37.774817 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60141a-0695-4250-aed7-3735c4672b53 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:37.776908 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3b60141a-0695-4250-aed7-3735c4672b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:37.838800 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60141a-0695-4250-aed7-3735c4672b53 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:37.842605 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9355c2-7d19-488d-aa18-13b19248ab08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:37.843242 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9355c2-7d19-488d-aa18-13b19248ab08 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:37.843525 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9355c2-7d19-488d-aa18-13b19248ab08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:37.843801 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9355c2-7d19-488d-aa18-13b19248ab08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:37.854607 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9355c2-7d19-488d-aa18-13b19248ab08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:37.856067 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9355c2-7d19-488d-aa18-13b19248ab08 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:37.866568 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1455/2861] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:33:38.261918 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8c775-2b03-4e9b-8d17-068f940781f8 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:38.263627 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a2b8c775-2b03-4e9b-8d17-068f940781f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:38.280125 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8c775-2b03-4e9b-8d17-068f940781f8 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:38.284686 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338a8b9-64b2-46ad-94cf-3bffcd53b3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:38.286642 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338a8b9-64b2-46ad-94cf-3bffcd53b3e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:38.286929 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338a8b9-64b2-46ad-94cf-3bffcd53b3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:38.287203 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338a8b9-64b2-46ad-94cf-3bffcd53b3e2 admin admin] PATH_INFO: `/v3/projects/ab50c562c42746a5be0e432d19dcf823` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:38.288444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338a8b9-64b2-46ad-94cf-3bffcd53b3e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab50c562c42746a5be0e432d19dcf823)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:38.290464 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338a8b9-64b2-46ad-94cf-3bffcd53b3e2 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:38.439650 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-8338a8b9-64b2-46ad-94cf-3bffcd53b3e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab50c562c42746a5be0e432d19dcf823', 'request_id': 'req-8338a8b9-64b2-46ad-94cf-3bffcd53b3e2'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:38.446151 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-8338a8b9-64b2-46ad-94cf-3bffcd53b3e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab50c562c42746a5be0e432d19dcf823', 'request_id': 'req-8338a8b9-64b2-46ad-94cf-3bffcd53b3e2'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:38.452731 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-8338a8b9-64b2-46ad-94cf-3bffcd53b3e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab50c562c42746a5be0e432d19dcf823', 'request_id': 'req-8338a8b9-64b2-46ad-94cf-3bffcd53b3e2'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:38.536319 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-8338a8b9-64b2-46ad-94cf-3bffcd53b3e2 admin admin] The token cache is being invalidate because project ab50c562c42746a5be0e432d19dcf823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:33:38.536603 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-8338a8b9-64b2-46ad-94cf-3bffcd53b3e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:38.537288 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-8338a8b9-64b2-46ad-94cf-3bffcd53b3e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:38.538895 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1407/2862] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:33:38 2022] DELETE /identity/v3/projects/ab50c562c42746a5be0e432d19dcf823 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:38.544636 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5e6e0-6142-48de-8195-38de86e4d0ae None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:38.548711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5e6e0-6142-48de-8195-38de86e4d0ae None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:38.548711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5e6e0-6142-48de-8195-38de86e4d0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:38.566514 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-38d5e6e0-6142-48de-8195-38de86e4d0ae None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:38.567747 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-38d5e6e0-6142-48de-8195-38de86e4d0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:38.585510 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:38.630406 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1456/2863] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:38.638590 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e060a47-c1fb-4634-830c-b27c36cd55ca None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:38.638874 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e060a47-c1fb-4634-830c-b27c36cd55ca None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:38.639152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e060a47-c1fb-4634-830c-b27c36cd55ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:38.661713 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-9e060a47-c1fb-4634-830c-b27c36cd55ca None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:38.663019 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9e060a47-c1fb-4634-830c-b27c36cd55ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:38.672387 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1408/2864] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:38.676903 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5e6e0-6142-48de-8195-38de86e4d0ae None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:38.687773 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5e6e0-6142-48de-8195-38de86e4d0ae None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:38.692567 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da8731-861c-4348-afab-8b5092e7424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:38.693144 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da8731-861c-4348-afab-8b5092e7424f admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:38.693422 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da8731-861c-4348-afab-8b5092e7424f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:38.693699 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da8731-861c-4348-afab-8b5092e7424f admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:38.694378 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da8731-861c-4348-afab-8b5092e7424f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:33:38.694678 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da8731-861c-4348-afab-8b5092e7424f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:38.696273 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da8731-861c-4348-afab-8b5092e7424f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:38.707821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1457/2865] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:33:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 16:33:38.712026 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e060a47-c1fb-4634-830c-b27c36cd55ca None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:38.721318 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e060a47-c1fb-4634-830c-b27c36cd55ca None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:38.726407 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618774a4-c1f3-4a9a-b8d4-fbda53264653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:38.727047 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618774a4-c1f3-4a9a-b8d4-fbda53264653 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:38.727325 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618774a4-c1f3-4a9a-b8d4-fbda53264653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:38.727597 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618774a4-c1f3-4a9a-b8d4-fbda53264653 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:38.728795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618774a4-c1f3-4a9a-b8d4-fbda53264653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:38.730865 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618774a4-c1f3-4a9a-b8d4-fbda53264653 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:38.823373 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1409/2866] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:33:38 2022] POST /identity/v3/projects => generated 400 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:33:38.827944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da8731-861c-4348-afab-8b5092e7424f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:38.839229 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da8731-861c-4348-afab-8b5092e7424f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:38.903290 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c73b12-ad7e-4ea5-bc46-f871e57421d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:38.903911 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c73b12-ad7e-4ea5-bc46-f871e57421d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:38.904191 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c73b12-ad7e-4ea5-bc46-f871e57421d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:38.904485 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c73b12-ad7e-4ea5-bc46-f871e57421d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:38.905200 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c73b12-ad7e-4ea5-bc46-f871e57421d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:38.907119 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c73b12-ad7e-4ea5-bc46-f871e57421d2 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:39.021613 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1458/2867] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:33:38 2022] POST /identity/v3/users => generated 301 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:33:39.026022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618774a4-c1f3-4a9a-b8d4-fbda53264653 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:39.036537 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618774a4-c1f3-4a9a-b8d4-fbda53264653 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:39.041740 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc9760-527e-4bea-b955-487f56147246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:39.042466 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc9760-527e-4bea-b955-487f56147246 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:39.042744 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc9760-527e-4bea-b955-487f56147246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:39.043036 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc9760-527e-4bea-b955-487f56147246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:39.043728 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc9760-527e-4bea-b955-487f56147246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:39.045616 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc9760-527e-4bea-b955-487f56147246 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:39.055675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1410/2868] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:33:39 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:33:39.059857 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c73b12-ad7e-4ea5-bc46-f871e57421d2 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:39.069995 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c73b12-ad7e-4ea5-bc46-f871e57421d2 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:39.074813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffea4a3-ccdd-43e2-b592-37069ca0ad3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:39.075414 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffea4a3-ccdd-43e2-b592-37069ca0ad3a admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:39.075694 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffea4a3-ccdd-43e2-b592-37069ca0ad3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:39.075968 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffea4a3-ccdd-43e2-b592-37069ca0ad3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:39.076743 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffea4a3-ccdd-43e2-b592-37069ca0ad3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:39.078321 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffea4a3-ccdd-43e2-b592-37069ca0ad3a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:39.089772 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1459/2869] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:33:39 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:33:39.094022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc9760-527e-4bea-b955-487f56147246 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:39.104816 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc9760-527e-4bea-b955-487f56147246 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:39.109565 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b199cc-670c-4004-9e6c-1fd8eacc8a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:39.110206 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b199cc-670c-4004-9e6c-1fd8eacc8a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:39.110491 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b199cc-670c-4004-9e6c-1fd8eacc8a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:39.110772 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b199cc-670c-4004-9e6c-1fd8eacc8a69 admin admin] PATH_INFO: `/v3/projects/038fd46f060e469f8c76596130376f40/users/5739a0ebdf264f85ae0970b96da3b77d/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:39.131484 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b199cc-670c-4004-9e6c-1fd8eacc8a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=038fd46f060e469f8c76596130376f40, user_id=5739a0ebdf264f85ae0970b96da3b77d, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:39.134290 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b199cc-670c-4004-9e6c-1fd8eacc8a69 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:39.226951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1411/2870] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:33:39 2022] PUT /identity/v3/projects/038fd46f060e469f8c76596130376f40/users/5739a0ebdf264f85ae0970b96da3b77d/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:33:39.237618 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385512-5c30-47a3-8f87-a8c43cad27e2 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:39.237929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385512-5c30-47a3-8f87-a8c43cad27e2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:39.238204 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385512-5c30-47a3-8f87-a8c43cad27e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:39.266814 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2e385512-5c30-47a3-8f87-a8c43cad27e2 None None] MFA Rules not processed for user `5739a0ebdf264f85ae0970b96da3b77d`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:39.268126 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2e385512-5c30-47a3-8f87-a8c43cad27e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:39.339333 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1460/2871] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:39 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:39.350961 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b199cc-670c-4004-9e6c-1fd8eacc8a69 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:39.352719 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e3b199cc-670c-4004-9e6c-1fd8eacc8a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:39.374354 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:39.411057 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b199cc-670c-4004-9e6c-1fd8eacc8a69 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:39.414768 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa41c4-e10b-46b3-b469-cba34f5c7109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb13d9d5d05a456fb2cb33a380c505f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:39.417845 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa41c4-e10b-46b3-b469-cba34f5c7109 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:39.417845 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa41c4-e10b-46b3-b469-cba34f5c7109 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:39.417845 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa41c4-e10b-46b3-b469-cba34f5c7109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:39.424767 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa41c4-e10b-46b3-b469-cba34f5c7109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:39.426202 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa41c4-e10b-46b3-b469-cba34f5c7109 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:39.434909 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1412/2872] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:33:39 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:33:45.379767 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e385512-5c30-47a3-8f87-a8c43cad27e2 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:45.400830 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:45.449168 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e385512-5c30-47a3-8f87-a8c43cad27e2 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:45.455723 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea131dfa-8c05-41bb-b1a9-a03ef49f1c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:45.456409 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea131dfa-8c05-41bb-b1a9-a03ef49f1c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:45.456786 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea131dfa-8c05-41bb-b1a9-a03ef49f1c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:45.457068 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea131dfa-8c05-41bb-b1a9-a03ef49f1c5d admin admin] PATH_INFO: `/v3/users/5739a0ebdf264f85ae0970b96da3b77d` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:45.458314 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea131dfa-8c05-41bb-b1a9-a03ef49f1c5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5739a0ebdf264f85ae0970b96da3b77d)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:45.460252 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea131dfa-8c05-41bb-b1a9-a03ef49f1c5d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:45.663270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ea131dfa-8c05-41bb-b1a9-a03ef49f1c5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5739a0ebdf264f85ae0970b96da3b77d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:45.663944 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ea131dfa-8c05-41bb-b1a9-a03ef49f1c5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5739a0ebdf264f85ae0970b96da3b77d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:45.739187 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ea131dfa-8c05-41bb-b1a9-a03ef49f1c5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5739a0ebdf264f85ae0970b96da3b77d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:45.752276 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ea131dfa-8c05-41bb-b1a9-a03ef49f1c5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5739a0ebdf264f85ae0970b96da3b77d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:45.753001 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ea131dfa-8c05-41bb-b1a9-a03ef49f1c5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5739a0ebdf264f85ae0970b96da3b77d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:45.765711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1461/2873] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:33:45 2022] DELETE /identity/v3/users/5739a0ebdf264f85ae0970b96da3b77d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:45.770408 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261bbda-f889-4878-a8f8-00195d11e215 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:45.770916 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261bbda-f889-4878-a8f8-00195d11e215 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:45.771016 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261bbda-f889-4878-a8f8-00195d11e215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:45.791925 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-1261bbda-f889-4878-a8f8-00195d11e215 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:45.793197 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1261bbda-f889-4878-a8f8-00195d11e215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:45.864600 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1413/2874] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:45.874567 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea131dfa-8c05-41bb-b1a9-a03ef49f1c5d admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:45.876103 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ea131dfa-8c05-41bb-b1a9-a03ef49f1c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:45.954496 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea131dfa-8c05-41bb-b1a9-a03ef49f1c5d admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:45.958254 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f01cd2-9a63-40ba-9307-e0ed0ec3cd92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:45.958869 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f01cd2-9a63-40ba-9307-e0ed0ec3cd92 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:45.959187 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f01cd2-9a63-40ba-9307-e0ed0ec3cd92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:45.959415 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f01cd2-9a63-40ba-9307-e0ed0ec3cd92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:45.970930 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f01cd2-9a63-40ba-9307-e0ed0ec3cd92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:45.972601 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f01cd2-9a63-40ba-9307-e0ed0ec3cd92 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:45.982576 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1462/2875] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:33:46.667170 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261bbda-f889-4878-a8f8-00195d11e215 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:46.668804 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1261bbda-f889-4878-a8f8-00195d11e215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:46.682703 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261bbda-f889-4878-a8f8-00195d11e215 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:46.687499 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95c238-b071-4c8d-a088-1e6044855a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:46.688182 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95c238-b071-4c8d-a088-1e6044855a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:46.688469 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95c238-b071-4c8d-a088-1e6044855a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:46.688777 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95c238-b071-4c8d-a088-1e6044855a44 admin admin] PATH_INFO: `/v3/projects/038fd46f060e469f8c76596130376f40` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:46.689990 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95c238-b071-4c8d-a088-1e6044855a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=038fd46f060e469f8c76596130376f40)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:46.691976 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95c238-b071-4c8d-a088-1e6044855a44 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:46.827113 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6d95c238-b071-4c8d-a088-1e6044855a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '038fd46f060e469f8c76596130376f40', 'request_id': 'req-6d95c238-b071-4c8d-a088-1e6044855a44'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:46.834565 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6d95c238-b071-4c8d-a088-1e6044855a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '038fd46f060e469f8c76596130376f40', 'request_id': 'req-6d95c238-b071-4c8d-a088-1e6044855a44'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:46.840361 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6d95c238-b071-4c8d-a088-1e6044855a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '038fd46f060e469f8c76596130376f40', 'request_id': 'req-6d95c238-b071-4c8d-a088-1e6044855a44'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:46.923927 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6d95c238-b071-4c8d-a088-1e6044855a44 admin admin] The token cache is being invalidate because project 038fd46f060e469f8c76596130376f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:33:46.924143 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6d95c238-b071-4c8d-a088-1e6044855a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:46.924819 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6d95c238-b071-4c8d-a088-1e6044855a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:33:46.926433 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1414/2876] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:33:46 2022] DELETE /identity/v3/projects/038fd46f060e469f8c76596130376f40 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:46.932327 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf97c7b-c84f-4770-a131-52ef492e5a3f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:46.948102 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf97c7b-c84f-4770-a131-52ef492e5a3f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:46.948102 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf97c7b-c84f-4770-a131-52ef492e5a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:46.953182 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5cf97c7b-c84f-4770-a131-52ef492e5a3f None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:46.954383 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5cf97c7b-c84f-4770-a131-52ef492e5a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:46.989881 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:47.017205 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1463/2877] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:33:47.027768 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4668675-a1ed-45de-8f9e-be4eb7697388 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:47.028242 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4668675-a1ed-45de-8f9e-be4eb7697388 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:47.028920 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4668675-a1ed-45de-8f9e-be4eb7697388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:47.051265 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c4668675-a1ed-45de-8f9e-be4eb7697388 None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:47.052486 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c4668675-a1ed-45de-8f9e-be4eb7697388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:47.061380 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1415/2878] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:47.065768 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf97c7b-c84f-4770-a131-52ef492e5a3f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:47.077691 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf97c7b-c84f-4770-a131-52ef492e5a3f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:47.083665 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc0f32-607d-4753-b9c3-8d0fd55ce118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:47.084320 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc0f32-607d-4753-b9c3-8d0fd55ce118 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:47.084593 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc0f32-607d-4753-b9c3-8d0fd55ce118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:47.084894 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc0f32-607d-4753-b9c3-8d0fd55ce118 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:47.085622 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc0f32-607d-4753-b9c3-8d0fd55ce118 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 16:33:47.085983 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc0f32-607d-4753-b9c3-8d0fd55ce118 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:47.088171 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc0f32-607d-4753-b9c3-8d0fd55ce118 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:47.100997 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1464/2879] 10.222.0.141 () {58 vars in 1158 bytes} [Tue Jul 26 16:33:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 16:33:47.106375 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4668675-a1ed-45de-8f9e-be4eb7697388 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:47.115813 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4668675-a1ed-45de-8f9e-be4eb7697388 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:47.120520 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fea8e-33e1-46d5-8273-f5ff8a85efe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:47.121168 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fea8e-33e1-46d5-8273-f5ff8a85efe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:47.121451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fea8e-33e1-46d5-8273-f5ff8a85efe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:47.121729 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fea8e-33e1-46d5-8273-f5ff8a85efe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:47.122402 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fea8e-33e1-46d5-8273-f5ff8a85efe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:47.124316 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fea8e-33e1-46d5-8273-f5ff8a85efe6 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:47.221795 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1416/2880] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:33:47 2022] POST /identity/v3/projects => generated 386 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:33:47.225870 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc0f32-607d-4753-b9c3-8d0fd55ce118 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:47.236646 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc0f32-607d-4753-b9c3-8d0fd55ce118 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:47.292977 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ff28c-31cc-40e2-82a9-e379d1a44028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:47.293598 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ff28c-31cc-40e2-82a9-e379d1a44028 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:47.293882 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ff28c-31cc-40e2-82a9-e379d1a44028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:47.294159 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ff28c-31cc-40e2-82a9-e379d1a44028 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:47.294823 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ff28c-31cc-40e2-82a9-e379d1a44028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:47.297024 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ff28c-31cc-40e2-82a9-e379d1a44028 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:47.432829 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1465/2881] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:33:47 2022] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 16:33:47.437319 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fea8e-33e1-46d5-8273-f5ff8a85efe6 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:47.448462 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fea8e-33e1-46d5-8273-f5ff8a85efe6 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:47.453268 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f0b37-2887-4350-8091-66a5a827156c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:47.453881 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f0b37-2887-4350-8091-66a5a827156c admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:47.454164 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f0b37-2887-4350-8091-66a5a827156c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:47.454438 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f0b37-2887-4350-8091-66a5a827156c admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:47.455133 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f0b37-2887-4350-8091-66a5a827156c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:47.456829 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f0b37-2887-4350-8091-66a5a827156c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:47.467938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1417/2882] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:33:47 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:33:47.472693 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ff28c-31cc-40e2-82a9-e379d1a44028 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:47.482680 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ff28c-31cc-40e2-82a9-e379d1a44028 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:47.490226 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a8aab-3e29-433b-a900-7567a871288c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:47.490849 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a8aab-3e29-433b-a900-7567a871288c admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:47.491131 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a8aab-3e29-433b-a900-7567a871288c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:47.491409 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a8aab-3e29-433b-a900-7567a871288c admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:47.492104 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a8aab-3e29-433b-a900-7567a871288c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:47.493738 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a8aab-3e29-433b-a900-7567a871288c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:47.505317 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1466/2883] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:33:47 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:33:47.510184 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f0b37-2887-4350-8091-66a5a827156c admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:47.520397 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f0b37-2887-4350-8091-66a5a827156c admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:47.526082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc48d98-e731-498d-ab89-4f25ed9100ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:47.526751 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc48d98-e731-498d-ab89-4f25ed9100ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:47.527033 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc48d98-e731-498d-ab89-4f25ed9100ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:47.527306 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc48d98-e731-498d-ab89-4f25ed9100ce admin admin] PATH_INFO: `/v3/projects/d95fd28fbe1d4c8b9140d0f8f4172bdb/users/7649f99214b94eda81914ed110a8b0f6/roles/61321ad01e84416981d4c7208c55bbe7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:47.529728 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:47.542949 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc48d98-e731-498d-ab89-4f25ed9100ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95fd28fbe1d4c8b9140d0f8f4172bdb, user_id=7649f99214b94eda81914ed110a8b0f6, role_id=61321ad01e84416981d4c7208c55bbe7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:47.545914 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc48d98-e731-498d-ab89-4f25ed9100ce admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:47.633152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1418/2884] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:33:47 2022] PUT /identity/v3/projects/d95fd28fbe1d4c8b9140d0f8f4172bdb/users/7649f99214b94eda81914ed110a8b0f6/roles/61321ad01e84416981d4c7208c55bbe7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:33:47.638880 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11032ea3-26c8-4fa6-8847-db47b370d98b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:47.639288 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11032ea3-26c8-4fa6-8847-db47b370d98b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:47.639579 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11032ea3-26c8-4fa6-8847-db47b370d98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:47.660044 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-11032ea3-26c8-4fa6-8847-db47b370d98b None None] MFA Rules not processed for user `6845518adc8f4e04b03cfbd69adea2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:47.661301 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-11032ea3-26c8-4fa6-8847-db47b370d98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:47.722428 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1467/2885] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:33:47.732105 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc48d98-e731-498d-ab89-4f25ed9100ce admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:47.733875 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7cc48d98-e731-498d-ab89-4f25ed9100ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:47.792043 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc48d98-e731-498d-ab89-4f25ed9100ce admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:47.796229 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc772114-3021-4602-b7bd-031e8fffebbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:47.796951 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc772114-3021-4602-b7bd-031e8fffebbb service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:47.797232 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc772114-3021-4602-b7bd-031e8fffebbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:47.797508 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc772114-3021-4602-b7bd-031e8fffebbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:47.807398 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc772114-3021-4602-b7bd-031e8fffebbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:47.809012 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc772114-3021-4602-b7bd-031e8fffebbb service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:47.820718 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1419/2886] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:33:53.325667 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cded8-a90c-4af1-a75e-cecd211343e3 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:53.326362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cded8-a90c-4af1-a75e-cecd211343e3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:53.326362 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cded8-a90c-4af1-a75e-cecd211343e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:53.361255 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-eb0cded8-a90c-4af1-a75e-cecd211343e3 None None] MFA Rules not processed for user `7649f99214b94eda81914ed110a8b0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:33:53.362513 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-eb0cded8-a90c-4af1-a75e-cecd211343e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:33:53.414736 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:53.447978 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1468/2887] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:33:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:33:53.452527 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc772114-3021-4602-b7bd-031e8fffebbb service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:53.464452 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc772114-3021-4602-b7bd-031e8fffebbb service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:53.470512 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0ae90-f1d3-4be7-890f-3364f1f9f99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:53.471215 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0ae90-f1d3-4be7-890f-3364f1f9f99c admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:53.471503 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0ae90-f1d3-4be7-890f-3364f1f9f99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:53.471771 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0ae90-f1d3-4be7-890f-3364f1f9f99c admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:53.475022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0ae90-f1d3-4be7-890f-3364f1f9f99c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:53.475022 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0ae90-f1d3-4be7-890f-3364f1f9f99c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:53.571397 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1420/2888] 10.222.0.141 () {60 vars in 1158 bytes} [Tue Jul 26 16:33:53 2022] POST /identity/v3/projects => generated 386 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:33:53.575427 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0cded8-a90c-4af1-a75e-cecd211343e3 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:53.588166 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0cded8-a90c-4af1-a75e-cecd211343e3 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:53.663144 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfc942-2383-47bf-bcbc-0db7bf7240ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:53.663783 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfc942-2383-47bf-bcbc-0db7bf7240ec admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:53.664047 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfc942-2383-47bf-bcbc-0db7bf7240ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:53.664322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfc942-2383-47bf-bcbc-0db7bf7240ec admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:53.665886 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cfc942-2383-47bf-bcbc-0db7bf7240ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:53.667831 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cfc942-2383-47bf-bcbc-0db7bf7240ec admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:53.740849 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1469/2889] 10.222.0.141 () {60 vars in 1149 bytes} [Tue Jul 26 16:33:53 2022] POST /identity/v3/users => generated 300 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 16:33:53.745695 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0ae90-f1d3-4be7-890f-3364f1f9f99c admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:53.756169 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0ae90-f1d3-4be7-890f-3364f1f9f99c admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:53.760825 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe69ed-1c30-4ab5-833e-544e4962e5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:53.761495 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe69ed-1c30-4ab5-833e-544e4962e5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:53.761719 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe69ed-1c30-4ab5-833e-544e4962e5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:53.761992 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe69ed-1c30-4ab5-833e-544e4962e5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:53.762674 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe69ed-1c30-4ab5-833e-544e4962e5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:53.764260 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe69ed-1c30-4ab5-833e-544e4962e5c2 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:53.775168 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1421/2890] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:33:53 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:33:53.779439 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfc942-2383-47bf-bcbc-0db7bf7240ec admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:53.789749 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfc942-2383-47bf-bcbc-0db7bf7240ec admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:53.795122 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6468abf-be95-4ca1-a4de-eb315e905c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:53.796079 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6468abf-be95-4ca1-a4de-eb315e905c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:53.796321 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6468abf-be95-4ca1-a4de-eb315e905c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:53.796593 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6468abf-be95-4ca1-a4de-eb315e905c50 admin admin] PATH_INFO: `/v3/projects/3de47e90bbef444880d6010ebc9ed676/users/686d27d858cf4df5967d9d336bc6dc94/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:53.813106 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6468abf-be95-4ca1-a4de-eb315e905c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de47e90bbef444880d6010ebc9ed676, user_id=686d27d858cf4df5967d9d336bc6dc94, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:53.816258 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6468abf-be95-4ca1-a4de-eb315e905c50 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:53.895135 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1470/2891] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:33:53 2022] PUT /identity/v3/projects/3de47e90bbef444880d6010ebc9ed676/users/686d27d858cf4df5967d9d336bc6dc94/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 16:33:53.900106 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe69ed-1c30-4ab5-833e-544e4962e5c2 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:53.910753 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe69ed-1c30-4ab5-833e-544e4962e5c2 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:53.973782 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20288f-71c4-4c75-9b67-6c6d14751e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:53.974404 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20288f-71c4-4c75-9b67-6c6d14751e8b admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:53.974685 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20288f-71c4-4c75-9b67-6c6d14751e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:53.974981 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20288f-71c4-4c75-9b67-6c6d14751e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:53.975673 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20288f-71c4-4c75-9b67-6c6d14751e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:53.978567 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20288f-71c4-4c75-9b67-6c6d14751e8b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:53.991734 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1422/2892] 10.222.0.141 () {58 vars in 1127 bytes} [Tue Jul 26 16:33:53 2022] GET /identity/v3/roles => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 16:33:53.995974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6468abf-be95-4ca1-a4de-eb315e905c50 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:33:54.006725 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6468abf-be95-4ca1-a4de-eb315e905c50 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:33:54.011517 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5814d-a735-40eb-aa80-ead6c7c58f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:33:54.012189 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5814d-a735-40eb-aa80-ead6c7c58f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:33:54.012472 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5814d-a735-40eb-aa80-ead6c7c58f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:33:54.012821 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5814d-a735-40eb-aa80-ead6c7c58f0d admin admin] PATH_INFO: `/v3/projects/3de47e90bbef444880d6010ebc9ed676/users/686d27d858cf4df5967d9d336bc6dc94/roles/94ecbd6c86a84b75bdb0c57fc27a9a07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:33:54.014794 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5814d-a735-40eb-aa80-ead6c7c58f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de47e90bbef444880d6010ebc9ed676, user_id=686d27d858cf4df5967d9d336bc6dc94, role_id=94ecbd6c86a84b75bdb0c57fc27a9a07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:33:54.017647 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5814d-a735-40eb-aa80-ead6c7c58f0d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:33:54.029711 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1471/2893] 10.222.0.141 () {60 vars in 1488 bytes} [Tue Jul 26 16:33:53 2022] PUT /identity/v3/projects/3de47e90bbef444880d6010ebc9ed676/users/686d27d858cf4df5967d9d336bc6dc94/roles/94ecbd6c86a84b75bdb0c57fc27a9a07 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:34:00.493952 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445d4dc-c0f0-4e81-a1c5-9a5413186d81 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:34:00.498310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445d4dc-c0f0-4e81-a1c5-9a5413186d81 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:34:00.498310 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445d4dc-c0f0-4e81-a1c5-9a5413186d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:34:00.538037 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-9445d4dc-c0f0-4e81-a1c5-9a5413186d81 None None] MFA Rules not processed for user `686d27d858cf4df5967d9d336bc6dc94`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:34:00.540223 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9445d4dc-c0f0-4e81-a1c5-9a5413186d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:34:00.592646 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:34:00.639134 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1423/2894] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:34:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:34:00.653389 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5814d-a735-40eb-aa80-ead6c7c58f0d admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:34:00.655306 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-69f5814d-a735-40eb-aa80-ead6c7c58f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:34:00.721407 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5814d-a735-40eb-aa80-ead6c7c58f0d admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:34:00.725981 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47560e66-1bea-4099-9447-43c0e81a8320 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d25aebc2bbc47b5adb7200275c98d90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:34:00.726623 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47560e66-1bea-4099-9447-43c0e81a8320 service glance] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:34:00.726901 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47560e66-1bea-4099-9447-43c0e81a8320 service glance] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:34:00.728090 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47560e66-1bea-4099-9447-43c0e81a8320 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:34:00.775306 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:34:00.793722 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47560e66-1bea-4099-9447-43c0e81a8320 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:34:00.795342 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47560e66-1bea-4099-9447-43c0e81a8320 service glance] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:34:00.807242 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1472/2895] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:34:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:34:01.091938 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a939ba-2a64-4e58-bf84-1d79910b9989 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:34:01.092225 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a939ba-2a64-4e58-bf84-1d79910b9989 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:34:01.092505 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a939ba-2a64-4e58-bf84-1d79910b9989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:34:01.156612 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-53a939ba-2a64-4e58-bf84-1d79910b9989 None None] MFA Rules not processed for user `02af03095e48472d96a995a530e78035`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:34:01.157877 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-53a939ba-2a64-4e58-bf84-1d79910b9989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:34:01.237936 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1424/2896] 10.222.0.141 () {58 vars in 1014 bytes} [Tue Jul 26 16:34:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:34:01.391417 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47560e66-1bea-4099-9447-43c0e81a8320 service glance] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:34:01.393063 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-47560e66-1bea-4099-9447-43c0e81a8320 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:34:01.520061 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47560e66-1bea-4099-9447-43c0e81a8320 service glance] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:34:01.525322 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd64b1-f90b-4ad4-8c83-5eacf993a3a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c5f92f21868436a99a5c7aaa1fc40b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:34:01.525955 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd64b1-f90b-4ad4-8c83-5eacf993a3a8 service swift] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:34:01.526240 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd64b1-f90b-4ad4-8c83-5eacf993a3a8 service swift] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:34:01.526521 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd64b1-f90b-4ad4-8c83-5eacf993a3a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:34:01.538080 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd64b1-f90b-4ad4-8c83-5eacf993a3a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:34:01.539899 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd64b1-f90b-4ad4-8c83-5eacf993a3a8 service swift] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:34:01.549753 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1473/2897] 10.222.0.141 () {60 vars in 1389 bytes} [Tue Jul 26 16:34:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 16:34:11.234949 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=59 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:34:11.545943 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=49 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:34:11.695994 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fdb25-2d99-40cd-a7a6-eb153aa96e06 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:34:11.696279 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fdb25-2d99-40cd-a7a6-eb153aa96e06 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:34:11.696556 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fdb25-2d99-40cd-a7a6-eb153aa96e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:34:11.716682 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-848fdb25-2d99-40cd-a7a6-eb153aa96e06 None None] MFA Rules not processed for user `7649f99214b94eda81914ed110a8b0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:34:11.717917 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-848fdb25-2d99-40cd-a7a6-eb153aa96e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:34:11.724972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1425/2898] 10.222.0.141 () {58 vars in 963 bytes} [Tue Jul 26 16:34:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 16:34:11.763812 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd64b1-f90b-4ad4-8c83-5eacf993a3a8 service swift] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:34:11.774270 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd64b1-f90b-4ad4-8c83-5eacf993a3a8 service swift] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:34:11.777915 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b087da-9eb3-42df-a0bc-669263a99f06 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d25aebc2bbc47b5adb7200275c98d90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:34:11.778518 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b087da-9eb3-42df-a0bc-669263a99f06 service glance] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:34:11.778805 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b087da-9eb3-42df-a0bc-669263a99f06 service glance] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:34:11.779081 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b087da-9eb3-42df-a0bc-669263a99f06 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:34:11.781076 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-37b087da-9eb3-42df-a0bc-669263a99f06 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:34:11.878892 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b087da-9eb3-42df-a0bc-669263a99f06 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:34:11.880346 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b087da-9eb3-42df-a0bc-669263a99f06 service glance] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:34:11.901962 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1474/2899] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:34:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:34:12.148435 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fdb25-2d99-40cd-a7a6-eb153aa96e06 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:34:12.156047 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-848fdb25-2d99-40cd-a7a6-eb153aa96e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:34:12.228431 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fdb25-2d99-40cd-a7a6-eb153aa96e06 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:34:12.232028 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45646d86-87c6-4f21-9b44-238e8fee0557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:34:12.232678 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45646d86-87c6-4f21-9b44-238e8fee0557 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:34:12.232974 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45646d86-87c6-4f21-9b44-238e8fee0557 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:34:12.233249 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45646d86-87c6-4f21-9b44-238e8fee0557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:34:12.235068 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-45646d86-87c6-4f21-9b44-238e8fee0557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:34:12.246171 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45646d86-87c6-4f21-9b44-238e8fee0557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:34:12.247631 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45646d86-87c6-4f21-9b44-238e8fee0557 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:34:12.256527 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1426/2900] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:34:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:34:12.696125 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b087da-9eb3-42df-a0bc-669263a99f06 service glance] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:34:12.700365 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-37b087da-9eb3-42df-a0bc-669263a99f06 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:34:12.711959 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45646d86-87c6-4f21-9b44-238e8fee0557 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:34:12.721886 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45646d86-87c6-4f21-9b44-238e8fee0557 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:34:12.726082 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dee94f-1862-42d0-beb5-b4256b1af282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:34:12.727451 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dee94f-1862-42d0-beb5-b4256b1af282 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:34:12.727806 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dee94f-1862-42d0-beb5-b4256b1af282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:34:12.728198 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dee94f-1862-42d0-beb5-b4256b1af282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:34:12.730611 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c3dee94f-1862-42d0-beb5-b4256b1af282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:34:12.745875 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dee94f-1862-42d0-beb5-b4256b1af282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:34:12.747341 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dee94f-1862-42d0-beb5-b4256b1af282 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:34:12.761945 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1427/2901] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:34:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:34:12.782802 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b087da-9eb3-42df-a0bc-669263a99f06 service glance] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:34:12.788436 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e59b1-2160-4fb6-9b23-26a7c81e76fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda05b7b9675423e992470819d1c150a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:34:12.790347 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e59b1-2160-4fb6-9b23-26a7c81e76fb service placement] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:34:12.790634 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e59b1-2160-4fb6-9b23-26a7c81e76fb service placement] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:34:12.790930 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e59b1-2160-4fb6-9b23-26a7c81e76fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:34:12.793262 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-527e59b1-2160-4fb6-9b23-26a7c81e76fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:34:12.806929 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e59b1-2160-4fb6-9b23-26a7c81e76fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:34:12.808564 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e59b1-2160-4fb6-9b23-26a7c81e76fb service placement] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:34:12.820093 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1475/2902] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:34:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:34:15.721598 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdce57c-8594-4a80-a4c7-131e54beccc3 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:34:15.722152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdce57c-8594-4a80-a4c7-131e54beccc3 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:34:15.722152 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdce57c-8594-4a80-a4c7-131e54beccc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:34:15.747952 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-5cdce57c-8594-4a80-a4c7-131e54beccc3 None None] MFA Rules not processed for user `02af03095e48472d96a995a530e78035`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:34:15.749145 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5cdce57c-8594-4a80-a4c7-131e54beccc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:34:15.756544 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1428/2903] 10.222.0.141 () {58 vars in 1014 bytes} [Tue Jul 26 16:34:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:34:15.771049 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e59b1-2160-4fb6-9b23-26a7c81e76fb service placement] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:34:15.783357 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e59b1-2160-4fb6-9b23-26a7c81e76fb service placement] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:34:15.791813 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad14a4-67db-47dc-90cf-d38f8324e157 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c5f92f21868436a99a5c7aaa1fc40b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:34:15.792529 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad14a4-67db-47dc-90cf-d38f8324e157 service swift] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:34:15.792840 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad14a4-67db-47dc-90cf-d38f8324e157 service swift] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:34:15.793314 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad14a4-67db-47dc-90cf-d38f8324e157 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:34:15.802617 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad14a4-67db-47dc-90cf-d38f8324e157 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:34:15.804267 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad14a4-67db-47dc-90cf-d38f8324e157 service swift] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:34:15.813431 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1476/2904] 10.222.0.141 () {60 vars in 1389 bytes} [Tue Jul 26 16:34:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 16:34:23.737185 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdce57c-8594-4a80-a4c7-131e54beccc3 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:34:23.747826 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdce57c-8594-4a80-a4c7-131e54beccc3 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:34:23.751662 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132c8b9-dc9e-4030-a2cb-1f9207524f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:34:23.752308 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132c8b9-dc9e-4030-a2cb-1f9207524f6d service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:34:23.752595 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132c8b9-dc9e-4030-a2cb-1f9207524f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:34:23.752904 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132c8b9-dc9e-4030-a2cb-1f9207524f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:34:23.754816 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4132c8b9-dc9e-4030-a2cb-1f9207524f6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:34:23.765257 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132c8b9-dc9e-4030-a2cb-1f9207524f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:34:23.766697 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132c8b9-dc9e-4030-a2cb-1f9207524f6d service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:34:23.774972 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1429/2905] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:34:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:34:24.634913 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad14a4-67db-47dc-90cf-d38f8324e157 service swift] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:34:24.636296 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-48ad14a4-67db-47dc-90cf-d38f8324e157 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:34:24.664309 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad14a4-67db-47dc-90cf-d38f8324e157 service swift] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:34:24.670655 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12577b4-1849-4848-91fa-662246a4e048 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:34:24.671349 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12577b4-1849-4848-91fa-662246a4e048 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:34:24.671631 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12577b4-1849-4848-91fa-662246a4e048 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:34:24.671909 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12577b4-1849-4848-91fa-662246a4e048 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:34:24.675159 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c12577b4-1849-4848-91fa-662246a4e048 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:34:24.689804 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12577b4-1849-4848-91fa-662246a4e048 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:34:24.692042 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12577b4-1849-4848-91fa-662246a4e048 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:34:24.705946 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1477/2906] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:34:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 16:34:28.506267 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132c8b9-dc9e-4030-a2cb-1f9207524f6d service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:34:28.511621 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4132c8b9-dc9e-4030-a2cb-1f9207524f6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:34:28.534044 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132c8b9-dc9e-4030-a2cb-1f9207524f6d service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:34:28.539792 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f261b4-d6bd-420e-a0a2-2b2524c5cf18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:34:28.540499 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f261b4-d6bd-420e-a0a2-2b2524c5cf18 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:34:28.540765 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f261b4-d6bd-420e-a0a2-2b2524c5cf18 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:34:28.541032 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f261b4-d6bd-420e-a0a2-2b2524c5cf18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:34:28.542818 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c5f261b4-d6bd-420e-a0a2-2b2524c5cf18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:34:28.556624 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f261b4-d6bd-420e-a0a2-2b2524c5cf18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:34:28.558246 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f261b4-d6bd-420e-a0a2-2b2524c5cf18 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:34:28.569831 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1430/2907] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:34:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:34:34.701138 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=87 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:34:36.522004 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12577b4-1849-4848-91fa-662246a4e048 service nova] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:34:36.531770 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12577b4-1849-4848-91fa-662246a4e048 service nova] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:34:36.535514 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27322ae1-7b3c-44e4-bd25-f53244006f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a99faad91b4357973f4bbb6632c724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:34:36.536152 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27322ae1-7b3c-44e4-bd25-f53244006f63 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:34:36.536431 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27322ae1-7b3c-44e4-bd25-f53244006f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:34:36.536728 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27322ae1-7b3c-44e4-bd25-f53244006f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:34:36.547136 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27322ae1-7b3c-44e4-bd25-f53244006f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:34:36.548575 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27322ae1-7b3c-44e4-bd25-f53244006f63 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:34:36.559247 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1478/2908] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:34:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:34:38.564871 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=50 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:34:41.413720 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f261b4-d6bd-420e-a0a2-2b2524c5cf18 service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:34:41.435264 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f261b4-d6bd-420e-a0a2-2b2524c5cf18 service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:34:41.451095 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb135df-c519-4220-802f-7fec7858a627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7eac931cabf4921b6dbd42f63b9300f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:34:41.452472 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb135df-c519-4220-802f-7fec7858a627 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:34:41.453004 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb135df-c519-4220-802f-7fec7858a627 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:34:41.453508 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb135df-c519-4220-802f-7fec7858a627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:34:41.455987 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ffb135df-c519-4220-802f-7fec7858a627 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:34:41.477935 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb135df-c519-4220-802f-7fec7858a627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:34:41.477935 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb135df-c519-4220-802f-7fec7858a627 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:34:41.495584 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1431/2909] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:34:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:34:46.554708 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=6 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:34:51.487837 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=6 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:36:02.132311 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca02580-f09d-4e3b-81f9-885a81024d42 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:36:02.135611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca02580-f09d-4e3b-81f9-885a81024d42 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:36:02.135611 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca02580-f09d-4e3b-81f9-885a81024d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:36:02.153656 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-bca02580-f09d-4e3b-81f9-885a81024d42 None None] MFA Rules not processed for user `02af03095e48472d96a995a530e78035`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 16:36:02.154997 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-bca02580-f09d-4e3b-81f9-885a81024d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:36:02.162410 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1479/2910] 10.222.0.141 () {58 vars in 972 bytes} [Tue Jul 26 16:36:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 16:36:02.205127 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb135df-c519-4220-802f-7fec7858a627 service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:36:02.217154 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb135df-c519-4220-802f-7fec7858a627 service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:36:02.222216 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83f0ef-bf41-4180-8336-78924e83642c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c5f92f21868436a99a5c7aaa1fc40b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:36:02.222900 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83f0ef-bf41-4180-8336-78924e83642c service swift] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:36:02.223156 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83f0ef-bf41-4180-8336-78924e83642c service swift] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:36:02.223434 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83f0ef-bf41-4180-8336-78924e83642c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:36:02.232710 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83f0ef-bf41-4180-8336-78924e83642c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:36:02.234398 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83f0ef-bf41-4180-8336-78924e83642c service swift] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:36:02.243329 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1432/2911] 10.222.0.141 () {60 vars in 1389 bytes} [Tue Jul 26 16:36:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 16:36:06.771504 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca02580-f09d-4e3b-81f9-885a81024d42 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:36:06.773776 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-bca02580-f09d-4e3b-81f9-885a81024d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:36:06.789413 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca02580-f09d-4e3b-81f9-885a81024d42 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:36:06.794752 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468ac80-55fe-417d-8b4d-515f7ff87b6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda05b7b9675423e992470819d1c150a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:36:06.795640 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468ac80-55fe-417d-8b4d-515f7ff87b6f service placement] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:36:06.795922 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468ac80-55fe-417d-8b4d-515f7ff87b6f service placement] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:36:06.796201 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468ac80-55fe-417d-8b4d-515f7ff87b6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:36:06.798052 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8468ac80-55fe-417d-8b4d-515f7ff87b6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:36:06.810651 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468ac80-55fe-417d-8b4d-515f7ff87b6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:36:06.812642 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468ac80-55fe-417d-8b4d-515f7ff87b6f service placement] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:36:06.827974 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1480/2912] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:36:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:36:10.830473 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83f0ef-bf41-4180-8336-78924e83642c service swift] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:36:10.904760 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83f0ef-bf41-4180-8336-78924e83642c service swift] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:36:10.909483 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747647e1-0a38-4606-8ebb-5d30f5388378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:36:10.910150 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747647e1-0a38-4606-8ebb-5d30f5388378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:36:10.910428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747647e1-0a38-4606-8ebb-5d30f5388378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:36:10.910699 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747647e1-0a38-4606-8ebb-5d30f5388378 admin admin] PATH_INFO: `/v3/users/7649f99214b94eda81914ed110a8b0f6` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:36:10.912540 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747647e1-0a38-4606-8ebb-5d30f5388378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7649f99214b94eda81914ed110a8b0f6)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:36:10.917879 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747647e1-0a38-4606-8ebb-5d30f5388378 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:36:11.084327 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-747647e1-0a38-4606-8ebb-5d30f5388378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7649f99214b94eda81914ed110a8b0f6'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:36:11.085026 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-747647e1-0a38-4606-8ebb-5d30f5388378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7649f99214b94eda81914ed110a8b0f6'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:36:11.097322 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-747647e1-0a38-4606-8ebb-5d30f5388378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7649f99214b94eda81914ed110a8b0f6'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:36:11.104444 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-747647e1-0a38-4606-8ebb-5d30f5388378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7649f99214b94eda81914ed110a8b0f6'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:36:11.182554 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-747647e1-0a38-4606-8ebb-5d30f5388378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7649f99214b94eda81914ed110a8b0f6'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:36:11.189070 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1433/2913] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:36:10 2022] DELETE /identity/v3/users/7649f99214b94eda81914ed110a8b0f6 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:36:11.500017 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468ac80-55fe-417d-8b4d-515f7ff87b6f service placement] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:36:11.511834 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468ac80-55fe-417d-8b4d-515f7ff87b6f service placement] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:36:11.583543 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b631bfb-31fb-4608-9fef-35847454cd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:36:11.584800 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b631bfb-31fb-4608-9fef-35847454cd00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:36:11.584800 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b631bfb-31fb-4608-9fef-35847454cd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:36:11.584800 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b631bfb-31fb-4608-9fef-35847454cd00 admin admin] PATH_INFO: `/v3/projects/d95fd28fbe1d4c8b9140d0f8f4172bdb` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:36:11.585908 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b631bfb-31fb-4608-9fef-35847454cd00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d95fd28fbe1d4c8b9140d0f8f4172bdb)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:36:11.587817 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b631bfb-31fb-4608-9fef-35847454cd00 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:36:11.733045 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5b631bfb-31fb-4608-9fef-35847454cd00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd95fd28fbe1d4c8b9140d0f8f4172bdb', 'request_id': 'req-5b631bfb-31fb-4608-9fef-35847454cd00'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:36:11.739846 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5b631bfb-31fb-4608-9fef-35847454cd00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd95fd28fbe1d4c8b9140d0f8f4172bdb', 'request_id': 'req-5b631bfb-31fb-4608-9fef-35847454cd00'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:36:11.745965 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5b631bfb-31fb-4608-9fef-35847454cd00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd95fd28fbe1d4c8b9140d0f8f4172bdb', 'request_id': 'req-5b631bfb-31fb-4608-9fef-35847454cd00'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:36:11.817916 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5b631bfb-31fb-4608-9fef-35847454cd00 admin admin] The token cache is being invalidate because project d95fd28fbe1d4c8b9140d0f8f4172bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:36:11.818215 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5b631bfb-31fb-4608-9fef-35847454cd00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:36:11.818921 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5b631bfb-31fb-4608-9fef-35847454cd00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:36:11.820478 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1481/2914] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:36:11 2022] DELETE /identity/v3/projects/d95fd28fbe1d4c8b9140d0f8f4172bdb => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:36:11.824641 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747647e1-0a38-4606-8ebb-5d30f5388378 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:36:11.826071 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-747647e1-0a38-4606-8ebb-5d30f5388378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:36:11.839896 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747647e1-0a38-4606-8ebb-5d30f5388378 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:36:11.898766 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de3a5f-9fd1-44b8-bed9-1959ffe33f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:36:11.899399 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de3a5f-9fd1-44b8-bed9-1959ffe33f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:36:11.899675 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de3a5f-9fd1-44b8-bed9-1959ffe33f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:36:11.899946 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de3a5f-9fd1-44b8-bed9-1959ffe33f75 admin admin] PATH_INFO: `/v3/users/686d27d858cf4df5967d9d336bc6dc94` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:36:11.901218 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de3a5f-9fd1-44b8-bed9-1959ffe33f75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=686d27d858cf4df5967d9d336bc6dc94)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:36:11.903214 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de3a5f-9fd1-44b8-bed9-1959ffe33f75 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:36:11.909000 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:36:12.072701 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b8de3a5f-9fd1-44b8-bed9-1959ffe33f75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '686d27d858cf4df5967d9d336bc6dc94'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:36:12.073342 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b8de3a5f-9fd1-44b8-bed9-1959ffe33f75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '686d27d858cf4df5967d9d336bc6dc94'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:36:12.086474 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b8de3a5f-9fd1-44b8-bed9-1959ffe33f75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '686d27d858cf4df5967d9d336bc6dc94'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:36:12.095427 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b8de3a5f-9fd1-44b8-bed9-1959ffe33f75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '686d27d858cf4df5967d9d336bc6dc94'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:36:12.154402 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b8de3a5f-9fd1-44b8-bed9-1959ffe33f75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '686d27d858cf4df5967d9d336bc6dc94'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:36:12.160896 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1434/2915] 10.222.0.141 () {58 vars in 1229 bytes} [Tue Jul 26 16:36:11 2022] DELETE /identity/v3/users/686d27d858cf4df5967d9d336bc6dc94 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:36:12.416192 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b631bfb-31fb-4608-9fef-35847454cd00 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:36:12.417664 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5b631bfb-31fb-4608-9fef-35847454cd00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:36:12.435432 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b631bfb-31fb-4608-9fef-35847454cd00 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:36:12.500117 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e3ae7-416a-47d1-878f-c0ca986fb109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6845518adc8f4e04b03cfbd69adea2d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7fee3c27a264e38accf0b43d34d249e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:36:12.500950 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e3ae7-416a-47d1-878f-c0ca986fb109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:36:12.501061 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e3ae7-416a-47d1-878f-c0ca986fb109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:36:12.501344 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e3ae7-416a-47d1-878f-c0ca986fb109 admin admin] PATH_INFO: `/v3/projects/3de47e90bbef444880d6010ebc9ed676` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:36:12.502579 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e3ae7-416a-47d1-878f-c0ca986fb109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de47e90bbef444880d6010ebc9ed676)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:36:12.504686 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e3ae7-416a-47d1-878f-c0ca986fb109 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:36:12.517347 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:36:12.610668 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b80e3ae7-416a-47d1-878f-c0ca986fb109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de47e90bbef444880d6010ebc9ed676', 'request_id': 'req-b80e3ae7-416a-47d1-878f-c0ca986fb109'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:36:12.618888 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b80e3ae7-416a-47d1-878f-c0ca986fb109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de47e90bbef444880d6010ebc9ed676', 'request_id': 'req-b80e3ae7-416a-47d1-878f-c0ca986fb109'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:36:12.624650 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b80e3ae7-416a-47d1-878f-c0ca986fb109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de47e90bbef444880d6010ebc9ed676', 'request_id': 'req-b80e3ae7-416a-47d1-878f-c0ca986fb109'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:36:12.691714 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b80e3ae7-416a-47d1-878f-c0ca986fb109 admin admin] The token cache is being invalidate because project 3de47e90bbef444880d6010ebc9ed676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 16:36:12.691954 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b80e3ae7-416a-47d1-878f-c0ca986fb109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:36:12.692599 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b80e3ae7-416a-47d1-878f-c0ca986fb109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 16:36:12.694191 dv-cinder-851042-1-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1482/2916] 10.222.0.141 () {58 vars in 1238 bytes} [Tue Jul 26 16:36:12 2022] DELETE /identity/v3/projects/3de47e90bbef444880d6010ebc9ed676 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 16:36:22.157209 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:36:22.688183 dv-cinder-851042-1-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:37:18.168389 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de3a5f-9fd1-44b8-bed9-1959ffe33f75 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 16:37:18.172198 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b8de3a5f-9fd1-44b8-bed9-1959ffe33f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:37:18.244609 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de3a5f-9fd1-44b8-bed9-1959ffe33f75 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 16:37:18.308472 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4e5f0-a463-4030-a2f4-93a841435560 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda05b7b9675423e992470819d1c150a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3747e176cdf2495d9b31a1afae618f68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 16:37:18.309141 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4e5f0-a463-4030-a2f4-93a841435560 service placement] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 16:37:18.309428 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4e5f0-a463-4030-a2f4-93a841435560 service placement] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 16:37:18.309704 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4e5f0-a463-4030-a2f4-93a841435560 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 16:37:18.311533 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-94f4e5f0-a463-4030-a2f4-93a841435560 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 16:37:18.324477 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4e5f0-a463-4030-a2f4-93a841435560 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 16:37:18.326099 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4e5f0-a463-4030-a2f4-93a841435560 service placement] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 16:37:18.336591 dv-cinder-851042-1-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1435/2917] 10.222.0.141 () {60 vars in 1370 bytes} [Tue Jul 26 16:37:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 16:37:28.332252 dv-cinder-851042-1-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=58 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}